Generate Muzzle classes for Groovy instrumentations #8004

nikita-tkachenko-datadog · 2024-11-22T20:43:15Z

What Does This Do

Updates the build logic so that $Muzzle classes are generated for instrumentations that are written in Groovy.

Motivation

Currently the Muzzle classes are only generated for Java, Scala, and Kotlin code.
There are instrumentations written in Groovy (gradle-3.0 and gradle-8.3).

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Squash your commits prior merging or merge using GitHub's Squash and merge
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: SCV-208

pr-commenter · 2024-11-22T21:22:07Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/generate-muzzle-for-groovy-instrumentations
git_commit_date	1732290365	1732308105
git_commit_sha	`79ca6e4`	`7ca94c8`
release_version	1.43.0-SNAPSHOT~79ca6e471f	1.43.0-SNAPSHOT~7ca94c8ef1

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1732310480	1732310480
ci_job_id	717753190	717753190
ci_pipeline_id	49770949	49770949
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 10 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.43.0-SNAPSHOT~7ca94c8ef1, baseline=1.43.0-SNAPSHOT~79ca6e471f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.096 s) : 0, 1096120
Total [baseline] (8.675 s) : 0, 8674989
Agent [candidate] (1.089 s) : 0, 1089002
Total [candidate] (8.634 s) : 0, 8633570
section iast
Agent [baseline] (1.217 s) : 0, 1217169
Total [baseline] (9.191 s) : 0, 9191255
Agent [candidate] (1.215 s) : 0, 1214753
Total [candidate] (9.19 s) : 0, 9189819
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.219 s) : 0, 1219470
Total [baseline] (9.207 s) : 0, 9207476
Agent [candidate] (1.218 s) : 0, 1217921
Total [candidate] (9.212 s) : 0, 9212292
section iast_TELEMETRY_OFF
Agent [baseline] (1.214 s) : 0, 1213926
Total [baseline] (9.19 s) : 0, 9190208
Agent [candidate] (1.215 s) : 0, 1215079
Total [candidate] (9.186 s) : 0, 9186102

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.096 s	-
Agent	iast	1.217 s	121.049 ms (11.0%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.219 s	123.35 ms (11.3%)
Agent	iast_TELEMETRY_OFF	1.214 s	117.806 ms (10.7%)
Total	tracing	8.675 s	-
Total	iast	9.191 s	516.266 ms (6.0%)
Total	iast_HARDCODED_SECRET_DISABLED	9.207 s	532.487 ms (6.1%)
Total	iast_TELEMETRY_OFF	9.19 s	515.219 ms (5.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.089 s	-
Agent	iast	1.215 s	125.751 ms (11.5%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.218 s	128.919 ms (11.8%)
Agent	iast_TELEMETRY_OFF	1.215 s	126.077 ms (11.6%)
Total	tracing	8.634 s	-
Total	iast	9.19 s	556.249 ms (6.4%)
Total	iast_HARDCODED_SECRET_DISABLED	9.212 s	578.722 ms (6.7%)
Total	iast_TELEMETRY_OFF	9.186 s	552.533 ms (6.4%)

gantt
    title insecure-bank - break down per module: candidate=1.43.0-SNAPSHOT~7ca94c8ef1, baseline=1.43.0-SNAPSHOT~79ca6e471f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (696.209 ms) : 0, 696209
BytebuddyAgent [candidate] (692.193 ms) : 0, 692193
GlobalTracer [baseline] (319.077 ms) : 0, 319077
GlobalTracer [candidate] (317.182 ms) : 0, 317182
AppSec [baseline] (54.964 ms) : 0, 54964
AppSec [candidate] (54.484 ms) : 0, 54484
Remote Config [baseline] (686.482 µs) : 0, 686
Remote Config [candidate] (683.496 µs) : 0, 683
Telemetry [baseline] (11.378 ms) : 0, 11378
Telemetry [candidate] (10.738 ms) : 0, 10738
section iast
BytebuddyAgent [baseline] (810.019 ms) : 0, 810019
BytebuddyAgent [candidate] (808.034 ms) : 0, 808034
GlobalTracer [baseline] (306.852 ms) : 0, 306852
GlobalTracer [candidate] (306.325 ms) : 0, 306325
AppSec [baseline] (56.987 ms) : 0, 56987
AppSec [candidate] (57.089 ms) : 0, 57089
IAST [baseline] (21.463 ms) : 0, 21463
IAST [candidate] (21.529 ms) : 0, 21529
Remote Config [baseline] (613.433 µs) : 0, 613
Remote Config [candidate] (617.928 µs) : 0, 618
Telemetry [baseline] (7.498 ms) : 0, 7498
Telemetry [candidate] (7.477 ms) : 0, 7477
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (809.964 ms) : 0, 809964
BytebuddyAgent [candidate] (809.853 ms) : 0, 809853
GlobalTracer [baseline] (307.369 ms) : 0, 307369
GlobalTracer [candidate] (306.681 ms) : 0, 306681
AppSec [baseline] (56.46 ms) : 0, 56460
AppSec [candidate] (58.377 ms) : 0, 58377
IAST [baseline] (23.758 ms) : 0, 23758
IAST [candidate] (21.025 ms) : 0, 21025
Remote Config [baseline] (624.28 µs) : 0, 624
Remote Config [candidate] (633.607 µs) : 0, 634
Telemetry [baseline] (7.544 ms) : 0, 7544
Telemetry [candidate] (7.596 ms) : 0, 7596
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (805.983 ms) : 0, 805983
BytebuddyAgent [candidate] (807.352 ms) : 0, 807352
GlobalTracer [baseline] (307.662 ms) : 0, 307662
GlobalTracer [candidate] (307.366 ms) : 0, 307366
AppSec [baseline] (58.294 ms) : 0, 58294
AppSec [candidate] (57.462 ms) : 0, 57462
IAST [baseline] (20.313 ms) : 0, 20313
IAST [candidate] (21.134 ms) : 0, 21134
Remote Config [baseline] (625.902 µs) : 0, 626
Remote Config [candidate] (644.642 µs) : 0, 645
Telemetry [baseline] (7.373 ms) : 0, 7373
Telemetry [candidate] (7.405 ms) : 0, 7405

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.43.0-SNAPSHOT~7ca94c8ef1, baseline=1.43.0-SNAPSHOT~79ca6e471f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.093 s) : 0, 1093027
Total [baseline] (10.489 s) : 0, 10489176
Agent [candidate] (1.09 s) : 0, 1090245
Total [candidate] (10.443 s) : 0, 10442914
section appsec
Agent [baseline] (1.225 s) : 0, 1225271
Total [baseline] (10.763 s) : 0, 10763170
Agent [candidate] (1.228 s) : 0, 1228498
Total [candidate] (10.753 s) : 0, 10753195
section iast
Agent [baseline] (1.216 s) : 0, 1215965
Total [baseline] (10.984 s) : 0, 10983656
Agent [candidate] (1.218 s) : 0, 1217774
Total [candidate] (10.958 s) : 0, 10957888
section profiling
Agent [baseline] (1.324 s) : 0, 1323616
Total [baseline] (10.853 s) : 0, 10852889
Agent [candidate] (1.326 s) : 0, 1326360
Total [candidate] (10.905 s) : 0, 10905456

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.093 s	-
Agent	appsec	1.225 s	132.244 ms (12.1%)
Agent	iast	1.216 s	122.938 ms (11.2%)
Agent	profiling	1.324 s	230.589 ms (21.1%)
Total	tracing	10.489 s	-
Total	appsec	10.763 s	273.994 ms (2.6%)
Total	iast	10.984 s	494.48 ms (4.7%)
Total	profiling	10.853 s	363.713 ms (3.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.09 s	-
Agent	appsec	1.228 s	138.253 ms (12.7%)
Agent	iast	1.218 s	127.529 ms (11.7%)
Agent	profiling	1.326 s	236.115 ms (21.7%)
Total	tracing	10.443 s	-
Total	appsec	10.753 s	310.281 ms (3.0%)
Total	iast	10.958 s	514.974 ms (4.9%)
Total	profiling	10.905 s	462.542 ms (4.4%)

gantt
    title petclinic - break down per module: candidate=1.43.0-SNAPSHOT~7ca94c8ef1, baseline=1.43.0-SNAPSHOT~79ca6e471f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (697.673 ms) : 0, 697673
BytebuddyAgent [candidate] (694.141 ms) : 0, 694141
GlobalTracer [baseline] (317.713 ms) : 0, 317713
GlobalTracer [candidate] (318.434 ms) : 0, 318434
AppSec [baseline] (54.513 ms) : 0, 54513
AppSec [candidate] (54.677 ms) : 0, 54677
Remote Config [baseline] (697.551 µs) : 0, 698
Remote Config [candidate] (684.159 µs) : 0, 684
Telemetry [baseline] (8.614 ms) : 0, 8614
Telemetry [candidate] (8.569 ms) : 0, 8569
section appsec
BytebuddyAgent [baseline] (710.669 ms) : 0, 710669
BytebuddyAgent [candidate] (712.934 ms) : 0, 712934
GlobalTracer [baseline] (314.505 ms) : 0, 314505
GlobalTracer [candidate] (315.651 ms) : 0, 315651
AppSec [baseline] (167.98 ms) : 0, 167980
AppSec [candidate] (166.246 ms) : 0, 166246
IAST [baseline] (20.536 ms) : 0, 20536
IAST [candidate] (19.921 ms) : 0, 19921
Remote Config [baseline] (655.851 µs) : 0, 656
Remote Config [candidate] (648.174 µs) : 0, 648
Telemetry [baseline] (7.484 ms) : 0, 7484
Telemetry [candidate] (9.318 ms) : 0, 9318
section iast
BytebuddyAgent [baseline] (808.316 ms) : 0, 808316
BytebuddyAgent [candidate] (809.846 ms) : 0, 809846
GlobalTracer [baseline] (306.483 ms) : 0, 306483
GlobalTracer [candidate] (306.963 ms) : 0, 306963
AppSec [baseline] (57.621 ms) : 0, 57621
AppSec [candidate] (57.353 ms) : 0, 57353
IAST [baseline] (21.687 ms) : 0, 21687
IAST [candidate] (21.734 ms) : 0, 21734
Remote Config [baseline] (621.903 µs) : 0, 622
Remote Config [candidate] (622.955 µs) : 0, 623
Telemetry [baseline] (7.553 ms) : 0, 7553
Telemetry [candidate] (7.531 ms) : 0, 7531
section profiling
BytebuddyAgent [baseline] (691.976 ms) : 0, 691976
BytebuddyAgent [candidate] (691.081 ms) : 0, 691081
GlobalTracer [baseline] (436.335 ms) : 0, 436335
GlobalTracer [candidate] (439.032 ms) : 0, 439032
AppSec [baseline] (53.559 ms) : 0, 53559
AppSec [candidate] (54.222 ms) : 0, 54222
Remote Config [baseline] (675.769 µs) : 0, 676
Remote Config [candidate] (661.697 µs) : 0, 662
Telemetry [baseline] (7.814 ms) : 0, 7814
Telemetry [candidate] (7.826 ms) : 0, 7826
ProfilingAgent [baseline] (93.935 ms) : 0, 93935
ProfilingAgent [candidate] (94.283 ms) : 0, 94283
Profiling [baseline] (93.958 ms) : 0, 93958
Profiling [candidate] (94.307 ms) : 0, 94307

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2024-11-22T20:51:26	2024-11-22T20:58:22
git_branch	master	nikita-tkachenko/generate-muzzle-for-groovy-instrumentations
git_commit_date	1732290365	1732308105
git_commit_sha	`79ca6e4`	`7ca94c8`
release_version	1.43.0-SNAPSHOT~79ca6e471f	1.43.0-SNAPSHOT~7ca94c8ef1
start_time	2024-11-22T20:51:12	2024-11-22T20:58:09

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1732309454	1732309454
ci_job_id	717753191	717753191
ci_pipeline_id	49770949	49770949
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.43.0-SNAPSHOT~7ca94c8ef1, baseline=1.43.0-SNAPSHOT~79ca6e471f
    dateFormat X
    axisFormat %s
section baseline
no_agent (374.131 µs) : 354, 394
.   : milestone, 374,
iast (491.82 µs) : 470, 514
.   : milestone, 492,
iast_FULL (650.523 µs) : 629, 672
.   : milestone, 651,
iast_GLOBAL (512.272 µs) : 491, 534
.   : milestone, 512,
iast_HARDCODED_SECRET_DISABLED (489.779 µs) : 468, 511
.   : milestone, 490,
iast_INACTIVE (450.839 µs) : 429, 472
.   : milestone, 451,
iast_TELEMETRY_OFF (479.679 µs) : 458, 501
.   : milestone, 480,
tracing (438.478 µs) : 418, 459
.   : milestone, 438,
section candidate
no_agent (375.688 µs) : 356, 395
.   : milestone, 376,
iast (483.74 µs) : 462, 505
.   : milestone, 484,
iast_FULL (654.604 µs) : 633, 676
.   : milestone, 655,
iast_GLOBAL (512.1 µs) : 491, 533
.   : milestone, 512,
iast_HARDCODED_SECRET_DISABLED (487.14 µs) : 466, 508
.   : milestone, 487,
iast_INACTIVE (453.883 µs) : 432, 476
.   : milestone, 454,
iast_TELEMETRY_OFF (472.431 µs) : 451, 494
.   : milestone, 472,
tracing (438.912 µs) : 418, 460
.   : milestone, 439,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	374.131 µs [354.49 µs, 393.772 µs]	-
iast	491.82 µs [469.819 µs, 513.821 µs]	117.689 µs (31.5%)
iast_FULL	650.523 µs [628.986 µs, 672.061 µs]	276.392 µs (73.9%)
iast_GLOBAL	512.272 µs [490.858 µs, 533.685 µs]	138.14 µs (36.9%)
iast_HARDCODED_SECRET_DISABLED	489.779 µs [468.215 µs, 511.343 µs]	115.648 µs (30.9%)
iast_INACTIVE	450.839 µs [429.478 µs, 472.201 µs]	76.708 µs (20.5%)
iast_TELEMETRY_OFF	479.679 µs [457.94 µs, 501.418 µs]	105.548 µs (28.2%)
tracing	438.478 µs [418.025 µs, 458.931 µs]	64.347 µs (17.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	375.688 µs [356.187 µs, 395.19 µs]	-
iast	483.74 µs [462.339 µs, 505.141 µs]	108.052 µs (28.8%)
iast_FULL	654.604 µs [632.935 µs, 676.273 µs]	278.916 µs (74.2%)
iast_GLOBAL	512.1 µs [490.851 µs, 533.349 µs]	136.412 µs (36.3%)
iast_HARDCODED_SECRET_DISABLED	487.14 µs [465.895 µs, 508.385 µs]	111.452 µs (29.7%)
iast_INACTIVE	453.883 µs [431.948 µs, 475.818 µs]	78.195 µs (20.8%)
iast_TELEMETRY_OFF	472.431 µs [450.933 µs, 493.929 µs]	96.743 µs (25.8%)
tracing	438.912 µs [418.065 µs, 459.759 µs]	63.224 µs (16.8%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.43.0-SNAPSHOT~7ca94c8ef1, baseline=1.43.0-SNAPSHOT~79ca6e471f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.347 ms) : 1326, 1367
.   : milestone, 1347,
appsec (1.743 ms) : 1718, 1767
.   : milestone, 1743,
appsec_no_iast (1.751 ms) : 1727, 1776
.   : milestone, 1751,
iast (1.479 ms) : 1456, 1502
.   : milestone, 1479,
profiling (1.509 ms) : 1485, 1533
.   : milestone, 1509,
tracing (1.492 ms) : 1468, 1516
.   : milestone, 1492,
section candidate
no_agent (1.35 ms) : 1331, 1370
.   : milestone, 1350,
appsec (1.741 ms) : 1717, 1765
.   : milestone, 1741,
appsec_no_iast (1.759 ms) : 1735, 1784
.   : milestone, 1759,
iast (1.489 ms) : 1467, 1512
.   : milestone, 1489,
profiling (1.514 ms) : 1489, 1539
.   : milestone, 1514,
tracing (1.487 ms) : 1463, 1510
.   : milestone, 1487,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.347 ms [1.326 ms, 1.367 ms]	-
appsec	1.743 ms [1.718 ms, 1.767 ms]	396.183 µs (29.4%)
appsec_no_iast	1.751 ms [1.727 ms, 1.776 ms]	404.539 µs (30.0%)
iast	1.479 ms [1.456 ms, 1.502 ms]	132.837 µs (9.9%)
profiling	1.509 ms [1.485 ms, 1.533 ms]	162.504 µs (12.1%)
tracing	1.492 ms [1.468 ms, 1.516 ms]	145.487 µs (10.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.35 ms [1.331 ms, 1.37 ms]	-
appsec	1.741 ms [1.717 ms, 1.765 ms]	390.676 µs (28.9%)
appsec_no_iast	1.759 ms [1.735 ms, 1.784 ms]	408.92 µs (30.3%)
iast	1.489 ms [1.467 ms, 1.512 ms]	138.72 µs (10.3%)
profiling	1.514 ms [1.489 ms, 1.539 ms]	163.677 µs (12.1%)
tracing	1.487 ms [1.463 ms, 1.51 ms]	136.084 µs (10.1%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/generate-muzzle-for-groovy-instrumentations
git_commit_date	1732290365	1732308105
git_commit_sha	`79ca6e4`	`7ca94c8`
release_version	1.43.0-SNAPSHOT~79ca6e471f	1.43.0-SNAPSHOT~7ca94c8ef1

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1732309967	1732309967
ci_job_id	717753192	717753192
ci_pipeline_id	49770949	49770949
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.43.0-SNAPSHOT~7ca94c8ef1, baseline=1.43.0-SNAPSHOT~79ca6e471f
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.961 s) : 14961000, 14961000
.   : milestone, 14961000,
appsec (14.736 s) : 14736000, 14736000
.   : milestone, 14736000,
iast (18.817 s) : 18817000, 18817000
.   : milestone, 18817000,
iast_GLOBAL (18.034 s) : 18034000, 18034000
.   : milestone, 18034000,
profiling (15.01 s) : 15010000, 15010000
.   : milestone, 15010000,
tracing (15.199 s) : 15199000, 15199000
.   : milestone, 15199000,
section candidate
no_agent (14.96 s) : 14960000, 14960000
.   : milestone, 14960000,
appsec (14.879 s) : 14879000, 14879000
.   : milestone, 14879000,
iast (18.459 s) : 18459000, 18459000
.   : milestone, 18459000,
iast_GLOBAL (17.937 s) : 17937000, 17937000
.   : milestone, 17937000,
profiling (15.05 s) : 15050000, 15050000
.   : milestone, 15050000,
tracing (15.022 s) : 15022000, 15022000
.   : milestone, 15022000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.961 s [14.961 s, 14.961 s]	-
appsec	14.736 s [14.736 s, 14.736 s]	-225.0 ms (-1.5%)
iast	18.817 s [18.817 s, 18.817 s]	3.856 s (25.8%)
iast_GLOBAL	18.034 s [18.034 s, 18.034 s]	3.073 s (20.5%)
profiling	15.01 s [15.01 s, 15.01 s]	49.0 ms (0.3%)
tracing	15.199 s [15.199 s, 15.199 s]	238.0 ms (1.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.96 s [14.96 s, 14.96 s]	-
appsec	14.879 s [14.879 s, 14.879 s]	-81.0 ms (-0.5%)
iast	18.459 s [18.459 s, 18.459 s]	3.499 s (23.4%)
iast_GLOBAL	17.937 s [17.937 s, 17.937 s]	2.977 s (19.9%)
profiling	15.05 s [15.05 s, 15.05 s]	90.0 ms (0.6%)
tracing	15.022 s [15.022 s, 15.022 s]	62.0 ms (0.4%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.43.0-SNAPSHOT~7ca94c8ef1, baseline=1.43.0-SNAPSHOT~79ca6e471f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.466 ms) : 1455, 1478
.   : milestone, 1466,
appsec (2.333 ms) : 2292, 2374
.   : milestone, 2333,
iast (2.086 ms) : 2034, 2139
.   : milestone, 2086,
iast_GLOBAL (2.118 ms) : 2066, 2171
.   : milestone, 2118,
profiling (1.964 ms) : 1921, 2007
.   : milestone, 1964,
tracing (1.92 ms) : 1880, 1960
.   : milestone, 1920,
section candidate
no_agent (1.468 ms) : 1457, 1480
.   : milestone, 1468,
appsec (2.335 ms) : 2294, 2376
.   : milestone, 2335,
iast (2.076 ms) : 2024, 2128
.   : milestone, 2076,
iast_GLOBAL (2.115 ms) : 2063, 2167
.   : milestone, 2115,
profiling (1.951 ms) : 1909, 1992
.   : milestone, 1951,
tracing (1.918 ms) : 1879, 1958
.   : milestone, 1918,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.466 ms [1.455 ms, 1.478 ms]	-
appsec	2.333 ms [2.292 ms, 2.374 ms]	866.964 µs (59.1%)
iast	2.086 ms [2.034 ms, 2.139 ms]	620.23 µs (42.3%)
iast_GLOBAL	2.118 ms [2.066 ms, 2.171 ms]	652.329 µs (44.5%)
profiling	1.964 ms [1.921 ms, 2.007 ms]	498.072 µs (34.0%)
tracing	1.92 ms [1.88 ms, 1.96 ms]	453.689 µs (30.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.468 ms [1.457 ms, 1.48 ms]	-
appsec	2.335 ms [2.294 ms, 2.376 ms]	866.632 µs (59.0%)
iast	2.076 ms [2.024 ms, 2.128 ms]	607.961 µs (41.4%)
iast_GLOBAL	2.115 ms [2.063 ms, 2.167 ms]	646.466 µs (44.0%)
profiling	1.951 ms [1.909 ms, 1.992 ms]	482.36 µs (32.9%)
tracing	1.918 ms [1.879 ms, 1.958 ms]	450.073 µs (30.7%)

Generate Muzzle for Groovy instrumentations

7ca94c8

nikita-tkachenko-datadog added the comp: tooling Build & Tooling label Nov 22, 2024

nikita-tkachenko-datadog marked this pull request as ready for review November 25, 2024 10:12

nikita-tkachenko-datadog requested a review from a team as a code owner November 25, 2024 10:12

nikita-tkachenko-datadog requested a review from ygree November 25, 2024 10:12

nikita-tkachenko-datadog added the type: enhancement label Nov 25, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Generate Muzzle classes for Groovy instrumentations #8004

Generate Muzzle classes for Groovy instrumentations #8004

nikita-tkachenko-datadog commented Nov 22, 2024 •

edited

Loading

pr-commenter bot commented Nov 22, 2024

Generate Muzzle classes for Groovy instrumentations #8004

Are you sure you want to change the base?

Generate Muzzle classes for Groovy instrumentations #8004

Conversation

nikita-tkachenko-datadog commented Nov 22, 2024 • edited Loading

What Does This Do

Motivation

Contributor Checklist

pr-commenter bot commented Nov 22, 2024

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

nikita-tkachenko-datadog commented Nov 22, 2024 •

edited

Loading