Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Piotr wolski/instrument kafka connectors #7959

Draft
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

piochelepiotr
Copy link
Contributor

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@piochelepiotr piochelepiotr force-pushed the piotr-wolski/instrument-kafka-connectors branch from 5b5089c to ff9bbf2 Compare November 18, 2024 21:53
@piochelepiotr piochelepiotr force-pushed the piotr-wolski/instrument-kafka-connectors branch from ff9bbf2 to 0127246 Compare November 18, 2024 21:53
@pr-commenter
Copy link

pr-commenter bot commented Nov 18, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master piotr-wolski/instrument-kafka-connectors
git_commit_date 1731943603 1731966783
git_commit_sha 6181783 ff9bbf2
release_version 1.43.0-SNAPSHOT~6181783bd1 1.42.0-SNAPSHOT~ff9bbf2b31
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1731969221 1731969221
ci_job_id 711406200 711406200
ci_pipeline_id 49320710 49320710
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 12 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.42.0-SNAPSHOT~ff9bbf2b31, baseline=1.43.0-SNAPSHOT~6181783bd1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.083 s) : 0, 1083325
Total [baseline] (8.61 s) : 0, 8610246
Agent [candidate] (1.085 s) : 0, 1085388
Total [candidate] (8.581 s) : 0, 8580686
section iast
Agent [baseline] (1.216 s) : 0, 1216372
Total [baseline] (9.145 s) : 0, 9144808
Agent [candidate] (1.211 s) : 0, 1211270
Total [candidate] (9.178 s) : 0, 9178293
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.221 s) : 0, 1221280
Total [baseline] (9.18 s) : 0, 9180006
Agent [candidate] (1.219 s) : 0, 1218550
Total [candidate] (9.114 s) : 0, 9114227
section iast_TELEMETRY_OFF
Agent [baseline] (1.207 s) : 0, 1206910
Total [baseline] (9.157 s) : 0, 9156817
Agent [candidate] (1.205 s) : 0, 1205132
Total [candidate] (9.142 s) : 0, 9142153
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.083 s -
Agent iast 1.216 s 133.048 ms (12.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.221 s 137.955 ms (12.7%)
Agent iast_TELEMETRY_OFF 1.207 s 123.585 ms (11.4%)
Total tracing 8.61 s -
Total iast 9.145 s 534.563 ms (6.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.18 s 569.76 ms (6.6%)
Total iast_TELEMETRY_OFF 9.157 s 546.572 ms (6.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent iast 1.211 s 125.882 ms (11.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.219 s 133.162 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.205 s 119.744 ms (11.0%)
Total tracing 8.581 s -
Total iast 9.178 s 597.607 ms (7.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.114 s 533.541 ms (6.2%)
Total iast_TELEMETRY_OFF 9.142 s 561.467 ms (6.5%)
gantt
    title insecure-bank - break down per module: candidate=1.42.0-SNAPSHOT~ff9bbf2b31, baseline=1.43.0-SNAPSHOT~6181783bd1

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (689.15 ms) : 0, 689150
BytebuddyAgent [candidate] (688.716 ms) : 0, 688716
GlobalTracer [baseline] (316.966 ms) : 0, 316966
GlobalTracer [candidate] (316.963 ms) : 0, 316963
AppSec [baseline] (54.252 ms) : 0, 54252
AppSec [candidate] (54.193 ms) : 0, 54193
Remote Config [baseline] (675.65 µs) : 0, 676
Remote Config [candidate] (678.363 µs) : 0, 678
Telemetry [baseline] (8.56 ms) : 0, 8560
Telemetry [candidate] (11.099 ms) : 0, 11099
section iast
BytebuddyAgent [baseline] (809.253 ms) : 0, 809253
BytebuddyAgent [candidate] (804.738 ms) : 0, 804738
GlobalTracer [baseline] (307.65 ms) : 0, 307650
GlobalTracer [candidate] (306.563 ms) : 0, 306563
AppSec [baseline] (55.809 ms) : 0, 55809
AppSec [candidate] (56.044 ms) : 0, 56044
Remote Config [baseline] (604.516 µs) : 0, 605
Remote Config [candidate] (604.641 µs) : 0, 605
Telemetry [baseline] (7.39 ms) : 0, 7390
Telemetry [candidate] (7.422 ms) : 0, 7422
IAST [baseline] (21.92 ms) : 0, 21920
IAST [candidate] (22.153 ms) : 0, 22153
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (811.882 ms) : 0, 811882
BytebuddyAgent [candidate] (810.288 ms) : 0, 810288
GlobalTracer [baseline] (308.461 ms) : 0, 308461
GlobalTracer [candidate] (307.879 ms) : 0, 307879
AppSec [baseline] (57.288 ms) : 0, 57288
AppSec [candidate] (57.004 ms) : 0, 57004
Remote Config [baseline] (702.139 µs) : 0, 702
Remote Config [candidate] (622.915 µs) : 0, 623
Telemetry [baseline] (7.593 ms) : 0, 7593
Telemetry [candidate] (7.528 ms) : 0, 7528
IAST [baseline] (21.587 ms) : 0, 21587
IAST [candidate] (21.412 ms) : 0, 21412
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (801.239 ms) : 0, 801239
BytebuddyAgent [candidate] (800.289 ms) : 0, 800289
GlobalTracer [baseline] (305.534 ms) : 0, 305534
GlobalTracer [candidate] (305.905 ms) : 0, 305905
AppSec [baseline] (58.224 ms) : 0, 58224
AppSec [candidate] (56.744 ms) : 0, 56744
Remote Config [baseline] (613.251 µs) : 0, 613
Remote Config [candidate] (593.121 µs) : 0, 593
Telemetry [baseline] (7.386 ms) : 0, 7386
Telemetry [candidate] (7.276 ms) : 0, 7276
IAST [baseline] (20.239 ms) : 0, 20239
IAST [candidate] (20.658 ms) : 0, 20658
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.42.0-SNAPSHOT~ff9bbf2b31, baseline=1.43.0-SNAPSHOT~6181783bd1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.081 s) : 0, 1081098
Total [baseline] (10.445 s) : 0, 10445280
Agent [candidate] (1.086 s) : 0, 1085973
Total [candidate] (10.368 s) : 0, 10368433
section appsec
Agent [baseline] (1.219 s) : 0, 1218632
Total [baseline] (10.667 s) : 0, 10666697
Agent [candidate] (1.223 s) : 0, 1222718
Total [candidate] (10.703 s) : 0, 10702855
section iast
Agent [baseline] (1.221 s) : 0, 1220834
Total [baseline] (10.895 s) : 0, 10895499
Agent [candidate] (1.211 s) : 0, 1210657
Total [candidate] (10.934 s) : 0, 10934146
section profiling
Agent [baseline] (1.281 s) : 0, 1280736
Total [baseline] (10.849 s) : 0, 10849384
Agent [candidate] (1.282 s) : 0, 1282481
Total [candidate] (10.753 s) : 0, 10753004
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent appsec 1.219 s 137.534 ms (12.7%)
Agent iast 1.221 s 139.736 ms (12.9%)
Agent profiling 1.281 s 199.638 ms (18.5%)
Total tracing 10.445 s -
Total appsec 10.667 s 221.418 ms (2.1%)
Total iast 10.895 s 450.22 ms (4.3%)
Total profiling 10.849 s 404.104 ms (3.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.086 s -
Agent appsec 1.223 s 136.745 ms (12.6%)
Agent iast 1.211 s 124.684 ms (11.5%)
Agent profiling 1.282 s 196.508 ms (18.1%)
Total tracing 10.368 s -
Total appsec 10.703 s 334.423 ms (3.2%)
Total iast 10.934 s 565.713 ms (5.5%)
Total profiling 10.753 s 384.571 ms (3.7%)
gantt
    title petclinic - break down per module: candidate=1.42.0-SNAPSHOT~ff9bbf2b31, baseline=1.43.0-SNAPSHOT~6181783bd1

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (687.83 ms) : 0, 687830
BytebuddyAgent [candidate] (689.008 ms) : 0, 689008
GlobalTracer [baseline] (316.35 ms) : 0, 316350
GlobalTracer [candidate] (317.204 ms) : 0, 317204
AppSec [baseline] (54.07 ms) : 0, 54070
AppSec [candidate] (54.166 ms) : 0, 54166
Remote Config [baseline] (680.231 µs) : 0, 680
Remote Config [candidate] (674.381 µs) : 0, 674
Telemetry [baseline] (8.501 ms) : 0, 8501
Telemetry [candidate] (11.186 ms) : 0, 11186
section appsec
BytebuddyAgent [baseline] (705.235 ms) : 0, 705235
BytebuddyAgent [candidate] (708.644 ms) : 0, 708644
GlobalTracer [baseline] (314.79 ms) : 0, 314790
GlobalTracer [candidate] (315.605 ms) : 0, 315605
AppSec [baseline] (166.494 ms) : 0, 166494
AppSec [candidate] (166.683 ms) : 0, 166683
Remote Config [baseline] (639.617 µs) : 0, 640
Remote Config [candidate] (640.598 µs) : 0, 641
Telemetry [baseline] (7.764 ms) : 0, 7764
Telemetry [candidate] (7.787 ms) : 0, 7787
IAST [baseline] (20.129 ms) : 0, 20129
IAST [candidate] (19.306 ms) : 0, 19306
section iast
BytebuddyAgent [baseline] (812.724 ms) : 0, 812724
BytebuddyAgent [candidate] (804.569 ms) : 0, 804569
GlobalTracer [baseline] (308.228 ms) : 0, 308228
GlobalTracer [candidate] (305.259 ms) : 0, 305259
AppSec [baseline] (57.661 ms) : 0, 57661
AppSec [candidate] (57.285 ms) : 0, 57285
Remote Config [baseline] (599.726 µs) : 0, 600
Remote Config [candidate] (617.81 µs) : 0, 618
Telemetry [baseline] (7.393 ms) : 0, 7393
Telemetry [candidate] (7.491 ms) : 0, 7491
IAST [baseline] (20.452 ms) : 0, 20452
IAST [candidate] (21.724 ms) : 0, 21724
section profiling
BytebuddyAgent [baseline] (681.732 ms) : 0, 681732
BytebuddyAgent [candidate] (683.751 ms) : 0, 683751
GlobalTracer [baseline] (400.475 ms) : 0, 400475
GlobalTracer [candidate] (400.987 ms) : 0, 400987
AppSec [baseline] (54.678 ms) : 0, 54678
AppSec [candidate] (54.609 ms) : 0, 54609
Remote Config [baseline] (672.149 µs) : 0, 672
Remote Config [candidate] (739.324 µs) : 0, 739
Telemetry [baseline] (11.392 ms) : 0, 11392
Telemetry [candidate] (12.797 ms) : 0, 12797
ProfilingAgent [baseline] (92.998 ms) : 0, 92998
ProfilingAgent [candidate] (90.811 ms) : 0, 90811
Profiling [baseline] (93.021 ms) : 0, 93021
Profiling [candidate] (90.834 ms) : 0, 90834
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-11-18T22:03:55 2024-11-18T22:10:51
git_branch master piotr-wolski/instrument-kafka-connectors
git_commit_date 1731943603 1731966783
git_commit_sha 6181783 ff9bbf2
release_version 1.43.0-SNAPSHOT~6181783bd1 1.42.0-SNAPSHOT~ff9bbf2b31
start_time 2024-11-18T22:03:41 2024-11-18T22:10:38
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1731968202 1731968202
ci_job_id 711406201 711406201
ci_pipeline_id 49320710 49320710
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 17 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling better
[-82.864µs; -32.214µs] or [-5.338%; -2.075%]
unstable
[-482.804op/s; +710.724op/s] or [-16.295%; +23.987%]
1.495ms 3076.923op/s 1.552ms 2962.963op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~ff9bbf2b31, baseline=1.43.0-SNAPSHOT~6181783bd1
    dateFormat X
    axisFormat %s
section baseline
no_agent (373.921 µs) : 354, 393
.   : milestone, 374,
iast (495.929 µs) : 475, 517
.   : milestone, 496,
iast_FULL (647.512 µs) : 626, 669
.   : milestone, 648,
iast_GLOBAL (510.135 µs) : 489, 531
.   : milestone, 510,
iast_HARDCODED_SECRET_DISABLED (487.517 µs) : 466, 509
.   : milestone, 488,
iast_INACTIVE (452.178 µs) : 431, 474
.   : milestone, 452,
iast_TELEMETRY_OFF (478.866 µs) : 458, 500
.   : milestone, 479,
tracing (448.023 µs) : 427, 469
.   : milestone, 448,
section candidate
no_agent (370.348 µs) : 350, 391
.   : milestone, 370,
iast (494.914 µs) : 473, 517
.   : milestone, 495,
iast_FULL (649.316 µs) : 627, 671
.   : milestone, 649,
iast_GLOBAL (524.831 µs) : 503, 546
.   : milestone, 525,
iast_HARDCODED_SECRET_DISABLED (490.088 µs) : 469, 511
.   : milestone, 490,
iast_INACTIVE (454.679 µs) : 434, 475
.   : milestone, 455,
iast_TELEMETRY_OFF (479.476 µs) : 459, 500
.   : milestone, 479,
tracing (453.716 µs) : 433, 474
.   : milestone, 454,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 373.921 µs [354.364 µs, 393.477 µs] -
iast 495.929 µs [474.86 µs, 516.997 µs] 122.008 µs (32.6%)
iast_FULL 647.512 µs [626.294 µs, 668.731 µs] 273.592 µs (73.2%)
iast_GLOBAL 510.135 µs [489.114 µs, 531.155 µs] 136.214 µs (36.4%)
iast_HARDCODED_SECRET_DISABLED 487.517 µs [466.34 µs, 508.694 µs] 113.597 µs (30.4%)
iast_INACTIVE 452.178 µs [430.704 µs, 473.653 µs] 78.258 µs (20.9%)
iast_TELEMETRY_OFF 478.866 µs [457.612 µs, 500.12 µs] 104.945 µs (28.1%)
tracing 448.023 µs [426.904 µs, 469.142 µs] 74.103 µs (19.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 370.348 µs [350.178 µs, 390.519 µs] -
iast 494.914 µs [473.009 µs, 516.818 µs] 124.566 µs (33.6%)
iast_FULL 649.316 µs [627.148 µs, 671.484 µs] 278.968 µs (75.3%)
iast_GLOBAL 524.831 µs [503.258 µs, 546.405 µs] 154.483 µs (41.7%)
iast_HARDCODED_SECRET_DISABLED 490.088 µs [468.811 µs, 511.365 µs] 119.74 µs (32.3%)
iast_INACTIVE 454.679 µs [433.937 µs, 475.421 µs] 84.331 µs (22.8%)
iast_TELEMETRY_OFF 479.476 µs [458.5 µs, 500.452 µs] 109.128 µs (29.5%)
tracing 453.716 µs [433.118 µs, 474.313 µs] 83.368 µs (22.5%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~ff9bbf2b31, baseline=1.43.0-SNAPSHOT~6181783bd1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.352 ms) : 1333, 1372
.   : milestone, 1352,
appsec (1.743 ms) : 1721, 1765
.   : milestone, 1743,
appsec_no_iast (1.765 ms) : 1742, 1789
.   : milestone, 1765,
iast (1.499 ms) : 1477, 1522
.   : milestone, 1499,
profiling (1.552 ms) : 1528, 1577
.   : milestone, 1552,
tracing (1.46 ms) : 1436, 1485
.   : milestone, 1460,
section candidate
no_agent (1.336 ms) : 1316, 1355
.   : milestone, 1336,
appsec (1.734 ms) : 1710, 1757
.   : milestone, 1734,
appsec_no_iast (1.74 ms) : 1716, 1764
.   : milestone, 1740,
iast (1.505 ms) : 1482, 1527
.   : milestone, 1505,
profiling (1.495 ms) : 1472, 1518
.   : milestone, 1495,
tracing (1.481 ms) : 1456, 1505
.   : milestone, 1481,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.352 ms [1.333 ms, 1.372 ms] -
appsec 1.743 ms [1.721 ms, 1.765 ms] 390.778 µs (28.9%)
appsec_no_iast 1.765 ms [1.742 ms, 1.789 ms] 413.219 µs (30.6%)
iast 1.499 ms [1.477 ms, 1.522 ms] 146.832 µs (10.9%)
profiling 1.552 ms [1.528 ms, 1.577 ms] 200.258 µs (14.8%)
tracing 1.46 ms [1.436 ms, 1.485 ms] 108.062 µs (8.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.336 ms [1.316 ms, 1.355 ms] -
appsec 1.734 ms [1.71 ms, 1.757 ms] 398.064 µs (29.8%)
appsec_no_iast 1.74 ms [1.716 ms, 1.764 ms] 404.317 µs (30.3%)
iast 1.505 ms [1.482 ms, 1.527 ms] 169.121 µs (12.7%)
profiling 1.495 ms [1.472 ms, 1.518 ms] 159.318 µs (11.9%)
tracing 1.481 ms [1.456 ms, 1.505 ms] 144.886 µs (10.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master piotr-wolski/instrument-kafka-connectors
git_commit_date 1731943603 1731966783
git_commit_sha 6181783 ff9bbf2
release_version 1.43.0-SNAPSHOT~6181783bd1 1.42.0-SNAPSHOT~ff9bbf2b31
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1731968729 1731968729
ci_job_id 711406202 711406202
ci_pipeline_id 49320710 49320710
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~ff9bbf2b31, baseline=1.43.0-SNAPSHOT~6181783bd1
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.493 s) : 15493000, 15493000
.   : milestone, 15493000,
appsec (15.144 s) : 15144000, 15144000
.   : milestone, 15144000,
iast (18.635 s) : 18635000, 18635000
.   : milestone, 18635000,
iast_GLOBAL (18.09 s) : 18090000, 18090000
.   : milestone, 18090000,
profiling (15.05 s) : 15050000, 15050000
.   : milestone, 15050000,
tracing (15.173 s) : 15173000, 15173000
.   : milestone, 15173000,
section candidate
no_agent (15.808 s) : 15808000, 15808000
.   : milestone, 15808000,
appsec (14.923 s) : 14923000, 14923000
.   : milestone, 14923000,
iast (18.755 s) : 18755000, 18755000
.   : milestone, 18755000,
iast_GLOBAL (18.24 s) : 18240000, 18240000
.   : milestone, 18240000,
profiling (15.21 s) : 15210000, 15210000
.   : milestone, 15210000,
tracing (14.959 s) : 14959000, 14959000
.   : milestone, 14959000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.493 s [15.493 s, 15.493 s] -
appsec 15.144 s [15.144 s, 15.144 s] -349.0 ms (-2.3%)
iast 18.635 s [18.635 s, 18.635 s] 3.142 s (20.3%)
iast_GLOBAL 18.09 s [18.09 s, 18.09 s] 2.597 s (16.8%)
profiling 15.05 s [15.05 s, 15.05 s] -443.0 ms (-2.9%)
tracing 15.173 s [15.173 s, 15.173 s] -320.0 ms (-2.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.808 s [15.808 s, 15.808 s] -
appsec 14.923 s [14.923 s, 14.923 s] -885.0 ms (-5.6%)
iast 18.755 s [18.755 s, 18.755 s] 2.947 s (18.6%)
iast_GLOBAL 18.24 s [18.24 s, 18.24 s] 2.432 s (15.4%)
profiling 15.21 s [15.21 s, 15.21 s] -598.0 ms (-3.8%)
tracing 14.959 s [14.959 s, 14.959 s] -849.0 ms (-5.4%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~ff9bbf2b31, baseline=1.43.0-SNAPSHOT~6181783bd1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1458, 1481
.   : milestone, 1470,
appsec (2.34 ms) : 2299, 2381
.   : milestone, 2340,
iast (2.071 ms) : 2019, 2122
.   : milestone, 2071,
iast_GLOBAL (2.134 ms) : 2081, 2188
.   : milestone, 2134,
profiling (1.936 ms) : 1895, 1977
.   : milestone, 1936,
tracing (1.921 ms) : 1881, 1961
.   : milestone, 1921,
section candidate
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (2.345 ms) : 2303, 2387
.   : milestone, 2345,
iast (2.085 ms) : 2032, 2138
.   : milestone, 2085,
iast_GLOBAL (2.13 ms) : 2077, 2183
.   : milestone, 2130,
profiling (1.944 ms) : 1901, 1987
.   : milestone, 1944,
tracing (1.928 ms) : 1888, 1968
.   : milestone, 1928,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.458 ms, 1.481 ms] -
appsec 2.34 ms [2.299 ms, 2.381 ms] 870.803 µs (59.3%)
iast 2.071 ms [2.019 ms, 2.122 ms] 601.174 µs (40.9%)
iast_GLOBAL 2.134 ms [2.081 ms, 2.188 ms] 664.833 µs (45.2%)
profiling 1.936 ms [1.895 ms, 1.977 ms] 466.071 µs (31.7%)
tracing 1.921 ms [1.881 ms, 1.961 ms] 451.434 µs (30.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 2.345 ms [2.303 ms, 2.387 ms] 872.692 µs (59.3%)
iast 2.085 ms [2.032 ms, 2.138 ms] 613.072 µs (41.6%)
iast_GLOBAL 2.13 ms [2.077 ms, 2.183 ms] 657.627 µs (44.7%)
profiling 1.944 ms [1.901 ms, 1.987 ms] 471.782 µs (32.0%)
tracing 1.928 ms [1.888 ms, 1.968 ms] 455.545 µs (30.9%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant