Skip to content

Gary/use ctx api #8711

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 2 commits into
base: gary/add-llm-obs-writer
Choose a base branch
from
Draft

Gary/use ctx api #8711

wants to merge 2 commits into from

Conversation

gary-huang
Copy link
Contributor

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@pr-commenter
Copy link

pr-commenter bot commented Apr 21, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master gary/use-ctx-api
git_commit_date 1745232115 1744421030
git_commit_sha f78a48b f78b2c5
release_version 1.49.0-SNAPSHOT~f78a48b48b 1.49.0-SNAPSHOT~f78b2c53aa
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1745248005 1745248005
ci_job_id 904846773 904846773
ci_pipeline_id 62773978 62773978
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-7s1ghto-project-304-concurrent-1-4eb9h3jo 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-7s1ghto-project-304-concurrent-1-4eb9h3jo 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 11 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:profiling:GlobalTracer better
[-16.402ms; -12.886ms] or [-4.380%; -3.441%]		 359.872ms 374.516ms
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.49.0-SNAPSHOT~f78b2c53aa, baseline=1.49.0-SNAPSHOT~f78a48b48b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1057902
Total [baseline] (8.675 s) : 0, 8674517
Agent [candidate] (1.056 s) : 0, 1055707
Total [candidate] (8.648 s) : 0, 8648083
section iast
Agent [baseline] (1.183 s) : 0, 1182952
Total [baseline] (9.253 s) : 0, 9253372
Agent [candidate] (1.186 s) : 0, 1186144
Total [candidate] (9.217 s) : 0, 9217194
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.182 s) : 0, 1182245
Total [baseline] (9.209 s) : 0, 9209087
Agent [candidate] (1.182 s) : 0, 1182142
Total [candidate] (9.207 s) : 0, 9207027
section iast_TELEMETRY_OFF
Agent [baseline] (1.185 s) : 0, 1184974
Total [baseline] (9.241 s) : 0, 9240687
Agent [candidate] (1.18 s) : 0, 1179663
Total [candidate] (9.243 s) : 0, 9242738
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent iast 1.183 s 125.051 ms (11.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.182 s 124.344 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.185 s 127.073 ms (12.0%)
Total tracing 8.675 s -
Total iast 9.253 s 578.855 ms (6.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.209 s 534.57 ms (6.2%)
Total iast_TELEMETRY_OFF 9.241 s 566.169 ms (6.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent iast 1.186 s 130.437 ms (12.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.182 s 126.435 ms (12.0%)
Agent iast_TELEMETRY_OFF 1.18 s 123.956 ms (11.7%)
Total tracing 8.648 s -
Total iast 9.217 s 569.111 ms (6.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.207 s 558.944 ms (6.5%)
Total iast_TELEMETRY_OFF 9.243 s 594.655 ms (6.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.49.0-SNAPSHOT~f78b2c53aa, baseline=1.49.0-SNAPSHOT~f78a48b48b

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (723.76 ms) : 0, 723760
BytebuddyAgent [candidate] (720.813 ms) : 0, 720813
GlobalTracer [baseline] (239.873 ms) : 0, 239873
GlobalTracer [candidate] (238.967 ms) : 0, 238967
AppSec [baseline] (54.247 ms) : 0, 54247
AppSec [candidate] (55.17 ms) : 0, 55170
Debugger [baseline] (4.401 ms) : 0, 4401
Debugger [candidate] (5.195 ms) : 0, 5195
Remote Config [baseline] (697.331 µs) : 0, 697
Remote Config [candidate] (1.473 ms) : 0, 1473
Telemetry [baseline] (11.408 ms) : 0, 11408
Telemetry [candidate] (10.643 ms) : 0, 10643
section iast
BytebuddyAgent [baseline] (837.712 ms) : 0, 837712
BytebuddyAgent [candidate] (841.817 ms) : 0, 841817
GlobalTracer [baseline] (229.425 ms) : 0, 229425
GlobalTracer [candidate] (229.245 ms) : 0, 229245
IAST [baseline] (25.04 ms) : 0, 25040
IAST [candidate] (24.166 ms) : 0, 24166
AppSec [baseline] (53.817 ms) : 0, 53817
AppSec [candidate] (53.934 ms) : 0, 53934
Debugger [baseline] (4.251 ms) : 0, 4251
Debugger [candidate] (4.234 ms) : 0, 4234
Remote Config [baseline] (610.478 µs) : 0, 610
Remote Config [candidate] (605.064 µs) : 0, 605
Telemetry [baseline] (8.748 ms) : 0, 8748
Telemetry [candidate] (8.72 ms) : 0, 8720
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (837.352 ms) : 0, 837352
BytebuddyAgent [candidate] (837.637 ms) : 0, 837637
GlobalTracer [baseline] (228.801 ms) : 0, 228801
GlobalTracer [candidate] (228.979 ms) : 0, 228979
IAST [baseline] (22.847 ms) : 0, 22847
IAST [candidate] (25.88 ms) : 0, 25880
AppSec [baseline] (56.243 ms) : 0, 56243
AppSec [candidate] (52.709 ms) : 0, 52709
Debugger [baseline] (4.271 ms) : 0, 4271
Debugger [candidate] (4.256 ms) : 0, 4256
Remote Config [baseline] (612.054 µs) : 0, 612
Remote Config [candidate] (625.946 µs) : 0, 626
Telemetry [baseline] (8.755 ms) : 0, 8755
Telemetry [candidate] (8.698 ms) : 0, 8698
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (840.772 ms) : 0, 840772
BytebuddyAgent [candidate] (835.991 ms) : 0, 835991
GlobalTracer [baseline] (228.9 ms) : 0, 228900
GlobalTracer [candidate] (229.311 ms) : 0, 229311
IAST [baseline] (22.353 ms) : 0, 22353
IAST [candidate] (22.258 ms) : 0, 22258
AppSec [baseline] (56.042 ms) : 0, 56042
AppSec [candidate] (55.393 ms) : 0, 55393
Debugger [baseline] (4.166 ms) : 0, 4166
Debugger [candidate] (4.11 ms) : 0, 4110
Remote Config [baseline] (624.174 µs) : 0, 624
Remote Config [candidate] (629.904 µs) : 0, 630
Telemetry [baseline] (8.624 ms) : 0, 8624
Telemetry [candidate] (8.558 ms) : 0, 8558
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.49.0-SNAPSHOT~f78b2c53aa, baseline=1.49.0-SNAPSHOT~f78a48b48b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1062116
Total [baseline] (10.502 s) : 0, 10501592
Agent [candidate] (1.057 s) : 0, 1057198
Total [candidate] (10.615 s) : 0, 10615243
section appsec
Agent [baseline] (1.201 s) : 0, 1200650
Total [baseline] (10.747 s) : 0, 10747293
Agent [candidate] (1.198 s) : 0, 1198267
Total [candidate] (10.774 s) : 0, 10773855
section iast
Agent [baseline] (1.203 s) : 0, 1203293
Total [baseline] (11.05 s) : 0, 11050241
Agent [candidate] (1.185 s) : 0, 1185088
Total [candidate] (10.996 s) : 0, 10995712
section profiling
Agent [baseline] (1.307 s) : 0, 1306811
Total [baseline] (10.937 s) : 0, 10937255
Agent [candidate] (1.291 s) : 0, 1291078
Total [candidate] (10.981 s) : 0, 10981455
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent appsec 1.201 s 138.533 ms (13.0%)
Agent iast 1.203 s 141.177 ms (13.3%)
Agent profiling 1.307 s 244.695 ms (23.0%)
Total tracing 10.502 s -
Total appsec 10.747 s 245.701 ms (2.3%)
Total iast 11.05 s 548.649 ms (5.2%)
Total profiling 10.937 s 435.663 ms (4.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent appsec 1.198 s 141.069 ms (13.3%)
Agent iast 1.185 s 127.891 ms (12.1%)
Agent profiling 1.291 s 233.88 ms (22.1%)
Total tracing 10.615 s -
Total appsec 10.774 s 158.611 ms (1.5%)
Total iast 10.996 s 380.469 ms (3.6%)
Total profiling 10.981 s 366.212 ms (3.4%) 
gantt
    title petclinic - break down per module: candidate=1.49.0-SNAPSHOT~f78b2c53aa, baseline=1.49.0-SNAPSHOT~f78a48b48b

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (725.442 ms) : 0, 725442
BytebuddyAgent [candidate] (720.756 ms) : 0, 720756
GlobalTracer [baseline] (240.281 ms) : 0, 240281
GlobalTracer [candidate] (239.151 ms) : 0, 239151
AppSec [baseline] (54.935 ms) : 0, 54935
AppSec [candidate] (55.719 ms) : 0, 55719
Debugger [baseline] (4.419 ms) : 0, 4419
Debugger [candidate] (4.402 ms) : 0, 4402
Remote Config [baseline] (712.728 µs) : 0, 713
Remote Config [candidate] (696.116 µs) : 0, 696
Telemetry [baseline] (12.746 ms) : 0, 12746
Telemetry [candidate] (13.133 ms) : 0, 13133
section appsec
BytebuddyAgent [baseline] (741.296 ms) : 0, 741296
BytebuddyAgent [candidate] (739.789 ms) : 0, 739789
GlobalTracer [baseline] (236.169 ms) : 0, 236169
GlobalTracer [candidate] (235.721 ms) : 0, 235721
IAST [baseline] (21.85 ms) : 0, 21850
IAST [candidate] (21.762 ms) : 0, 21762
AppSec [baseline] (175.764 ms) : 0, 175764
AppSec [candidate] (175.371 ms) : 0, 175371
Debugger [baseline] (4.194 ms) : 0, 4194
Debugger [candidate] (4.212 ms) : 0, 4212
Remote Config [baseline] (627.294 µs) : 0, 627
Remote Config [candidate] (625.992 µs) : 0, 626
Telemetry [baseline] (8.169 ms) : 0, 8169
Telemetry [candidate] (8.158 ms) : 0, 8158
section iast
BytebuddyAgent [baseline] (853.656 ms) : 0, 853656
BytebuddyAgent [candidate] (839.821 ms) : 0, 839821
GlobalTracer [baseline] (232.465 ms) : 0, 232465
GlobalTracer [candidate] (229.733 ms) : 0, 229733
IAST [baseline] (23.223 ms) : 0, 23223
IAST [candidate] (24.334 ms) : 0, 24334
AppSec [baseline] (56.448 ms) : 0, 56448
AppSec [candidate] (54.217 ms) : 0, 54217
Debugger [baseline] (4.306 ms) : 0, 4306
Debugger [candidate] (4.234 ms) : 0, 4234
Remote Config [baseline] (616.629 µs) : 0, 617
Remote Config [candidate] (635.686 µs) : 0, 636
Telemetry [baseline] (8.783 ms) : 0, 8783
Telemetry [candidate] (8.647 ms) : 0, 8647
section profiling
BytebuddyAgent [baseline] (711.467 ms) : 0, 711467
BytebuddyAgent [candidate] (711.796 ms) : 0, 711796
GlobalTracer [baseline] (374.516 ms) : 0, 374516
GlobalTracer [candidate] (359.872 ms) : 0, 359872
AppSec [baseline] (54.293 ms) : 0, 54293
AppSec [candidate] (53.249 ms) : 0, 53249
Debugger [baseline] (4.397 ms) : 0, 4397
Debugger [candidate] (4.368 ms) : 0, 4368
Remote Config [baseline] (676.432 µs) : 0, 676
Remote Config [candidate] (647.047 µs) : 0, 647
Telemetry [baseline] (8.978 ms) : 0, 8978
Telemetry [candidate] (8.92 ms) : 0, 8920
ProfilingAgent [baseline] (102.28 ms) : 0, 102280
ProfilingAgent [candidate] (102.009 ms) : 0, 102009
Profiling [baseline] (102.305 ms) : 0, 102305
Profiling [candidate] (102.034 ms) : 0, 102034
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-04-21T14:36:59 2025-04-21T14:44:47
git_branch master gary/use-ctx-api
git_commit_date 1745232115 1744421030
git_commit_sha f78a48b f78b2c5
release_version 1.49.0-SNAPSHOT~f78a48b48b 1.49.0-SNAPSHOT~f78b2c53aa
start_time 2025-04-21T14:36:45 2025-04-21T14:44:33
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1745247087 1745247087
ci_job_id 904846776 904846776
ci_pipeline_id 62773978 62773978
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-dt3tsoob-project-304-concurrent-1-wisai1n8 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-dt3tsoob-project-304-concurrent-1-wisai1n8 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 17 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.49.0-SNAPSHOT~f78b2c53aa, baseline=1.49.0-SNAPSHOT~f78a48b48b
    dateFormat X
    axisFormat %s
section baseline
no_agent (389.454 µs) : 369, 410
.   : milestone, 389,
iast (519.103 µs) : 497, 541
.   : milestone, 519,
iast_FULL (735.968 µs) : 714, 758
.   : milestone, 736,
iast_GLOBAL (563.693 µs) : 541, 586
.   : milestone, 564,
iast_HARDCODED_SECRET_DISABLED (515.842 µs) : 494, 537
.   : milestone, 516,
iast_INACTIVE (471.096 µs) : 448, 494
.   : milestone, 471,
iast_TELEMETRY_OFF (508.402 µs) : 486, 530
.   : milestone, 508,
tracing (459.97 µs) : 439, 481
.   : milestone, 460,
section candidate
no_agent (387.527 µs) : 368, 407
.   : milestone, 388,
iast (516.482 µs) : 495, 538
.   : milestone, 516,
iast_FULL (738.131 µs) : 716, 760
.   : milestone, 738,
iast_GLOBAL (561.908 µs) : 540, 583
.   : milestone, 562,
iast_HARDCODED_SECRET_DISABLED (522.232 µs) : 500, 544
.   : milestone, 522,
iast_INACTIVE (472.837 µs) : 451, 495
.   : milestone, 473,
iast_TELEMETRY_OFF (502.385 µs) : 481, 524
.   : milestone, 502,
tracing (466.615 µs) : 445, 489
.   : milestone, 467,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 389.454 µs [368.992 µs, 409.917 µs] -
iast 519.103 µs [497.413 µs, 540.792 µs] 129.648 µs (33.3%)
iast_FULL 735.968 µs [713.853 µs, 758.082 µs] 346.513 µs (89.0%)
iast_GLOBAL 563.693 µs [541.305 µs, 586.081 µs] 174.239 µs (44.7%)
iast_HARDCODED_SECRET_DISABLED 515.842 µs [494.233 µs, 537.451 µs] 126.388 µs (32.5%)
iast_INACTIVE 471.096 µs [447.958 µs, 494.233 µs] 81.641 µs (21.0%)
iast_TELEMETRY_OFF 508.402 µs [486.478 µs, 530.326 µs] 118.948 µs (30.5%)
tracing 459.97 µs [439.342 µs, 480.598 µs] 70.515 µs (18.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 387.527 µs [368.018 µs, 407.036 µs] -
iast 516.482 µs [494.747 µs, 538.218 µs] 128.956 µs (33.3%)
iast_FULL 738.131 µs [716.271 µs, 759.992 µs] 350.605 µs (90.5%)
iast_GLOBAL 561.908 µs [540.43 µs, 583.385 µs] 174.381 µs (45.0%)
iast_HARDCODED_SECRET_DISABLED 522.232 µs [500.143 µs, 544.32 µs] 134.705 µs (34.8%)
iast_INACTIVE 472.837 µs [450.771 µs, 494.903 µs] 85.311 µs (22.0%)
iast_TELEMETRY_OFF 502.385 µs [480.739 µs, 524.03 µs] 114.858 µs (29.6%)
tracing 466.615 µs [444.625 µs, 488.605 µs] 79.088 µs (20.4%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.49.0-SNAPSHOT~f78b2c53aa, baseline=1.49.0-SNAPSHOT~f78a48b48b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.377 ms) : 1357, 1396
.   : milestone, 1377,
appsec (1.752 ms) : 1729, 1776
.   : milestone, 1752,
appsec_no_iast (1.75 ms) : 1726, 1775
.   : milestone, 1750,
code_origins (1.697 ms) : 1670, 1724
.   : milestone, 1697,
iast (1.515 ms) : 1490, 1539
.   : milestone, 1515,
profiling (1.544 ms) : 1519, 1569
.   : milestone, 1544,
tracing (1.522 ms) : 1497, 1546
.   : milestone, 1522,
section candidate
no_agent (1.371 ms) : 1353, 1390
.   : milestone, 1371,
appsec (1.757 ms) : 1734, 1780
.   : milestone, 1757,
appsec_no_iast (1.73 ms) : 1706, 1753
.   : milestone, 1730,
code_origins (1.694 ms) : 1667, 1721
.   : milestone, 1694,
iast (1.513 ms) : 1488, 1539
.   : milestone, 1513,
profiling (1.538 ms) : 1513, 1563
.   : milestone, 1538,
tracing (1.515 ms) : 1491, 1539
.   : milestone, 1515,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.377 ms [1.357 ms, 1.396 ms] -
appsec 1.752 ms [1.729 ms, 1.776 ms] 375.649 µs (27.3%)
appsec_no_iast 1.75 ms [1.726 ms, 1.775 ms] 373.839 µs (27.2%)
code_origins 1.697 ms [1.67 ms, 1.724 ms] 320.414 µs (23.3%)
iast 1.515 ms [1.49 ms, 1.539 ms] 137.959 µs (10.0%)
profiling 1.544 ms [1.519 ms, 1.569 ms] 167.443 µs (12.2%)
tracing 1.522 ms [1.497 ms, 1.546 ms] 144.998 µs (10.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.371 ms [1.353 ms, 1.39 ms] -
appsec 1.757 ms [1.734 ms, 1.78 ms] 385.944 µs (28.1%)
appsec_no_iast 1.73 ms [1.706 ms, 1.753 ms] 358.442 µs (26.1%)
code_origins 1.694 ms [1.667 ms, 1.721 ms] 322.734 µs (23.5%)
iast 1.513 ms [1.488 ms, 1.539 ms] 141.905 µs (10.3%)
profiling 1.538 ms [1.513 ms, 1.563 ms] 166.764 µs (12.2%)
tracing 1.515 ms [1.491 ms, 1.539 ms] 143.688 µs (10.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master gary/use-ctx-api
git_commit_date 1745232115 1744421030
git_commit_sha f78a48b f78b2c5
release_version 1.49.0-SNAPSHOT~f78a48b48b 1.49.0-SNAPSHOT~f78b2c53aa
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1745247557 1745247557
ci_job_id 904846778 904846778
ci_pipeline_id 62773978 62773978
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-s6sqwae-project-304-concurrent-0-ttz7au5v 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-s6sqwae-project-304-concurrent-0-ttz7au5v 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.49.0-SNAPSHOT~f78b2c53aa, baseline=1.49.0-SNAPSHOT~f78a48b48b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (2.348 ms) : 2304, 2392
.   : milestone, 2348,
iast (2.111 ms) : 2056, 2167
.   : milestone, 2111,
iast_GLOBAL (2.162 ms) : 2106, 2218
.   : milestone, 2162,
profiling (1.967 ms) : 1923, 2010
.   : milestone, 1967,
tracing (1.944 ms) : 1901, 1986
.   : milestone, 1944,
section candidate
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (2.342 ms) : 2298, 2386
.   : milestone, 2342,
iast (2.114 ms) : 2059, 2169
.   : milestone, 2114,
iast_GLOBAL (2.163 ms) : 2107, 2219
.   : milestone, 2163,
profiling (1.997 ms) : 1951, 2042
.   : milestone, 1997,
tracing (1.958 ms) : 1916, 2001
.   : milestone, 1958,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 2.348 ms [2.304 ms, 2.392 ms] 872.705 µs (59.1%)
iast 2.111 ms [2.056 ms, 2.167 ms] 635.936 µs (43.1%)
iast_GLOBAL 2.162 ms [2.106 ms, 2.218 ms] 686.232 µs (46.5%)
profiling 1.967 ms [1.923 ms, 2.01 ms] 491.051 µs (33.3%)
tracing 1.944 ms [1.901 ms, 1.986 ms] 468.282 µs (31.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 2.342 ms [2.298 ms, 2.386 ms] 871.612 µs (59.3%)
iast 2.114 ms [2.059 ms, 2.169 ms] 643.489 µs (43.8%)
iast_GLOBAL 2.163 ms [2.107 ms, 2.219 ms] 692.387 µs (47.1%)
profiling 1.997 ms [1.951 ms, 2.042 ms] 526.212 µs (35.8%)
tracing 1.958 ms [1.916 ms, 2.001 ms] 488.059 µs (33.2%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.49.0-SNAPSHOT~f78b2c53aa, baseline=1.49.0-SNAPSHOT~f78a48b48b
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.525 s) : 15525000, 15525000
.   : milestone, 15525000,
appsec (15.266 s) : 15266000, 15266000
.   : milestone, 15266000,
iast (18.398 s) : 18398000, 18398000
.   : milestone, 18398000,
iast_GLOBAL (17.969 s) : 17969000, 17969000
.   : milestone, 17969000,
profiling (14.948 s) : 14948000, 14948000
.   : milestone, 14948000,
tracing (14.997 s) : 14997000, 14997000
.   : milestone, 14997000,
section candidate
no_agent (15.254 s) : 15254000, 15254000
.   : milestone, 15254000,
appsec (15.175 s) : 15175000, 15175000
.   : milestone, 15175000,
iast (18.854 s) : 18854000, 18854000
.   : milestone, 18854000,
iast_GLOBAL (18.127 s) : 18127000, 18127000
.   : milestone, 18127000,
profiling (14.995 s) : 14995000, 14995000
.   : milestone, 14995000,
tracing (14.933 s) : 14933000, 14933000
.   : milestone, 14933000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.525 s [15.525 s, 15.525 s] -
appsec 15.266 s [15.266 s, 15.266 s] -259.0 ms (-1.7%)
iast 18.398 s [18.398 s, 18.398 s] 2.873 s (18.5%)
iast_GLOBAL 17.969 s [17.969 s, 17.969 s] 2.444 s (15.7%)
profiling 14.948 s [14.948 s, 14.948 s] -577.0 ms (-3.7%)
tracing 14.997 s [14.997 s, 14.997 s] -528.0 ms (-3.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.254 s [15.254 s, 15.254 s] -
appsec 15.175 s [15.175 s, 15.175 s] -79.0 ms (-0.5%)
iast 18.854 s [18.854 s, 18.854 s] 3.6 s (23.6%)
iast_GLOBAL 18.127 s [18.127 s, 18.127 s] 2.873 s (18.8%)
profiling 14.995 s [14.995 s, 14.995 s] -259.0 ms (-1.7%)
tracing 14.933 s [14.933 s, 14.933 s] -321.0 ms (-2.1%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@gary-huang