Skip to content

Replace a regex-based SMAP parser with a hand-crafted one #8730

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Replace a regex-based SMAP parser with a hand-crafted one #8730

wants to merge 1 commit into from

Conversation

jbachorik
Copy link
Contributor

@jbachorik jbachorik commented Apr 24, 2025 •
edited
Loading

What Does This Do

In a nut-shell, it replaces the regex based smap entry parser with a minimalistic hand-crafted one.

Motivation

Regex based smap parser is allocating a lot and shows up on profiles of mostly idle applications prominently.

We should try to reduce the allocation rate of the parser not to create panic in users when the smap events collection is enabled and allow us to enable it by default, as it can provide useful data for investigating memory issues.

Additional Notes

Compared to the current implementation, the new parser reduces the CPU usage of otherwise idle application by ~30% (600ms vs. 400ms normalized) but what is more important, the allocation rate drops by ~75% (85MiB vs. 25MiB normalized).
Although this might not seem as much, it paints a slightly less scary picture when enabled on mostly idle services.

The data is captured here - service samples is the new implementation, whereas samples-1.48.2 is the one available in version 1.48.2

Contributor Checklist

Jira ticket: PROF-11713

@pr-commenter
Copy link

pr-commenter bot commented Apr 24, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/smap
git_commit_date 1745519613 1745523447
git_commit_sha 511416f 7adc76d
release_version 1.49.0-SNAPSHOT~511416f4ef 1.49.0-SNAPSHOT~7adc76db3c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1745526526 1745526526
ci_job_id 911750828 911750828
ci_pipeline_id 63262696 63262696
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-xpsrxtzn-project-304-concurrent-0-cfmbplwg 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-xpsrxtzn-project-304-concurrent-0-cfmbplwg 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 10 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.49.0-SNAPSHOT~7adc76db3c, baseline=1.49.0-SNAPSHOT~511416f4ef

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.068 s) : 0, 1067833
Total [baseline] (8.728 s) : 0, 8728154
Agent [candidate] (1.064 s) : 0, 1064402
Total [candidate] (8.723 s) : 0, 8722666
section iast
Agent [baseline] (1.188 s) : 0, 1187953
Total [baseline] (9.226 s) : 0, 9226366
Agent [candidate] (1.192 s) : 0, 1191815
Total [candidate] (9.283 s) : 0, 9282544
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.195 s) : 0, 1194714
Total [baseline] (9.242 s) : 0, 9242311
Agent [candidate] (1.194 s) : 0, 1193874
Total [candidate] (9.231 s) : 0, 9230894
section iast_TELEMETRY_OFF
Agent [baseline] (1.186 s) : 0, 1185816
Total [baseline] (9.265 s) : 0, 9265041
Agent [candidate] (1.191 s) : 0, 1191152
Total [candidate] (9.241 s) : 0, 9241054
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent iast 1.188 s 120.12 ms (11.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.195 s 126.881 ms (11.9%)
Agent iast_TELEMETRY_OFF 1.186 s 117.983 ms (11.0%)
Total tracing 8.728 s -
Total iast 9.226 s 498.212 ms (5.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.242 s 514.158 ms (5.9%)
Total iast_TELEMETRY_OFF 9.265 s 536.887 ms (6.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.192 s 127.413 ms (12.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.194 s 129.471 ms (12.2%)
Agent iast_TELEMETRY_OFF 1.191 s 126.75 ms (11.9%)
Total tracing 8.723 s -
Total iast 9.283 s 559.878 ms (6.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.231 s 508.228 ms (5.8%)
Total iast_TELEMETRY_OFF 9.241 s 518.388 ms (5.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.49.0-SNAPSHOT~7adc76db3c, baseline=1.49.0-SNAPSHOT~511416f4ef

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (728.919 ms) : 0, 728919
BytebuddyAgent [candidate] (724.378 ms) : 0, 724378
GlobalTracer [baseline] (241.792 ms) : 0, 241792
GlobalTracer [candidate] (241.467 ms) : 0, 241467
AppSec [baseline] (56.499 ms) : 0, 56499
AppSec [candidate] (55.156 ms) : 0, 55156
Debugger [baseline] (7.714 ms) : 0, 7714
Debugger [candidate] (8.448 ms) : 0, 8448
Remote Config [baseline] (700.103 µs) : 0, 700
Remote Config [candidate] (725.464 µs) : 0, 725
Telemetry [baseline] (8.513 ms) : 0, 8513
Telemetry [candidate] (10.696 ms) : 0, 10696
section iast
BytebuddyAgent [baseline] (841.817 ms) : 0, 841817
BytebuddyAgent [candidate] (843.309 ms) : 0, 843309
GlobalTracer [baseline] (230.064 ms) : 0, 230064
GlobalTracer [candidate] (231.291 ms) : 0, 231291
IAST [baseline] (25.674 ms) : 0, 25674
IAST [candidate] (25.251 ms) : 0, 25251
AppSec [baseline] (51.152 ms) : 0, 51152
AppSec [candidate] (52.487 ms) : 0, 52487
Debugger [baseline] (5.846 ms) : 0, 5846
Debugger [candidate] (5.937 ms) : 0, 5937
Remote Config [baseline] (590.483 µs) : 0, 590
Remote Config [candidate] (605.35 µs) : 0, 605
Telemetry [baseline] (7.889 ms) : 0, 7889
Telemetry [candidate] (7.928 ms) : 0, 7928
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (846.196 ms) : 0, 846196
BytebuddyAgent [candidate] (846.037 ms) : 0, 846037
GlobalTracer [baseline] (230.606 ms) : 0, 230606
GlobalTracer [candidate] (230.29 ms) : 0, 230290
IAST [baseline] (23.382 ms) : 0, 23382
IAST [candidate] (23.875 ms) : 0, 23875
AppSec [baseline] (51.588 ms) : 0, 51588
AppSec [candidate] (54.853 ms) : 0, 54853
Debugger [baseline] (5.985 ms) : 0, 5985
Debugger [candidate] (5.885 ms) : 0, 5885
Remote Config [baseline] (603.523 µs) : 0, 604
Remote Config [candidate] (589.759 µs) : 0, 590
Telemetry [baseline] (7.966 ms) : 0, 7966
Telemetry [candidate] (7.849 ms) : 0, 7849
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (839.903 ms) : 0, 839903
BytebuddyAgent [candidate] (843.841 ms) : 0, 843841
GlobalTracer [baseline] (230.337 ms) : 0, 230337
GlobalTracer [candidate] (230.306 ms) : 0, 230306
IAST [baseline] (22.216 ms) : 0, 22216
IAST [candidate] (22.6 ms) : 0, 22600
AppSec [baseline] (55.644 ms) : 0, 55644
AppSec [candidate] (56.395 ms) : 0, 56395
Debugger [baseline] (5.85 ms) : 0, 5850
Debugger [candidate] (6.025 ms) : 0, 6025
Remote Config [baseline] (597.764 µs) : 0, 598
Remote Config [candidate] (613.384 µs) : 0, 613
Telemetry [baseline] (7.815 ms) : 0, 7815
Telemetry [candidate] (7.834 ms) : 0, 7834
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.49.0-SNAPSHOT~7adc76db3c, baseline=1.49.0-SNAPSHOT~511416f4ef

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1065934
Total [baseline] (10.595 s) : 0, 10594642
Agent [candidate] (1.059 s) : 0, 1058908
Total [candidate] (10.537 s) : 0, 10536682
section appsec
Agent [baseline] (1.202 s) : 0, 1201817
Total [baseline] (10.718 s) : 0, 10717717
Agent [candidate] (1.2 s) : 0, 1200410
Total [candidate] (10.757 s) : 0, 10756739
section iast
Agent [baseline] (1.188 s) : 0, 1187820
Total [baseline] (10.908 s) : 0, 10908498
Agent [candidate] (1.194 s) : 0, 1194013
Total [candidate] (11.035 s) : 0, 11035343
section profiling
Agent [baseline] (1.311 s) : 0, 1311200
Total [baseline] (10.774 s) : 0, 10774375
Agent [candidate] (1.321 s) : 0, 1320970
Total [candidate] (10.753 s) : 0, 10753357
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.202 s 135.883 ms (12.7%)
Agent iast 1.188 s 121.886 ms (11.4%)
Agent profiling 1.311 s 245.266 ms (23.0%)
Total tracing 10.595 s -
Total appsec 10.718 s 123.075 ms (1.2%)
Total iast 10.908 s 313.856 ms (3.0%)
Total profiling 10.774 s 179.734 ms (1.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.2 s 141.502 ms (13.4%)
Agent iast 1.194 s 135.105 ms (12.8%)
Agent profiling 1.321 s 262.062 ms (24.7%)
Total tracing 10.537 s -
Total appsec 10.757 s 220.057 ms (2.1%)
Total iast 11.035 s 498.662 ms (4.7%)
Total profiling 10.753 s 216.675 ms (2.1%) 
gantt
    title petclinic - break down per module: candidate=1.49.0-SNAPSHOT~7adc76db3c, baseline=1.49.0-SNAPSHOT~511416f4ef

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (727.093 ms) : 0, 727093
BytebuddyAgent [candidate] (722.463 ms) : 0, 722463
GlobalTracer [baseline] (240.773 ms) : 0, 240773
GlobalTracer [candidate] (239.353 ms) : 0, 239353
AppSec [baseline] (56.0 ms) : 0, 56000
AppSec [candidate] (56.408 ms) : 0, 56408
Debugger [baseline] (8.517 ms) : 0, 8517
Debugger [candidate] (7.558 ms) : 0, 7558
Remote Config [baseline] (708.799 µs) : 0, 709
Remote Config [candidate] (693.857 µs) : 0, 694
Telemetry [baseline] (9.211 ms) : 0, 9211
Telemetry [candidate] (8.896 ms) : 0, 8896
section appsec
BytebuddyAgent [baseline] (739.744 ms) : 0, 739744
BytebuddyAgent [candidate] (739.766 ms) : 0, 739766
GlobalTracer [baseline] (236.534 ms) : 0, 236534
GlobalTracer [candidate] (236.207 ms) : 0, 236207
AppSec [baseline] (176.33 ms) : 0, 176330
AppSec [candidate] (175.214 ms) : 0, 175214
Debugger [baseline] (6.678 ms) : 0, 6678
Debugger [candidate] (6.688 ms) : 0, 6688
Remote Config [baseline] (630.532 µs) : 0, 631
Remote Config [candidate] (624.968 µs) : 0, 625
Telemetry [baseline] (7.45 ms) : 0, 7450
Telemetry [candidate] (7.438 ms) : 0, 7438
IAST [baseline] (21.757 ms) : 0, 21757
IAST [candidate] (21.811 ms) : 0, 21811
section iast
BytebuddyAgent [baseline] (841.055 ms) : 0, 841055
BytebuddyAgent [candidate] (843.809 ms) : 0, 843809
GlobalTracer [baseline] (229.856 ms) : 0, 229856
GlobalTracer [candidate] (232.153 ms) : 0, 232153
AppSec [baseline] (56.462 ms) : 0, 56462
AppSec [candidate] (54.368 ms) : 0, 54368
Debugger [baseline] (5.904 ms) : 0, 5904
Debugger [candidate] (6.034 ms) : 0, 6034
Remote Config [baseline] (594.629 µs) : 0, 595
Remote Config [candidate] (615.57 µs) : 0, 616
Telemetry [baseline] (7.833 ms) : 0, 7833
Telemetry [candidate] (7.992 ms) : 0, 7992
IAST [baseline] (22.728 ms) : 0, 22728
IAST [candidate] (23.126 ms) : 0, 23126
section profiling
ProfilingAgent [baseline] (103.244 ms) : 0, 103244
ProfilingAgent [candidate] (104.826 ms) : 0, 104826
BytebuddyAgent [baseline] (712.374 ms) : 0, 712374
BytebuddyAgent [candidate] (718.79 ms) : 0, 718790
GlobalTracer [baseline] (376.139 ms) : 0, 376139
GlobalTracer [candidate] (377.954 ms) : 0, 377954
AppSec [baseline] (54.178 ms) : 0, 54178
AppSec [candidate] (53.668 ms) : 0, 53668
Debugger [baseline] (6.156 ms) : 0, 6156
Debugger [candidate] (6.217 ms) : 0, 6217
Remote Config [baseline] (660.612 µs) : 0, 661
Remote Config [candidate] (677.337 µs) : 0, 677
Telemetry [baseline] (8.053 ms) : 0, 8053
Telemetry [candidate] (8.171 ms) : 0, 8171
Profiling [baseline] (103.27 ms) : 0, 103270
Profiling [candidate] (104.851 ms) : 0, 104851
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-04-24T19:56:58 2025-04-24T20:04:44
git_branch master jb/smap
git_commit_date 1745519613 1745523447
git_commit_sha 511416f 7adc76d
release_version 1.49.0-SNAPSHOT~511416f4ef 1.49.0-SNAPSHOT~7adc76db3c
start_time 2025-04-24T19:56:44 2025-04-24T20:04:30
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1745525482 1745525482
ci_job_id 911750829 911750829
ci_pipeline_id 63262696 63262696
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-syfpehly-project-304-concurrent-0-anfg99dv 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-syfpehly-project-304-concurrent-0-anfg99dv 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 17 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:code_origins better
[-105.136µs; -46.143µs] or [-6.074%; -2.666%]		 unstable
[-284.579op/s; +665.531op/s] or [-10.672%; +24.957%]		 1.655ms 2857.143op/s 1.731ms 2666.667op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.49.0-SNAPSHOT~7adc76db3c, baseline=1.49.0-SNAPSHOT~511416f4ef
    dateFormat X
    axisFormat %s
section baseline
no_agent (384.691 µs) : 364, 405
.   : milestone, 385,
iast (526.952 µs) : 504, 550
.   : milestone, 527,
iast_FULL (740.96 µs) : 717, 765
.   : milestone, 741,
iast_GLOBAL (574.044 µs) : 552, 596
.   : milestone, 574,
iast_HARDCODED_SECRET_DISABLED (517.555 µs) : 494, 541
.   : milestone, 518,
iast_INACTIVE (472.957 µs) : 450, 496
.   : milestone, 473,
iast_TELEMETRY_OFF (514.378 µs) : 491, 537
.   : milestone, 514,
tracing (459.216 µs) : 438, 481
.   : milestone, 459,
section candidate
no_agent (384.192 µs) : 364, 404
.   : milestone, 384,
iast (514.555 µs) : 493, 536
.   : milestone, 515,
iast_FULL (732.231 µs) : 709, 755
.   : milestone, 732,
iast_GLOBAL (576.537 µs) : 553, 600
.   : milestone, 577,
iast_HARDCODED_SECRET_DISABLED (516.965 µs) : 494, 540
.   : milestone, 517,
iast_INACTIVE (465.666 µs) : 443, 488
.   : milestone, 466,
iast_TELEMETRY_OFF (502.568 µs) : 479, 526
.   : milestone, 503,
tracing (457.449 µs) : 436, 479
.   : milestone, 457,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 384.691 µs [364.296 µs, 405.086 µs] -
iast 526.952 µs [503.877 µs, 550.028 µs] 142.261 µs (37.0%)
iast_FULL 740.96 µs [717.229 µs, 764.692 µs] 356.269 µs (92.6%)
iast_GLOBAL 574.044 µs [551.641 µs, 596.448 µs] 189.353 µs (49.2%)
iast_HARDCODED_SECRET_DISABLED 517.555 µs [493.961 µs, 541.149 µs] 132.864 µs (34.5%)
iast_INACTIVE 472.957 µs [450.022 µs, 495.892 µs] 88.266 µs (22.9%)
iast_TELEMETRY_OFF 514.378 µs [491.36 µs, 537.396 µs] 129.687 µs (33.7%)
tracing 459.216 µs [437.812 µs, 480.62 µs] 74.525 µs (19.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 384.192 µs [364.427 µs, 403.958 µs] -
iast 514.555 µs [492.756 µs, 536.354 µs] 130.363 µs (33.9%)
iast_FULL 732.231 µs [709.343 µs, 755.119 µs] 348.039 µs (90.6%)
iast_GLOBAL 576.537 µs [552.743 µs, 600.331 µs] 192.345 µs (50.1%)
iast_HARDCODED_SECRET_DISABLED 516.965 µs [493.723 µs, 540.208 µs] 132.773 µs (34.6%)
iast_INACTIVE 465.666 µs [443.092 µs, 488.24 µs] 81.474 µs (21.2%)
iast_TELEMETRY_OFF 502.568 µs [479.418 µs, 525.718 µs] 118.375 µs (30.8%)
tracing 457.449 µs [436.27 µs, 478.628 µs] 73.257 µs (19.1%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.49.0-SNAPSHOT~7adc76db3c, baseline=1.49.0-SNAPSHOT~511416f4ef
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.353 ms) : 1333, 1374
.   : milestone, 1353,
appsec (1.738 ms) : 1714, 1762
.   : milestone, 1738,
appsec_no_iast (1.738 ms) : 1715, 1761
.   : milestone, 1738,
code_origins (1.731 ms) : 1704, 1758
.   : milestone, 1731,
iast (1.525 ms) : 1502, 1549
.   : milestone, 1525,
profiling (1.53 ms) : 1506, 1554
.   : milestone, 1530,
tracing (1.494 ms) : 1469, 1520
.   : milestone, 1494,
section candidate
no_agent (1.365 ms) : 1345, 1385
.   : milestone, 1365,
appsec (1.754 ms) : 1731, 1778
.   : milestone, 1754,
appsec_no_iast (1.735 ms) : 1710, 1760
.   : milestone, 1735,
code_origins (1.655 ms) : 1628, 1683
.   : milestone, 1655,
iast (1.506 ms) : 1481, 1531
.   : milestone, 1506,
profiling (1.531 ms) : 1507, 1555
.   : milestone, 1531,
tracing (1.491 ms) : 1466, 1516
.   : milestone, 1491,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.353 ms [1.333 ms, 1.374 ms] -
appsec 1.738 ms [1.714 ms, 1.762 ms] 384.8 µs (28.4%)
appsec_no_iast 1.738 ms [1.715 ms, 1.761 ms] 384.407 µs (28.4%)
code_origins 1.731 ms [1.704 ms, 1.758 ms] 377.628 µs (27.9%)
iast 1.525 ms [1.502 ms, 1.549 ms] 172.055 µs (12.7%)
profiling 1.53 ms [1.506 ms, 1.554 ms] 176.671 µs (13.1%)
tracing 1.494 ms [1.469 ms, 1.52 ms] 140.878 µs (10.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.365 ms [1.345 ms, 1.385 ms] -
appsec 1.754 ms [1.731 ms, 1.778 ms] 389.652 µs (28.6%)
appsec_no_iast 1.735 ms [1.71 ms, 1.76 ms] 370.233 µs (27.1%)
code_origins 1.655 ms [1.628 ms, 1.683 ms] 290.598 µs (21.3%)
iast 1.506 ms [1.481 ms, 1.531 ms] 141.281 µs (10.4%)
profiling 1.531 ms [1.507 ms, 1.555 ms] 166.141 µs (12.2%)
tracing 1.491 ms [1.466 ms, 1.516 ms] 125.923 µs (9.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/smap
git_commit_date 1745519613 1745523447
git_commit_sha 511416f 7adc76d
release_version 1.49.0-SNAPSHOT~511416f4ef 1.49.0-SNAPSHOT~7adc76db3c
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1745525953 1745525953
ci_job_id 911750830 911750830
ci_pipeline_id 63262696 63262696
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-xpsrxtzn-project-304-concurrent-1-b1vftgi0 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-xpsrxtzn-project-304-concurrent-1-b1vftgi0 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.49.0-SNAPSHOT~7adc76db3c, baseline=1.49.0-SNAPSHOT~511416f4ef
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.421 s) : 15421000, 15421000
.   : milestone, 15421000,
appsec (15.138 s) : 15138000, 15138000
.   : milestone, 15138000,
iast (19.106 s) : 19106000, 19106000
.   : milestone, 19106000,
iast_GLOBAL (18.314 s) : 18314000, 18314000
.   : milestone, 18314000,
profiling (15.676 s) : 15676000, 15676000
.   : milestone, 15676000,
tracing (14.995 s) : 14995000, 14995000
.   : milestone, 14995000,
section candidate
no_agent (14.668 s) : 14668000, 14668000
.   : milestone, 14668000,
appsec (14.852 s) : 14852000, 14852000
.   : milestone, 14852000,
iast (18.66 s) : 18660000, 18660000
.   : milestone, 18660000,
iast_GLOBAL (18.343 s) : 18343000, 18343000
.   : milestone, 18343000,
profiling (15.109 s) : 15109000, 15109000
.   : milestone, 15109000,
tracing (14.719 s) : 14719000, 14719000
.   : milestone, 14719000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.421 s [15.421 s, 15.421 s] -
appsec 15.138 s [15.138 s, 15.138 s] -283.0 ms (-1.8%)
iast 19.106 s [19.106 s, 19.106 s] 3.685 s (23.9%)
iast_GLOBAL 18.314 s [18.314 s, 18.314 s] 2.893 s (18.8%)
profiling 15.676 s [15.676 s, 15.676 s] 255.0 ms (1.7%)
tracing 14.995 s [14.995 s, 14.995 s] -426.0 ms (-2.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.668 s [14.668 s, 14.668 s] -
appsec 14.852 s [14.852 s, 14.852 s] 184.0 ms (1.3%)
iast 18.66 s [18.66 s, 18.66 s] 3.992 s (27.2%)
iast_GLOBAL 18.343 s [18.343 s, 18.343 s] 3.675 s (25.1%)
profiling 15.109 s [15.109 s, 15.109 s] 441.0 ms (3.0%)
tracing 14.719 s [14.719 s, 14.719 s] 51.0 ms (0.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.49.0-SNAPSHOT~7adc76db3c, baseline=1.49.0-SNAPSHOT~511416f4ef
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (2.372 ms) : 2325, 2418
.   : milestone, 2372,
iast (2.156 ms) : 2097, 2215
.   : milestone, 2156,
iast_GLOBAL (2.2 ms) : 2141, 2259
.   : milestone, 2200,
profiling (1.995 ms) : 1948, 2042
.   : milestone, 1995,
tracing (1.978 ms) : 1933, 2023
.   : milestone, 1978,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (2.375 ms) : 2329, 2422
.   : milestone, 2375,
iast (2.146 ms) : 2087, 2204
.   : milestone, 2146,
iast_GLOBAL (2.194 ms) : 2135, 2253
.   : milestone, 2194,
profiling (2.494 ms) : 2312, 2675
.   : milestone, 2494,
tracing (1.983 ms) : 1937, 2028
.   : milestone, 1983,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.462 ms, 1.485 ms] -
appsec 2.372 ms [2.325 ms, 2.418 ms] 898.352 µs (61.0%)
iast 2.156 ms [2.097 ms, 2.215 ms] 683.149 µs (46.4%)
iast_GLOBAL 2.2 ms [2.141 ms, 2.259 ms] 726.896 µs (49.3%)
profiling 1.995 ms [1.948 ms, 2.042 ms] 521.843 µs (35.4%)
tracing 1.978 ms [1.933 ms, 2.023 ms] 504.926 µs (34.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 2.375 ms [2.329 ms, 2.422 ms] 903.91 µs (61.4%)
iast 2.146 ms [2.087 ms, 2.204 ms] 674.461 µs (45.8%)
iast_GLOBAL 2.194 ms [2.135 ms, 2.253 ms] 722.454 µs (49.1%)
profiling 2.494 ms [2.312 ms, 2.675 ms] 1.022 ms (69.5%)
tracing 1.983 ms [1.937 ms, 2.028 ms] 511.302 µs (34.8%)

@jbachorik jbachorik marked this pull request as ready for review April 24, 2025 20:36
@jbachorik jbachorik requested a review from a team as a code owner April 24, 2025 20:36
@PerfectSlayer PerfectSlayer added the tag: performance Performance related changes label Apr 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
comp: profiling Profiling tag: performance Performance related changes type: enhancement
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@jbachorik @PerfectSlayer