Consider modified tests when applying fail-fast tests ordering #8474

nikita-tkachenko-datadog · 2025-02-28T16:38:23Z

What Does This Do

When applying fail-fast tests ordering, "impacted tests" (test cases whose body was modified) are considered for reordering along with new and flaky tests.

Additional Notes

"Execution priority" heuristic is added to the execution strategy to encapsulate ordering logic and reuse it for different testing frameworks.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: SDTEST-1512

pr-commenter · 2025-02-28T17:33:04Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/impacted-tests-ordering
git_commit_date	1740758111	1740760500
git_commit_sha	`19d8832`	`95b3762`
release_version	1.47.0-SNAPSHOT~19d8832a9d	1.47.0-SNAPSHOT~95b3762f7d

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1740763728	1740763728
ci_job_id	828127233	828127233
ci_pipeline_id	57367357	57367357
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-stj6nuyy-project-304-concurrent-4-y2jyefhz 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-stj6nuyy-project-304-concurrent-4-y2jyefhz 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 6 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~95b3762f7d, baseline=1.47.0-SNAPSHOT~19d8832a9d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.045 s) : 0, 1044625
Total [baseline] (8.687 s) : 0, 8686522
Agent [candidate] (1.046 s) : 0, 1046449
Total [candidate] (8.723 s) : 0, 8723024
section iast
Agent [baseline] (1.172 s) : 0, 1172407
Total [baseline] (9.29 s) : 0, 9289760
Agent [candidate] (1.171 s) : 0, 1170767
Total [candidate] (9.317 s) : 0, 9317000
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.173 s) : 0, 1172587
Total [baseline] (9.216 s) : 0, 9215522
Agent [candidate] (1.176 s) : 0, 1176493
Total [candidate] (9.283 s) : 0, 9282624
section iast_TELEMETRY_OFF
Agent [baseline] (1.166 s) : 0, 1166290
Total [baseline] (9.299 s) : 0, 9299007
Agent [candidate] (1.168 s) : 0, 1168481
Total [candidate] (9.253 s) : 0, 9253280

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.045 s	-
Agent	iast	1.172 s	127.782 ms (12.2%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.173 s	127.962 ms (12.2%)
Agent	iast_TELEMETRY_OFF	1.166 s	121.665 ms (11.6%)
Total	tracing	8.687 s	-
Total	iast	9.29 s	603.238 ms (6.9%)
Total	iast_HARDCODED_SECRET_DISABLED	9.216 s	529.0 ms (6.1%)
Total	iast_TELEMETRY_OFF	9.299 s	612.485 ms (7.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.046 s	-
Agent	iast	1.171 s	124.318 ms (11.9%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.176 s	130.044 ms (12.4%)
Agent	iast_TELEMETRY_OFF	1.168 s	122.031 ms (11.7%)
Total	tracing	8.723 s	-
Total	iast	9.317 s	593.976 ms (6.8%)
Total	iast_HARDCODED_SECRET_DISABLED	9.283 s	559.599 ms (6.4%)
Total	iast_TELEMETRY_OFF	9.253 s	530.256 ms (6.1%)

gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~95b3762f7d, baseline=1.47.0-SNAPSHOT~19d8832a9d

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (720.854 ms) : 0, 720854
BytebuddyAgent [candidate] (722.664 ms) : 0, 722664
GlobalTracer [baseline] (239.968 ms) : 0, 239968
GlobalTracer [candidate] (240.542 ms) : 0, 240542
AppSec [baseline] (55.795 ms) : 0, 55795
AppSec [candidate] (55.973 ms) : 0, 55973
Remote Config [baseline] (695.177 µs) : 0, 695
Remote Config [candidate] (715.647 µs) : 0, 716
Telemetry [baseline] (12.302 ms) : 0, 12302
Telemetry [candidate] (11.502 ms) : 0, 11502
section iast
BytebuddyAgent [baseline] (836.535 ms) : 0, 836535
BytebuddyAgent [candidate] (836.89 ms) : 0, 836890
GlobalTracer [baseline] (231.071 ms) : 0, 231071
GlobalTracer [candidate] (229.347 ms) : 0, 229347
IAST [baseline] (22.986 ms) : 0, 22986
IAST [candidate] (22.91 ms) : 0, 22910
AppSec [baseline] (57.355 ms) : 0, 57355
AppSec [candidate] (57.198 ms) : 0, 57198
Remote Config [baseline] (625.065 µs) : 0, 625
Remote Config [candidate] (609.471 µs) : 0, 609
Telemetry [baseline] (8.823 ms) : 0, 8823
Telemetry [candidate] (8.856 ms) : 0, 8856
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (837.537 ms) : 0, 837537
BytebuddyAgent [candidate] (839.582 ms) : 0, 839582
GlobalTracer [baseline] (230.194 ms) : 0, 230194
GlobalTracer [candidate] (230.848 ms) : 0, 230848
IAST [baseline] (22.921 ms) : 0, 22921
IAST [candidate] (23.314 ms) : 0, 23314
AppSec [baseline] (57.561 ms) : 0, 57561
AppSec [candidate] (58.155 ms) : 0, 58155
Remote Config [baseline] (609.282 µs) : 0, 609
Remote Config [candidate] (621.05 µs) : 0, 621
Telemetry [baseline] (8.767 ms) : 0, 8767
Telemetry [candidate] (8.915 ms) : 0, 8915
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (833.313 ms) : 0, 833313
BytebuddyAgent [candidate] (834.77 ms) : 0, 834770
GlobalTracer [baseline] (229.64 ms) : 0, 229640
GlobalTracer [candidate] (229.936 ms) : 0, 229936
IAST [baseline] (23.627 ms) : 0, 23627
IAST [candidate] (24.538 ms) : 0, 24538
AppSec [baseline] (55.479 ms) : 0, 55479
AppSec [candidate] (55.013 ms) : 0, 55013
Remote Config [baseline] (623.248 µs) : 0, 623
Remote Config [candidate] (610.494 µs) : 0, 610
Telemetry [baseline] (8.637 ms) : 0, 8637
Telemetry [candidate] (8.636 ms) : 0, 8636

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~95b3762f7d, baseline=1.47.0-SNAPSHOT~19d8832a9d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.042 s) : 0, 1042206
Total [baseline] (10.456 s) : 0, 10456318
Agent [candidate] (1.038 s) : 0, 1038346
Total [candidate] (10.43 s) : 0, 10429540
section appsec
Agent [baseline] (1.185 s) : 0, 1184658
Total [baseline] (10.777 s) : 0, 10777111
Agent [candidate] (1.186 s) : 0, 1186116
Total [candidate] (10.747 s) : 0, 10746889
section iast
Agent [baseline] (1.174 s) : 0, 1174013
Total [baseline] (10.998 s) : 0, 10997533
Agent [candidate] (1.181 s) : 0, 1180733
Total [candidate] (11.019 s) : 0, 11019111
section profiling
Agent [baseline] (1.263 s) : 0, 1262934
Total [baseline] (10.86 s) : 0, 10860439
Agent [candidate] (1.26 s) : 0, 1259703
Total [candidate] (10.841 s) : 0, 10840878

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.042 s	-
Agent	appsec	1.185 s	142.452 ms (13.7%)
Agent	iast	1.174 s	131.807 ms (12.6%)
Agent	profiling	1.263 s	220.728 ms (21.2%)
Total	tracing	10.456 s	-
Total	appsec	10.777 s	320.793 ms (3.1%)
Total	iast	10.998 s	541.215 ms (5.2%)
Total	profiling	10.86 s	404.121 ms (3.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.038 s	-
Agent	appsec	1.186 s	147.77 ms (14.2%)
Agent	iast	1.181 s	142.387 ms (13.7%)
Agent	profiling	1.26 s	221.357 ms (21.3%)
Total	tracing	10.43 s	-
Total	appsec	10.747 s	317.349 ms (3.0%)
Total	iast	11.019 s	589.57 ms (5.7%)
Total	profiling	10.841 s	411.338 ms (3.9%)

gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~95b3762f7d, baseline=1.47.0-SNAPSHOT~19d8832a9d

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (719.82 ms) : 0, 719820
BytebuddyAgent [candidate] (717.745 ms) : 0, 717745
GlobalTracer [baseline] (239.394 ms) : 0, 239394
GlobalTracer [candidate] (239.34 ms) : 0, 239340
AppSec [baseline] (55.802 ms) : 0, 55802
AppSec [candidate] (55.595 ms) : 0, 55595
Remote Config [baseline] (689.677 µs) : 0, 690
Remote Config [candidate] (688.452 µs) : 0, 688
Telemetry [baseline] (11.509 ms) : 0, 11509
Telemetry [candidate] (10.031 ms) : 0, 10031
section appsec
BytebuddyAgent [baseline] (736.946 ms) : 0, 736946
BytebuddyAgent [candidate] (736.89 ms) : 0, 736890
GlobalTracer [baseline] (235.449 ms) : 0, 235449
GlobalTracer [candidate] (236.372 ms) : 0, 236372
AppSec [baseline] (177.185 ms) : 0, 177185
AppSec [candidate] (177.969 ms) : 0, 177969
Remote Config [baseline] (662.902 µs) : 0, 663
Remote Config [candidate] (657.861 µs) : 0, 658
Telemetry [baseline] (8.64 ms) : 0, 8640
Telemetry [candidate] (8.275 ms) : 0, 8275
IAST [baseline] (21.585 ms) : 0, 21585
IAST [candidate] (21.913 ms) : 0, 21913
section iast
BytebuddyAgent [baseline] (837.764 ms) : 0, 837764
BytebuddyAgent [candidate] (844.098 ms) : 0, 844098
GlobalTracer [baseline] (231.153 ms) : 0, 231153
GlobalTracer [candidate] (231.266 ms) : 0, 231266
AppSec [baseline] (57.665 ms) : 0, 57665
AppSec [candidate] (57.865 ms) : 0, 57865
Remote Config [baseline] (643.607 µs) : 0, 644
Remote Config [candidate] (615.409 µs) : 0, 615
Telemetry [baseline] (8.872 ms) : 0, 8872
Telemetry [candidate] (8.762 ms) : 0, 8762
IAST [baseline] (22.882 ms) : 0, 22882
IAST [candidate] (23.02 ms) : 0, 23020
section profiling
BytebuddyAgent [baseline] (710.089 ms) : 0, 710089
BytebuddyAgent [candidate] (709.139 ms) : 0, 709139
GlobalTracer [baseline] (349.905 ms) : 0, 349905
GlobalTracer [candidate] (350.173 ms) : 0, 350173
AppSec [baseline] (55.732 ms) : 0, 55732
AppSec [candidate] (54.366 ms) : 0, 54366
Remote Config [baseline] (675.07 µs) : 0, 675
Remote Config [candidate] (670.493 µs) : 0, 670
Telemetry [baseline] (9.027 ms) : 0, 9027
Telemetry [candidate] (8.923 ms) : 0, 8923
ProfilingAgent [baseline] (97.058 ms) : 0, 97058
ProfilingAgent [candidate] (96.041 ms) : 0, 96041
Profiling [baseline] (97.085 ms) : 0, 97085
Profiling [candidate] (96.068 ms) : 0, 96068

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-02-28T16:59:02	2025-02-28T17:06:46
git_branch	master	nikita-tkachenko/impacted-tests-ordering
git_commit_date	1740758111	1740760500
git_commit_sha	`19d8832`	`95b3762`
release_version	1.47.0-SNAPSHOT~19d8832a9d	1.47.0-SNAPSHOT~95b3762f7d
start_time	2025-02-28T16:58:47	2025-02-28T17:06:32

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1740762805	1740762805
ci_job_id	828127234	828127234
ci_pipeline_id	57367357	57367357
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-vwfacpvz-project-304-concurrent-1-paocdi21 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-vwfacpvz-project-304-concurrent-1-paocdi21 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 17 unstable metrics.

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~95b3762f7d, baseline=1.47.0-SNAPSHOT~19d8832a9d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.363 ms) : 1344, 1382
.   : milestone, 1363,
appsec (1.745 ms) : 1721, 1768
.   : milestone, 1745,
appsec_no_iast (1.746 ms) : 1722, 1771
.   : milestone, 1746,
code_origins (1.683 ms) : 1650, 1715
.   : milestone, 1683,
iast (1.515 ms) : 1491, 1540
.   : milestone, 1515,
profiling (1.5 ms) : 1476, 1523
.   : milestone, 1500,
tracing (1.5 ms) : 1476, 1524
.   : milestone, 1500,
section candidate
no_agent (1.352 ms) : 1332, 1373
.   : milestone, 1352,
appsec (1.723 ms) : 1698, 1748
.   : milestone, 1723,
appsec_no_iast (1.758 ms) : 1733, 1782
.   : milestone, 1758,
code_origins (1.701 ms) : 1668, 1734
.   : milestone, 1701,
iast (1.51 ms) : 1486, 1534
.   : milestone, 1510,
profiling (1.53 ms) : 1506, 1555
.   : milestone, 1530,
tracing (1.486 ms) : 1460, 1511
.   : milestone, 1486,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.363 ms [1.344 ms, 1.382 ms]	-
appsec	1.745 ms [1.721 ms, 1.768 ms]	381.935 µs (28.0%)
appsec_no_iast	1.746 ms [1.722 ms, 1.771 ms]	383.52 µs (28.1%)
code_origins	1.683 ms [1.65 ms, 1.715 ms]	319.766 µs (23.5%)
iast	1.515 ms [1.491 ms, 1.54 ms]	152.345 µs (11.2%)
profiling	1.5 ms [1.476 ms, 1.523 ms]	137.105 µs (10.1%)
tracing	1.5 ms [1.476 ms, 1.524 ms]	137.194 µs (10.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.352 ms [1.332 ms, 1.373 ms]	-
appsec	1.723 ms [1.698 ms, 1.748 ms]	370.555 µs (27.4%)
appsec_no_iast	1.758 ms [1.733 ms, 1.782 ms]	405.22 µs (30.0%)
code_origins	1.701 ms [1.668 ms, 1.734 ms]	348.397 µs (25.8%)
iast	1.51 ms [1.486 ms, 1.534 ms]	157.298 µs (11.6%)
profiling	1.53 ms [1.506 ms, 1.555 ms]	177.872 µs (13.2%)
tracing	1.486 ms [1.46 ms, 1.511 ms]	133.115 µs (9.8%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~95b3762f7d, baseline=1.47.0-SNAPSHOT~19d8832a9d
    dateFormat X
    axisFormat %s
section baseline
no_agent (389.261 µs) : 370, 409
.   : milestone, 389,
iast (513.545 µs) : 491, 536
.   : milestone, 514,
iast_FULL (726.064 µs) : 704, 748
.   : milestone, 726,
iast_GLOBAL (555.931 µs) : 534, 577
.   : milestone, 556,
iast_HARDCODED_SECRET_DISABLED (516.894 µs) : 494, 540
.   : milestone, 517,
iast_INACTIVE (456.966 µs) : 436, 478
.   : milestone, 457,
iast_TELEMETRY_OFF (503.741 µs) : 482, 526
.   : milestone, 504,
tracing (458.884 µs) : 438, 480
.   : milestone, 459,
section candidate
no_agent (380.517 µs) : 360, 401
.   : milestone, 381,
iast (512.218 µs) : 490, 535
.   : milestone, 512,
iast_FULL (729.877 µs) : 708, 752
.   : milestone, 730,
iast_GLOBAL (564.436 µs) : 542, 586
.   : milestone, 564,
iast_HARDCODED_SECRET_DISABLED (520.78 µs) : 498, 543
.   : milestone, 521,
iast_INACTIVE (471.667 µs) : 450, 494
.   : milestone, 472,
iast_TELEMETRY_OFF (499.834 µs) : 477, 523
.   : milestone, 500,
tracing (460.724 µs) : 439, 482
.   : milestone, 461,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	389.261 µs [369.511 µs, 409.01 µs]	-
iast	513.545 µs [490.861 µs, 536.229 µs]	124.284 µs (31.9%)
iast_FULL	726.064 µs [704.112 µs, 748.017 µs]	336.804 µs (86.5%)
iast_GLOBAL	555.931 µs [534.387 µs, 577.475 µs]	166.67 µs (42.8%)
iast_HARDCODED_SECRET_DISABLED	516.894 µs [494.216 µs, 539.572 µs]	127.633 µs (32.8%)
iast_INACTIVE	456.966 µs [436.017 µs, 477.916 µs]	67.706 µs (17.4%)
iast_TELEMETRY_OFF	503.741 µs [481.611 µs, 525.872 µs]	114.481 µs (29.4%)
tracing	458.884 µs [437.61 µs, 480.159 µs]	69.624 µs (17.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	380.517 µs [360.333 µs, 400.701 µs]	-
iast	512.218 µs [489.526 µs, 534.91 µs]	131.701 µs (34.6%)
iast_FULL	729.877 µs [708.115 µs, 751.639 µs]	349.36 µs (91.8%)
iast_GLOBAL	564.436 µs [542.417 µs, 586.454 µs]	183.919 µs (48.3%)
iast_HARDCODED_SECRET_DISABLED	520.78 µs [498.376 µs, 543.184 µs]	140.263 µs (36.9%)
iast_INACTIVE	471.667 µs [449.833 µs, 493.5 µs]	91.15 µs (24.0%)
iast_TELEMETRY_OFF	499.834 µs [476.624 µs, 523.043 µs]	119.317 µs (31.4%)
tracing	460.724 µs [439.411 µs, 482.037 µs]	80.207 µs (21.1%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/impacted-tests-ordering
git_commit_date	1740758111	1740760500
git_commit_sha	`19d8832`	`95b3762`
release_version	1.47.0-SNAPSHOT~19d8832a9d	1.47.0-SNAPSHOT~95b3762f7d

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1740763427	1740763427
ci_job_id	828127235	828127235
ci_pipeline_id	57367357	57367357
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-stj6nuyy-project-304-concurrent-5-ed95n8vi 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-stj6nuyy-project-304-concurrent-5-ed95n8vi 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~95b3762f7d, baseline=1.47.0-SNAPSHOT~19d8832a9d
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.79 s) : 14790000, 14790000
.   : milestone, 14790000,
appsec (15.108 s) : 15108000, 15108000
.   : milestone, 15108000,
iast (19.057 s) : 19057000, 19057000
.   : milestone, 19057000,
iast_GLOBAL (17.872 s) : 17872000, 17872000
.   : milestone, 17872000,
profiling (15.059 s) : 15059000, 15059000
.   : milestone, 15059000,
tracing (15.021 s) : 15021000, 15021000
.   : milestone, 15021000,
section candidate
no_agent (15.554 s) : 15554000, 15554000
.   : milestone, 15554000,
appsec (15.023 s) : 15023000, 15023000
.   : milestone, 15023000,
iast (18.865 s) : 18865000, 18865000
.   : milestone, 18865000,
iast_GLOBAL (18.258 s) : 18258000, 18258000
.   : milestone, 18258000,
profiling (15.174 s) : 15174000, 15174000
.   : milestone, 15174000,
tracing (14.9 s) : 14900000, 14900000
.   : milestone, 14900000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.79 s [14.79 s, 14.79 s]	-
appsec	15.108 s [15.108 s, 15.108 s]	318.0 ms (2.2%)
iast	19.057 s [19.057 s, 19.057 s]	4.267 s (28.9%)
iast_GLOBAL	17.872 s [17.872 s, 17.872 s]	3.082 s (20.8%)
profiling	15.059 s [15.059 s, 15.059 s]	269.0 ms (1.8%)
tracing	15.021 s [15.021 s, 15.021 s]	231.0 ms (1.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.554 s [15.554 s, 15.554 s]	-
appsec	15.023 s [15.023 s, 15.023 s]	-531.0 ms (-3.4%)
iast	18.865 s [18.865 s, 18.865 s]	3.311 s (21.3%)
iast_GLOBAL	18.258 s [18.258 s, 18.258 s]	2.704 s (17.4%)
profiling	15.174 s [15.174 s, 15.174 s]	-380.0 ms (-2.4%)
tracing	14.9 s [14.9 s, 14.9 s]	-654.0 ms (-4.2%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~95b3762f7d, baseline=1.47.0-SNAPSHOT~19d8832a9d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1485
.   : milestone, 1474,
appsec (2.338 ms) : 2295, 2382
.   : milestone, 2338,
iast (2.131 ms) : 2076, 2186
.   : milestone, 2131,
iast_GLOBAL (2.175 ms) : 2119, 2231
.   : milestone, 2175,
profiling (2.445 ms) : 2264, 2625
.   : milestone, 2445,
tracing (1.954 ms) : 1911, 1996
.   : milestone, 1954,
section candidate
no_agent (1.481 ms) : 1470, 1493
.   : milestone, 1481,
appsec (2.34 ms) : 2296, 2383
.   : milestone, 2340,
iast (2.121 ms) : 2066, 2176
.   : milestone, 2121,
iast_GLOBAL (2.171 ms) : 2115, 2226
.   : milestone, 2171,
profiling (2.007 ms) : 1962, 2052
.   : milestone, 2007,
tracing (1.956 ms) : 1913, 1998
.   : milestone, 1956,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.463 ms, 1.485 ms]	-
appsec	2.338 ms [2.295 ms, 2.382 ms]	864.517 µs (58.7%)
iast	2.131 ms [2.076 ms, 2.186 ms]	656.882 µs (44.6%)
iast_GLOBAL	2.175 ms [2.119 ms, 2.231 ms]	701.292 µs (47.6%)
profiling	2.445 ms [2.264 ms, 2.625 ms]	970.685 µs (65.9%)
tracing	1.954 ms [1.911 ms, 1.996 ms]	479.888 µs (32.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.481 ms [1.47 ms, 1.493 ms]	-
appsec	2.34 ms [2.296 ms, 2.383 ms]	858.151 µs (57.9%)
iast	2.121 ms [2.066 ms, 2.176 ms]	639.673 µs (43.2%)
iast_GLOBAL	2.171 ms [2.115 ms, 2.226 ms]	689.297 µs (46.5%)
profiling	2.007 ms [1.962 ms, 2.052 ms]	525.569 µs (35.5%)
tracing	1.956 ms [1.913 ms, 1.998 ms]	474.031 µs (32.0%)

| Package | Type | Package file | Manager | Update | Change | |---|---|---|---|---|---| | [com.datadoghq:dd-trace-api](https://github.com/datadog/dd-trace-java) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `1.46.1` -> `1.47.0` | | [com.datadoghq:dd-trace-ot](https://github.com/datadog/dd-trace-java) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `1.46.1` -> `1.47.0` | | [software.amazon.awssdk:sdk-core](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.30.33` -> `2.30.34` | | [software.amazon.awssdk:sqs](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.30.33` -> `2.30.34` | | [software.amazon.awssdk:dynamodb-enhanced](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.30.33` -> `2.30.34` | | [software.amazon.awssdk:dynamodb](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.30.33` -> `2.30.34` | | [software.amazon.awssdk:aws-core](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.30.33` -> `2.30.34` | | [software.amazon.awssdk:bom](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.30.33` -> `2.30.34` | | [software.amazon.awssdk:auth](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.30.33` -> `2.30.34` | --- ### Release Notes <details> <summary>datadog/dd-trace-java (com.datadoghq:dd-trace-api)</summary> ### [`v1.47.0`](https://github.com/DataDog/dd-trace-java/releases/tag/v1.47.0): 1.47.0 ##### Components ##### Application Security Management (IAST) - 🐛 Exclude com.stripe.net.HttpURLConnectionClient to solve IAST SSRF vulnerability false positives ([#8483](DataDog/dd-trace-java#8483) - [@jandro996](https://github.com/jandro996)) - 🐛 Add exclusion to solve IAST weak randomness vulnerability false positives ([#8462](DataDog/dd-trace-java#8462) - [@jandro996](https://github.com/jandro996)) - ✨ Fix weak randomness false positive in Kafka client ([#8408](DataDog/dd-trace-java#8408) - [@smola](https://github.com/smola)) - ✨ Fix location for SSRF with Kong Unirest ([#8407](DataDog/dd-trace-java#8407) - [@smola](https://github.com/smola)) - ✨ Exclude IBM Instana from IAST ([#8406](DataDog/dd-trace-java#8406) - [@smola](https://github.com/smola)) - 🐛 Fix org.json iast instrumentation test for latest dependency ([#8347](DataDog/dd-trace-java#8347) - [@jandro996](https://github.com/jandro996)) - ✨ Configuration to Disable APM Tracing ([#8219](DataDog/dd-trace-java#8219) - [@jandro996](https://github.com/jandro996)) - ✨ Address cookie vulnerability cardinality issues ([#8210](DataDog/dd-trace-java#8210) - [@jandro996](https://github.com/jandro996)) - ✨ Email HTML Injection detection in IAST ([#8205](DataDog/dd-trace-java#8205) - [@sezen-datadog](https://github.com/sezen-datadog)) ##### Application Security Management (WAF) - 🐛✨ Ensure usr.exists tag is not overridden when UsernameNotFoundException is thrown ([#8376](DataDog/dd-trace-java#8376) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - 🐛✨ Ensure usr.exists tag is not overridden by auto instrumentation ([#8374](DataDog/dd-trace-java#8374) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ Update appsec metrics with event_rules_version tag ([#8354](DataDog/dd-trace-java#8354) - [@sezen-datadog](https://github.com/sezen-datadog)) - ✨ Update metrics: appsec.waf.requests ([#8353](DataDog/dd-trace-java#8353) - [@Mariovido](https://github.com/Mariovido)) - ✨ Improve ASM support in vert.x 5.0 ([#8285](DataDog/dd-trace-java#8285) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ Update metrics: appsec.waf.updates and appsec.waf.init ([#8280](DataDog/dd-trace-java#8280) - [@Mariovido](https://github.com/Mariovido)) - ✨ Configuration to Disable APM Tracing ([#8219](DataDog/dd-trace-java#8219) - [@jandro996](https://github.com/jandro996)) ##### Build & Tooling - 🐛 Do not generate Muzzle references for primitive arrays in method body ([#8361](DataDog/dd-trace-java#8361) - [@amarziali](https://github.com/amarziali)) - 📖 Improve dev env setup documentation for Windows ([#8180](DataDog/dd-trace-java#8180) - [@lucaspimentel](https://github.com/lucaspimentel)) ##### Continuous Integration Visibility - ✨ Add support for skip-EFD tagging ([#8487](DataDog/dd-trace-java#8487) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🐛 Fix an NPE in Gradle Android instrumentation ([#8484](DataDog/dd-trace-java#8484) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Consider modified tests when applying fail-fast tests ordering ([#8474](DataDog/dd-trace-java#8474) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Implement tests reordering for TestNG ([#8467](DataDog/dd-trace-java#8467) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🐛 Fix Gradle Launcher instrumentation to not interfere with Gradle Test Kit ([#8465](DataDog/dd-trace-java#8465) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🧹 Use separate TestEventHandlers per framework in CI Vis instrumentations ([#8451](DataDog/dd-trace-java#8451) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Remove warning log when JUnit 4 test method cannot be retrieved ([#8445](DataDog/dd-trace-java#8445) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🐛 Fix Scalatest tracing for tests that are reported asynchronously ([#8444](DataDog/dd-trace-java#8444) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Implement attempt to fix tests ([#8393](DataDog/dd-trace-java#8393) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Implement test disabling ([#8377](DataDog/dd-trace-java#8377) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Update CODEOWNERS parser to not log errors on comments with leading whitespace ([#8349](DataDog/dd-trace-java#8349) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Request Test Management tests list ([#8345](DataDog/dd-trace-java#8345) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Receive test management settings from CIVis settings request ([#8331](DataDog/dd-trace-java#8331) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Implement quarantined tests tagging ([#8326](DataDog/dd-trace-java#8326) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Implement tests quarantining ([#8320](DataDog/dd-trace-java#8320) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Add tag to specify if the user is setting DD_SERVICE ([#8318](DataDog/dd-trace-java#8318) - [@daniel-mohedano](https://github.com/daniel-mohedano)) ##### Crash tracking - ✨ Only fork jps when required ([#8419](DataDog/dd-trace-java#8419) - [@mcculls](https://github.com/mcculls)) - 🐛 Use Java home of the crashed process to launch crash uploader ([#8348](DataDog/dd-trace-java#8348) - [@jbachorik](https://github.com/jbachorik)) ##### Data Streams Monitoring - 🐛 Fix error happening when sqs message attributes are readonly ([#8473](DataDog/dd-trace-java#8473) - [@vandonr](https://github.com/vandonr)) - 🐛 Fix bug on proto schema extraction ([#8403](DataDog/dd-trace-java#8403) - [@vandonr](https://github.com/vandonr)) - 🐛 Fix service name overrides in consumers ([#8387](DataDog/dd-trace-java#8387) - [@piochelepiotr](https://github.com/piochelepiotr)) ##### Database Monitoring - ✨ Add DBMTracePreparedStatements to tracer configuration log ([#8508](DataDog/dd-trace-java#8508) - [@cecile75](https://github.com/cecile75)) ##### Dynamic Instrumentation - ✨ Look in another location for grpc service methods ([#8468](DataDog/dd-trace-java#8468) - [@evanchooly](https://github.com/evanchooly)) - 🐛 Fix Exception Replay with Lambda proxy classes ([#8452](DataDog/dd-trace-java#8452) - [@jpbempel](https://github.com/jpbempel)) - ✨ Add code origin support for spring-webmvc ([#8416](DataDog/dd-trace-java#8416) - [@evanchooly](https://github.com/evanchooly)) - ✨ Add support for scanning jar from loaded class ([#8370](DataDog/dd-trace-java#8370) - [@jpbempel](https://github.com/jpbempel)) - 🐛 Disable capture of entry values ([#8369](DataDog/dd-trace-java#8369) - [@jpbempel](https://github.com/jpbempel)) - 🐛 Fix CodeOrigin for `@Trace` annotation ([#8344](DataDog/dd-trace-java#8344) - [@jpbempel](https://github.com/jpbempel)) - 🐛 Fix equals/hashCode for CodeOrigin probe ([#8319](DataDog/dd-trace-java#8319) - [@jpbempel](https://github.com/jpbempel)) - ✨ Add code origin support to kafka message listeners ([#8301](DataDog/dd-trace-java#8301) - [@evanchooly](https://github.com/evanchooly)) ##### Metrics - ✨ Create metric: appsec.waf.error ([#8381](DataDog/dd-trace-java#8381) - [@sezen-datadog](https://github.com/sezen-datadog)) - ✨ Create metric: appsec.rasp.error ([#8364](DataDog/dd-trace-java#8364) - [@sezen-datadog](https://github.com/sezen-datadog)) ##### Profiling - ✨ Bump ddprof library to 1.22.0 ([#8463](DataDog/dd-trace-java#8463) - [@jbachorik](https://github.com/jbachorik)) - IBM J9 8u361 corresponds to OpenJDK 8u362 by [@jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#187 - Fix compatibility with musl libc 1.2.4 by [@jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#189 - Modify version extraction by [@jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#179 - Do not write null values to jvminfo event by [@jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#184 - Productize VMStructs-based stack walker by [@jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#177 - A few minor downport issues by [@jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#180 - Enable ASGCT by default on fairly safe J9 JDK versions by [@jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#181 - 🐛 Exclude OrderedThreadPoolExecutor from queue-time measurements ([#8456](DataDog/dd-trace-java#8456) - [@jbachorik](https://github.com/jbachorik)) - ✨ Record JVM info on JVMs without JFR ([#8431](DataDog/dd-trace-java#8431) - [@jbachorik](https://github.com/jbachorik)) - 🐛 Actually use CleanupTask in TempLocationManager ([#8420](DataDog/dd-trace-java#8420) - [@mcculls](https://github.com/mcculls)) - ✨ Only fork jps when required ([#8419](DataDog/dd-trace-java#8419) - [@mcculls](https://github.com/mcculls)) - 🐛 Adjust JFR checks for J9 ([#8405](DataDog/dd-trace-java#8405) - [@jbachorik](https://github.com/jbachorik)) - 🧹 Disable smap RSS parsing by default ([#8342](DataDog/dd-trace-java#8342) - [@MattAlp](https://github.com/MattAlp)) ##### Telemetry - 🐛 Add support for JBoss jar:file format to DependencyResolver ([#8428](DataDog/dd-trace-java#8428) - [@jandro996](https://github.com/jandro996)) - ✨ Update metrics: appsec.waf.requests ([#8353](DataDog/dd-trace-java#8353) - [@Mariovido](https://github.com/Mariovido)) ##### Trace context propagation - ✨ Introduce tracing propagator ([#8313](DataDog/dd-trace-java#8313) - [@PerfectSlayer](https://github.com/PerfectSlayer)) ##### Tracer core - 🐛 Fix Stable Config telemetry source names ([#8460](DataDog/dd-trace-java#8460) - [@BaptisteFoy](https://github.com/BaptisteFoy)) - ✨ Probe trace endpoints with a valid payload of empty arrays ([#8414](DataDog/dd-trace-java#8414) - [@mcculls](https://github.com/mcculls)) - ✨ Add 1 minute fail-safe to JUL/JMX class-loading callback ([#8399](DataDog/dd-trace-java#8399) - [@mcculls](https://github.com/mcculls)) - ✨ Migrate DSM injection calls to context-first APIs ([#8383](DataDog/dd-trace-java#8383) - [@PerfectSlayer](https://github.com/PerfectSlayer)) - 🧹 Move continuation capture methods from scope to tracer ([#8371](DataDog/dd-trace-java#8371) - [@mcculls](https://github.com/mcculls)) - ✨ Migrate context extraction calls to context-first APIs ([#8368](DataDog/dd-trace-java#8368) - [@PerfectSlayer](https://github.com/PerfectSlayer)) - 🧹 Migrate context injection calls to context-first APIs ([#8358](DataDog/dd-trace-java#8358) - [@PerfectSlayer](https://github.com/PerfectSlayer)) - 💡 Support reading configurations from files ([#8338](DataDog/dd-trace-java#8338) - [@mtoffl01](https://github.com/mtoffl01)) - 💡 Implementation of BaggagePropagator and BaggageContext ([#8330](DataDog/dd-trace-java#8330) - [@mhlidd](https://github.com/mhlidd)) - 🧹 Combine continuation implementations into one which supports multiple activations ([#8324](DataDog/dd-trace-java#8324) - [@mcculls](https://github.com/mcculls)) - ✨ Introduce tracing propagator ([#8313](DataDog/dd-trace-java#8313) - [@PerfectSlayer](https://github.com/PerfectSlayer)) - ✨ Remove old context propagation API ([#8271](DataDog/dd-trace-java#8271) - [@PerfectSlayer](https://github.com/PerfectSlayer)) ##### Instrumentations ##### AWS Lambda instrumentation - 🐛 Send error message and stack to Lambda extension ([#8417](DataDog/dd-trace-java#8417) - [@nhulston](https://github.com/nhulston)) ##### AWS SDK instrumentation - 🐛 Fix error happening when sqs message attributes are readonly ([#8473](DataDog/dd-trace-java#8473) - [@vandonr](https://github.com/vandonr)) - 💡 Inject trace context into AWS Step Functions input ([#7585](DataDog/dd-trace-java#7585) - [@DylanLovesCoffee](https://github.com/DylanLovesCoffee)) ##### Core Java language instrumentation - ✨ Look in another location for grpc service methods ([#8468](DataDog/dd-trace-java#8468) - [@evanchooly](https://github.com/evanchooly)) - ✨ Add code origin support for spring-webmvc ([#8416](DataDog/dd-trace-java#8416) - [@evanchooly](https://github.com/evanchooly)) - 💡 Implementation of BaggagePropagator and BaggageContext ([#8330](DataDog/dd-trace-java#8330) - [@mhlidd](https://github.com/mhlidd)) - ✨ Add code origin support to kafka message listeners ([#8301](DataDog/dd-trace-java#8301) - [@evanchooly](https://github.com/evanchooly)) ##### gRPC instrumentation - ✨ Look in another location for grpc service methods ([#8468](DataDog/dd-trace-java#8468) - [@evanchooly](https://github.com/evanchooly)) ##### Kafka instrumentation - ✨ Add messaging.destination.name tag to kafka integrations ([#8366](DataDog/dd-trace-java#8366) - [@rarguelloF](https://github.com/rarguelloF)) ##### Protocol Buffer instrumentation - 🐛 Fix bug on proto schema extraction ([#8403](DataDog/dd-trace-java#8403) - [@vandonr](https://github.com/vandonr)) </details> --- ### Configuration 📅 **Schedule**: Branch creation - "after 6pm every weekday,before 2am every weekday" in timezone Australia/Melbourne, Automerge - At any time (no schedule defined). 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Never, or you tick the rebase/retry checkbox. 👻 **Immortal**: This PR will be recreated if closed unmerged. Get [config help](https://github.com/renovatebot/renovate/discussions) if that's undesired. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate). GitOrigin-RevId: 108a0f86aa59ab4c938cbac0688dd4c19cb301fa

Consider modified tests when applying fail-fast tests ordering

95b3762

nikita-tkachenko-datadog added type: enhancement comp: ci visibility Continuous Integration Visibility labels Feb 28, 2025

nikita-tkachenko-datadog marked this pull request as ready for review March 3, 2025 11:05

nikita-tkachenko-datadog requested a review from a team as a code owner March 3, 2025 11:05

nikita-tkachenko-datadog requested review from juan-fernandez and daniel-mohedano and removed request for a team and juan-fernandez March 3, 2025 11:05

daniel-mohedano approved these changes Mar 4, 2025

View reviewed changes

nikita-tkachenko-datadog merged commit 5c10862 into master Mar 4, 2025
212 of 221 checks passed

nikita-tkachenko-datadog deleted the nikita-tkachenko/impacted-tests-ordering branch March 4, 2025 09:09

github-actions bot added this to the 1.47.0 milestone Mar 4, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Consider modified tests when applying fail-fast tests ordering #8474

Consider modified tests when applying fail-fast tests ordering #8474

nikita-tkachenko-datadog commented Feb 28, 2025 •

edited by jira bot

Loading

pr-commenter bot commented Feb 28, 2025

Consider modified tests when applying fail-fast tests ordering #8474

Consider modified tests when applying fail-fast tests ordering #8474

Conversation

nikita-tkachenko-datadog commented Feb 28, 2025 • edited by jira bot Loading

What Does This Do

Additional Notes

Contributor Checklist

pr-commenter bot commented Feb 28, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

nikita-tkachenko-datadog commented Feb 28, 2025 •

edited by jira bot

Loading