File tree 1 file changed +3
-4
lines changed
1 file changed +3
-4
lines changed Original file line number Diff line number Diff line change @@ -142,11 +142,10 @@ be reported.
142
142
143
143
## Retry policy
144
144
145
- Any suspected performance regressions will be retried up to ` --max-retries ` times (default is 3). Only regressions that are
146
- repeatedly reproducible will cause the benchmark to exit with a nonzero exit code. The bottom of the Buildkite log will show
147
- the retry attempts.
145
+ Any scenario will be run exactly ` --runs-per-scenario ` times (default is 3). The run with the median wallclock duration
146
+ will be chosen and other runs will be discarded.
148
147
149
- Reported performance improvements are not retried to establish reprodicibility , so should be considered flukes if seen in the CI
148
+ Reported performance improvements are not retried to establish reproducibility , so should be considered flakes if seen in the CI
150
149
output until reliably reproduced locally.
151
150
152
151
# Measuring memory consumption
You can’t perform that action at this time.
0 commit comments