Skip to content

Commit 5acc25d

Browse files
celinvaltedinski
authored andcommitted
Update bookrunner expectation after rust-lang#1061 fix (rust-lang#1077)
1 parent fed674c commit 5acc25d

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

scripts/ci/detect_bookrunner_failures.sh

+3-1
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ set -eu
1010
# The threshold is roughly computed as: `1.05 * <number of expected failures>`
1111
# The extra 5% allows us to account for occasional timeouts. It is reviewed and
1212
# updated whenever the Rust toolchain version is updated.
13-
EXPECTED=94
13+
EXPECTED=82
1414
THRESHOLD=$(expr ${EXPECTED} \* 105 / 100) # Add 5% threshold
1515

1616
if [[ $# -ne 1 ]]; then
@@ -29,6 +29,8 @@ NUM_FAILURES=${strarr[-1]}
2929
# Print a message and return a nonzero code if the threshold is exceeded
3030
if [[ $NUM_FAILURES -ge $THRESHOLD ]]; then
3131
echo "Error: The number of failures from bookrunner is higher than expected!"
32+
echo
33+
echo "Found $NUM_FAILURES which is higher than the threshold of $THRESHOLD"
3234
echo "This means that your changes are causing at least 5% more failures than in previous bookrunner runs."
3335
echo "To check these failures locally, run \`cargo run -p bookrunner\` and inspect the report in \`build/output/latest/html/index.html\`."
3436
echo "For more details on bookrunner, go to https://model-checking.github.io/kani/bookrunner.html"

0 commit comments

Comments
 (0)