Skip to content

[skip circleci] Rerun tests between workflow run attempts #2408

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 2 commits into from

Conversation

jneira
Copy link
Member

@jneira jneira commented Nov 27, 2021

  • To try to alliviate flakiness. Even if we get to reduce the number of flaky tests i think we could keep this as tests always can fail due to external factors
  • The trick is cache .tasty-rerun-log per commit and workflow matrix. So f.e. linux+ghc-8.6.5+commit is succesful and windows+ghc-9.0.1 fails the previous one will be succesfull without actually running any test (which might fail this time)
  • Test options are --rerun-update --rerun-filter failures,exceptions,new, if there is no .tasty-rerun-log, the situation in the first attempt of the run, it will execute all tests. All succesives test executions will filter out the succesful ones, even between different run attempts

@jneira jneira changed the title Rerun tests between workflow run attempts [skip circleci] Rerun tests between workflow run attempts Nov 27, 2021
@jneira
Copy link
Member Author

jneira commented Nov 28, 2021

Included in #2393 to help get it merged. This changes are only ci config ones, so it cant introduce itself any bug

@jneira jneira closed this Nov 28, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant