Skip to content

Fix test failures related to file corruption #36530

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Dec 12, 2018

Conversation

s1monw
Copy link
Contributor

@s1monw s1monw commented Dec 12, 2018

This closes #36526 and fixes a general issue with our CorruptionUtils

We currently only prune old .liv generations. With soft_deletes it's important
to also prune DV generations.
Today we read a broken checksum since we also checksum the 8 footer bytes that include
the checksum algorithm and the footer magic.

Closes elastic#36526
@s1monw s1monw added >non-issue >test Issues or PRs that are addressing/adding tests >test-failure Triaged test failures from CI v7.0.0 labels Dec 12, 2018
@s1monw s1monw requested a review from dnhatn December 12, 2018 09:48
@colings86 colings86 added the :Core/Infra/Core Core issues without another label label Dec 12, 2018
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-infra

Copy link
Member

@dnhatn dnhatn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks @s1monw.

@s1monw s1monw merged commit ff5dd14 into elastic:master Dec 12, 2018
@s1monw s1monw deleted the fix_corrupt_test branch December 12, 2018 15:21
s1monw added a commit that referenced this pull request Dec 12, 2018
* Fix CorruptFileIT to also take last DV generation into account

We currently only prune old .liv generations. With soft_deletes it's important
to also prune DV generations.

* Fix CorruptionUtils to skip the footer bytes after the checksum is read.

Today we read a broken checksum since we also checksum the 8 footer bytes that include
the checksum algorithm and the footer magic.

Closes #36526
@s1monw s1monw added the v6.6.0 label Dec 12, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Core/Infra/Core Core issues without another label >non-issue >test Issues or PRs that are addressing/adding tests >test-failure Triaged test failures from CI v6.6.0 v7.0.0-beta1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[CI] testCorruptFileThenSnapshotAndRestore fails
4 participants