Skip to content

Assert translog stats busily #45809

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Aug 21, 2019
Merged

Assert translog stats busily #45809

merged 3 commits into from
Aug 21, 2019

Conversation

dnhatn
Copy link
Member

@dnhatn dnhatn commented Aug 21, 2019

If soft-deletes is enabled, we will trim translog above the local checkpoint of the safe commit immediately. However, if the translog durability is async, the last commit might not be the safe commit as the local checkpoint won't advance until translog is synced. We can't verify translog stats in this case.

Closes #45801
Relates #45473

@dnhatn dnhatn added >test Issues or PRs that are addressing/adding tests :Distributed Indexing/Distributed A catch all label for anything in the Distributed Indexing Area. Please avoid if you can. v8.0.0 v7.4.0 labels Aug 21, 2019
@dnhatn dnhatn requested a review from henningandersen August 21, 2019 16:51
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed

Copy link
Member

@original-brownbear original-brownbear left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks @dnhatn LGTM!

@dnhatn
Copy link
Member Author

dnhatn commented Aug 21, 2019

Thanks @original-brownbear.

@dnhatn dnhatn changed the title Do not verify translog stats if durability is async Assert translog stats busily Aug 21, 2019
@dnhatn dnhatn merged commit 34d6913 into elastic:master Aug 21, 2019
@dnhatn dnhatn deleted the fix-translog-stats branch August 21, 2019 22:14
dnhatn added a commit to dnhatn/elasticsearch that referenced this pull request Aug 22, 2019
If soft-deletes is enabled, we will trim translog above the local
checkpoint of the safe commit immediately. However, if the translog
durability is async, the last commit might not be the safe commit as the
local checkpoint won't advance until translog is synced. Therefore, we
need to verify translog stats busily.

Closes elastic#45801
Relates elastic#45473
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Distributed Indexing/Distributed A catch all label for anything in the Distributed Indexing Area. Please avoid if you can. >test Issues or PRs that are addressing/adding tests v7.4.0 v8.0.0-alpha1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[CI] OpenCloseIndexIT testTranslogStats failures
4 participants