Skip to content

Data Tier correlation for searchable_snapshot mount location #74706

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 7 commits into from
Jun 30, 2021

Conversation

stefnestor
Copy link
Contributor

Per @andreidan wisdom:

searchable snapshots are mounted directly on the corresponding data tiers (namely, fully mounted indices on the hot, cold or frozen tiers (depending on the ILM phase where the searchable_action is defined) while the partially mounted indices are mounted on the frozen tier).

This points out the prerequisite of the corresponding data tier for the searchable_snapshot phase.

@stefnestor stefnestor added >docs General docs changes Team:Docs Meta label for docs team labels Jun 29, 2021
@stefnestor stefnestor requested review from andreidan and jrodewig June 29, 2021 15:25
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-docs (Team:Docs)

@elasticsearchmachine elasticsearchmachine added v8.0.0 external-contributor Pull request authored by a developer outside the Elasticsearch team labels Jun 29, 2021
@jrodewig jrodewig added :Data Management/ILM+SLM Index and Snapshot lifecycle management :Distributed Coordination/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs v7.13.3 v7.14.0 labels Jun 29, 2021
@elasticmachine elasticmachine added Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. Team:Data Management Meta label for data/management team labels Jun 29, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (Team:Distributed)

@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-features (Team:Core/Features)

Copy link
Contributor

@jrodewig jrodewig left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for this clarification @stefnestor.

In addition to your change, I added a sentence to make it clearer that the action requires data tiers. I also moved the last sentence to the first paragraph.

This LGTM, but I'll wait on @andreidan's review before merging.

@mark-vieira
Copy link
Contributor

@elasticmachine retest this please

1 similar comment
@mark-vieira
Copy link
Contributor

@elasticmachine retest this please

Copy link
Contributor

@andreidan andreidan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've left a minor suggestion, thanks for working on this Stef!

the data stream.
the stream.

The `searchable_snapshot` action requires <<data-tiers,data tiers>>. In the
Copy link
Contributor

@andreidan andreidan Jun 30, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could we expand this a bit and say something like:

The `searchable_snapshot` action requires a system that uses <<data-tiers,data tiers>> 
as it will mount the index directly on the corresponding tier using the
 <<tier-preference-allocation-filter, `index.routing.allocation.include._tier_preference`>> setting.

Maybe @jrodewig has a better suggestion here? (I don't particularly like "a system that uses ..." but not sure how else to phrase this).

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @andreidan. I pushed some changes to incorporate the index.routing.allocation.include._tier_preference setting content.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks James

@jrodewig
Copy link
Contributor

@elasticmachine run elasticsearch-ci/docs

@stefnestor
Copy link
Contributor Author

stefnestor commented Jul 12, 2021

@jrodewig can we also back port this applicable info to 7.12, 7.11, & 7.10? I know we back ported to 7.x (thank you!), but if we still back port to the other version it'd help as well. 🙏🏼

@jrodewig
Copy link
Contributor

Hi @stefnestor. Thanks for reaching out.

Per our backport guidelines, we typically don't backport doc changes to out-of-maintenance versions. However, I'll work on getting these in as it seems to be a problem point.

jrodewig added a commit that referenced this pull request Jul 12, 2021
jrodewig added a commit that referenced this pull request Jul 12, 2021
jrodewig added a commit that referenced this pull request Jul 12, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Data Management/ILM+SLM Index and Snapshot lifecycle management :Distributed Coordination/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs >docs General docs changes external-contributor Pull request authored by a developer outside the Elasticsearch team Team:Data Management Meta label for data/management team Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. Team:Docs Meta label for docs team v7.10.3 v7.11.3 v7.12.2 v7.13.3 v7.14.0 v8.0.0-alpha1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants