Skip to content

Commit ba66669

Browse files
authored
[DOCS] Rename mount types for searchable snapshots (#72699)
Changes: * Renames 'full copy searchable snapshot' to 'fully mounted index.' * Renames 'shared cache searchable snapshot' to 'partially mounted index.' * Removes some unneeded cache setup instructions for the frozen tier. We added a default cache size with #71844.
1 parent 15e42fd commit ba66669

File tree

10 files changed

+75
-93
lines changed

10 files changed

+75
-93
lines changed

docs/java-rest/high-level/searchable_snapshots/caches_stats.asciidoc

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,8 @@
1010
[id="{upid}-{api}-request"]
1111
==== Request
1212

13-
The Cache Stats API provides statistics about searchable snapshot shared cache.
13+
Retrieves statistics about the shared cache for
14+
{ref}/searchable-snapshots.html#partially-mounted[partially mounted indices].
1415

1516
["source","java",subs="attributes,callouts,macros"]
1617
--------------------------------------------------

docs/reference/cluster/nodes-stats.asciidoc

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -259,12 +259,14 @@ Total size, in bytes, of all shards assigned to the node.
259259
`total_data_set_size`::
260260
(<<byte-units,byte value>>)
261261
Total data set size of all shards assigned to the node.
262-
This includes the size of shards not stored fully on the node (shared cache searchable snapshots).
262+
This includes the size of shards not stored fully on the node, such as the
263+
cache for <<partially-mounted,partially mounted indices>>.
263264

264265
`total_data_set_size_in_bytes`::
265266
(integer)
266267
Total data set size, in bytes, of all shards assigned to the node.
267-
This includes the size of shards not stored fully on the node (shared cache searchable snapshots).
268+
This includes the size of shards not stored fully on the node, such as the
269+
cache for <<partially-mounted,partially mounted indices>>.
268270

269271
`reserved`::
270272
(<<byte-units,byte value>>)

docs/reference/cluster/stats.asciidoc

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -243,12 +243,14 @@ Total size, in bytes, of all shards assigned to selected nodes.
243243
`total_data_set_size`::
244244
(<<byte-units, byte units>>)
245245
Total data set size of all shards assigned to selected nodes.
246-
This includes the size of shards not stored fully on the nodes (shared cache searchable snapshots).
246+
This includes the size of shards not stored fully on the nodes, such as the
247+
cache for <<partially-mounted,partially mounted indices>>.
247248

248249
`total_data_set_size_in_bytes`::
249250
(integer)
250251
Total data set size, in bytes, of all shards assigned to selected nodes.
251-
This includes the size of shards not stored fully on the nodes (shared cache searchable snapshots).
252+
This includes the size of shards not stored fully on the nodes, such as the
253+
cache for <<partially-mounted,partially mounted indices>>.
252254

253255
`reserved`::
254256
(<<byte-units,byte value>>)

docs/reference/datatiers.asciidoc

Lines changed: 8 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -78,8 +78,9 @@ Once data is no longer being updated, it can move from the warm tier to the cold
7878
stays while being queried infrequently.
7979
The cold tier is still a responsive query tier, but data in the cold tier is not normally updated.
8080
As data transitions into the cold tier it can be compressed and shrunken.
81-
For resiliency, indices in the cold tier can rely on
82-
<<ilm-searchable-snapshot, searchable snapshots>>, eliminating the need for replicas.
81+
For resiliency, the cold tier can use <<fully-mounted,fully mounted indices>> of
82+
<<ilm-searchable-snapshot,{search-snaps}>>, eliminating the need for
83+
replicas.
8384

8485
[discrete]
8586
[[frozen-tier]]
@@ -88,20 +89,11 @@ For resiliency, indices in the cold tier can rely on
8889
Once data is no longer being queried, or being queried rarely, it may move from
8990
the cold tier to the frozen tier where it stays for the rest of its life.
9091

91-
The frozen tier uses <<searchable-snapshots,{search-snaps}>> to store and load
92-
data from a snapshot repository. Instead of using a full local copy of your
93-
data, these {search-snaps} use smaller <<shared-cache,local caches>> containing
94-
only recently searched data. If a search requires data that is not in a cache,
95-
{es} fetches the data as needed from the snapshot repository. This decouples
96-
compute and storage, letting you run searches over very large data sets with
97-
minimal compute resources, which significantly reduces your storage and
98-
operating costs.
99-
100-
The <<ilm-index-lifecycle, frozen phase>> automatically converts data
101-
transitioning into the frozen tier into a shared-cache searchable snapshot.
102-
103-
Search is typically slower on the frozen tier than the cold tier, because {es}
104-
must sometimes fetch data from the snapshot repository.
92+
The frozen tier uses <<partially-mounted,partially mounted indices>> to store
93+
and load data from a snapshot repository. This reduces local storage and
94+
operating costs while still letting you search frozen data. Because {es} must
95+
sometimes fetch frozen data from the snapshot repository, searches on the frozen
96+
tier are typically slower than on the cold tier.
10597

10698
[discrete]
10799
[[data-tier-allocation]]

docs/reference/migration/migrate_8_0/settings.asciidoc

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -167,7 +167,7 @@ Discontinue use of the removed settings. If needed, use
167167
cluster recovery pending a certain number of data nodes.
168168
====
169169

170-
.Setting the searchable snapshots shared cache size on non-frozen nodes is no longer permitted.
170+
.You can no longer set `xpack.searchable.snapshot.shared_cache.size` on non-frozen nodes.
171171
[%collapsible]
172172
====
173173
*Details* +
@@ -176,10 +176,10 @@ that does not have the `data_frozen` role was deprecated in {es} 7.12.0 and has
176176
been removed in {es} 8.0.0.
177177
178178
*Impact* +
179-
Discontinue use of the removed setting. Note that searchable snapshots mounted
180-
using the `shared_cache` storage option were only allocated to nodes that had
181-
the `data_frozen` role, so removing this setting on nodes that do not have the
182-
`data_frozen` role will have no impact on functionality.
179+
{es} only allocates partially mounted indices to nodes with the `data_frozen`
180+
role. Do not set `xpack.searchable.snapshot.shared_cache.size` on nodes without
181+
the `data_frozen` role. Removing the setting on nodes without the `data_frozen`
182+
role will not impact functionality.
183183
====
184184

185185
.By default, destructive index actions do not allow wildcards.

docs/reference/searchable-snapshots/apis/clear-cache.asciidoc

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,8 +8,8 @@
88

99
experimental::[]
1010

11-
Clears indices and data streams from the <<shared-cache,shared searchable
12-
snapshot cache>>.
11+
Clears indices and data streams from the shared cache for
12+
<<partially-mounted,partially mounted indices>>.
1313

1414
[[searchable-snapshots-api-clear-cache-request]]
1515
==== {api-request-title}

docs/reference/searchable-snapshots/apis/mount-snapshot.asciidoc

Lines changed: 12 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -48,12 +48,18 @@ include::{es-repo-dir}/rest-api/common-parms.asciidoc[tag=master-timeout]
4848
Defaults to `false`.
4949

5050
`storage`::
51-
(Optional, string) Selects the kind of local storage used to accelerate
52-
searches of the mounted index. If `full_copy`, each node holding a shard of the
53-
searchable snapshot index makes a full copy of the shard to its local storage.
54-
If `shared_cache`, the shard uses the
55-
<<searchable-snapshots-shared-cache,shared cache>>. Defaults to `full_copy`.
56-
See <<searchable-snapshot-mount-storage-options>>.
51+
+
52+
--
53+
(Optional, string)
54+
<<searchable-snapshot-mount-storage-options,Mount option>> for the
55+
{search-snap} index. Possible values are:
56+
57+
`full_copy` (Default):::
58+
<<fully-mounted,Fully mounted index>>.
59+
60+
`shared_cache`:::
61+
<<partially-mounted,Partially mounted index>>.
62+
--
5763

5864
[[searchable-snapshots-api-mount-request-body]]
5965
==== {api-request-body-title}

docs/reference/searchable-snapshots/apis/node-cache-stats.asciidoc

Lines changed: 4 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,8 @@
66
<titleabbrev>Cache stats</titleabbrev>
77
++++
88

9-
Provide statistics about the searchable snapshots <<shared-cache,shared cache>>.
9+
Retrieves statistics about the shared cache for <<partially-mounted,partially
10+
mounted indices>>.
1011

1112
[[searchable-snapshots-api-cache-stats-request]]
1213
==== {api-request-title}
@@ -22,12 +23,6 @@ If the {es} {security-features} are enabled, you must have the
2223
`manage` cluster privilege to use this API.
2324
For more information, see <<security-privileges>>.
2425

25-
[[searchable-snapshots-api-cache-stats-desc]]
26-
==== {api-description-title}
27-
28-
You can use the Cache Stats API to retrieve statistics about the
29-
usage of the <<shared-cache,shared cache>> on nodes in a cluster.
30-
3126
[[searchable-snapshots-api-cache-stats-path-params]]
3227
==== {api-path-parms-title}
3328

@@ -97,7 +92,8 @@ Contains statistics about the shared cache file.
9792
[[searchable-snapshots-api-cache-stats-example]]
9893
==== {api-examples-title}
9994

100-
Retrieves the searchable snapshots shared cache file statistics for all data nodes:
95+
Gets the statistics about the shared cache for partially mounted indices from
96+
all data nodes:
10197

10298
[source,console]
10399
--------------------------------------------------

docs/reference/searchable-snapshots/index.asciidoc

Lines changed: 32 additions & 38 deletions
Original file line numberDiff line numberDiff line change
@@ -117,76 +117,75 @@ copying data from the primary.
117117
To search a snapshot, you must first mount it locally as an index. Usually
118118
{ilm-init} will do this automatically, but you can also call the
119119
<<searchable-snapshots-api-mount-snapshot,mount snapshot>> API yourself. There
120-
are two options for mounting a snapshot, each with different performance
121-
characteristics and local storage footprints:
120+
are two options for mounting an index from a snapshot, each with different
121+
performance characteristics and local storage footprints:
122122

123-
[[full-copy]]
124-
Full copy::
123+
[[fully-mounted]]
124+
Fully mounted index::
125125
Loads a full copy of the snapshotted index's shards onto node-local storage
126-
within the cluster. This is the default mount option. {ilm-init} uses this
127-
option by default in the `hot` and `cold` phases.
126+
within the cluster. {ilm-init} uses this option in the `hot` and `cold` phases.
128127
+
129-
Search performance for a full-copy searchable snapshot index is normally
128+
Search performance for a fully mounted index is normally
130129
comparable to a regular index, since there is minimal need to access the
131130
snapshot repository. While recovery is ongoing, search performance may be
132131
slower than with a regular index because a search may need some data that has
133132
not yet been retrieved into the local copy. If that happens, {es} will eagerly
134133
retrieve the data needed to complete the search in parallel with the ongoing
135134
recovery.
136135

137-
[[shared-cache]]
138-
Shared cache::
136+
[[partially-mounted]]
137+
Partially mounted index::
139138
Uses a local cache containing only recently searched parts of the snapshotted
140-
index's data. {ilm-init} uses this option by default in the `frozen` phase and
141-
corresponding frozen tier.
139+
index's data. This cache has a fixed size and is shared across nodes in the
140+
frozen tier. {ilm-init} uses this option in the `frozen` phase.
142141
+
143142
If a search requires data that is not in the cache, {es} fetches the missing
144143
data from the snapshot repository. Searches that require these fetches are
145144
slower, but the fetched data is stored in the cache so that similar searches
146145
can be served more quickly in future. {es} will evict infrequently used data
147146
from the cache to free up space.
148147
+
149-
Although slower than a full local copy or a regular index, a shared-cache
150-
searchable snapshot index still returns search results quickly, even for large
151-
data sets, because the layout of data in the repository is heavily optimized
152-
for search. Many searches will need to retrieve only a small subset of the
153-
total shard data before returning results.
154-
155-
To mount a searchable snapshot index with the shared cache mount option, you
156-
must have one or more nodes with a shared cache available. By default,
157-
dedicated frozen data tier nodes (nodes with the `data_frozen` role and no other
158-
data roles) have a shared cache configured using the greater of 90% of total
159-
disk space and total disk space subtracted a headroom of 100GB.
148+
Although slower than a fully mounted index or a regular index, a
149+
partially mounted index still returns search results quickly, even for
150+
large data sets, because the layout of data in the repository is heavily
151+
optimized for search. Many searches will need to retrieve only a small subset of
152+
the total shard data before returning results.
153+
154+
To partially mount an index, you must have one or more nodes with a shared cache
155+
available. By default, dedicated frozen data tier nodes (nodes with the
156+
`data_frozen` role and no other data roles) have a shared cache configured using
157+
the greater of 90% of total disk space and total disk space subtracted a
158+
headroom of 100GB.
160159

161160
Using a dedicated frozen tier is highly recommended for production use. If you
162161
do not have a dedicated frozen tier, you must configure the
163162
`xpack.searchable.snapshot.shared_cache.size` setting to reserve space for the
164-
cache on one or more nodes. Indices mounted with the shared cache mount option
163+
cache on one or more nodes. Partially mounted indices
165164
are only allocated to nodes that have a shared cache.
166165

167166
[[searchable-snapshots-shared-cache]]
168167
`xpack.searchable.snapshot.shared_cache.size`::
169168
(<<static-cluster-setting,Static>>)
170-
The size of the space reserved for the shared cache, either specified as a
171-
percentage of total disk space or an absolute <<byte-units,byte value>>.
172-
Defaults to 90% of total disk space on dedicated frozen data tier nodes,
173-
otherwise `0b`.
169+
Disk space reserved for the shared cache of partially mounted indices.
170+
Accepts a percentage of total disk space or an absolute <<byte-units,byte
171+
value>>. Defaults to `90%` of total disk space for dedicated frozen data tier
172+
nodes. Otherwise defaults to `0b`.
174173

175174
`xpack.searchable.snapshot.shared_cache.size.max_headroom`::
176175
(<<static-cluster-setting,Static>>, <<byte-units,byte value>>)
177-
For dedicated frozen tier nodes, the max headroom to maintain. Defaults to 100GB
178-
on dedicated frozen tier nodes when
179-
`xpack.searchable.snapshot.shared_cache.size` is not explicitly set, otherwise
180-
-1 (not set). Can only be set when `xpack.searchable.snapshot.shared_cache.size`
181-
is set as a percentage.
176+
For dedicated frozen tier nodes, the max headroom to maintain. If
177+
`xpack.searchable.snapshot.shared_cache.size` is not explicitly set, this
178+
setting defaults to `100GB`. Otherwise it defaults to `-1` (not set). You can
179+
only configure this setting if `xpack.searchable.snapshot.shared_cache.size` is
180+
set as a percentage.
182181

183182
To illustrate how these settings work in concert let us look at two examples
184183
when using the default values of the settings on a dedicated frozen node:
185184

186185
* A 4000 GB disk will result in a shared cache sized at 3900 GB. 90% of 4000 GB
187186
is 3600 GB, leaving 400 GB headroom. The default `max_headroom` of 100 GB
188187
takes effect, and the result is therefore 3900 GB.
189-
* A 400 GB disk will result in a shard cache sized at 360 GB.
188+
* A 400 GB disk will result in a shared cache sized at 360 GB.
190189

191190
You can configure the settings in `elasticsearch.yml`:
192191

@@ -199,11 +198,6 @@ IMPORTANT: You can only configure these settings on nodes with the
199198
<<data-frozen-node,`data_frozen`>> role. Additionally, nodes with a shared
200199
cache can only have a single <<path-settings,data path>>.
201200

202-
You can set `xpack.searchable.snapshot.shared_cache.size` to any size between a
203-
couple of gigabytes up to 90% of available disk space. We only recommend larger
204-
sizes if you use the node exclusively on a frozen tier or for searchable
205-
snapshots.
206-
207201
[discrete]
208202
[[back-up-restore-searchable-snapshots]]
209203
=== Back up and restore {search-snaps}

docs/reference/tab-widgets/data-tiers.asciidoc

Lines changed: 2 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -36,19 +36,8 @@ node.roles: [ data_cold ]
3636
node.roles: [ data_frozen ]
3737
----
3838

39-
For nodes in the frozen tier, set
40-
<<searchable-snapshots-shared-cache,`xpack.searchable.snapshot.shared_cache.size`>>
41-
to up to 90% of the node's available disk space. The frozen tier uses this space
42-
to create a <<shared-cache,shared, fixed-size cache>> for
43-
<<searchable-snapshots,searchable snapshots>>.
44-
45-
[source,yaml]
46-
----
47-
node.roles: [ data_frozen ]
48-
xpack.searchable.snapshot.shared_cache.size: 50GB
49-
----
50-
51-
If needed, you can assign a node to more than one tier.
39+
We recommend you use dedicated nodes in the frozen tier. If needed, you can
40+
assign other nodes to more than one tier.
5241

5342
[source,yaml]
5443
----

0 commit comments

Comments
 (0)