From 3abb0845a5c3d9f3f80c8f88c76196daf5df1888 Mon Sep 17 00:00:00 2001 From: lcawl Date: Mon, 14 Dec 2020 11:12:07 -0800 Subject: [PATCH 1/3] [DOCS] Adds xpack.ml.max_ml_node_size --- docs/reference/settings/ml-settings.asciidoc | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/docs/reference/settings/ml-settings.asciidoc b/docs/reference/settings/ml-settings.asciidoc index 335d1a5c75234..ab550157216e2 100644 --- a/docs/reference/settings/ml-settings.asciidoc +++ b/docs/reference/settings/ml-settings.asciidoc @@ -80,6 +80,11 @@ total memory of the machine, not current free memory. Jobs are not allocated to a node if doing so would cause the estimated memory use of {ml} jobs to exceed the limit. +`xpack.ml.max_ml_node_size`:: +(<>) +The maximum node size for {ml} nodes. Defaults to `0b`, which means this value +is ignored. + `xpack.ml.max_model_memory_limit`:: (<>) The maximum `model_memory_limit` property value that can be set for any job on this node. If you try to create a job with From ac61994e9454cdb4d0c8b85da65d698cf58fa5d9 Mon Sep 17 00:00:00 2001 From: lcawl Date: Mon, 14 Dec 2020 12:23:39 -0800 Subject: [PATCH 2/3] [DOCS] Clarify setting description --- docs/reference/settings/ml-settings.asciidoc | 13 ++++++++----- 1 file changed, 8 insertions(+), 5 deletions(-) diff --git a/docs/reference/settings/ml-settings.asciidoc b/docs/reference/settings/ml-settings.asciidoc index ab550157216e2..f6265b0cb75a0 100644 --- a/docs/reference/settings/ml-settings.asciidoc +++ b/docs/reference/settings/ml-settings.asciidoc @@ -80,11 +80,6 @@ total memory of the machine, not current free memory. Jobs are not allocated to a node if doing so would cause the estimated memory use of {ml} jobs to exceed the limit. -`xpack.ml.max_ml_node_size`:: -(<>) -The maximum node size for {ml} nodes. Defaults to `0b`, which means this value -is ignored. - `xpack.ml.max_model_memory_limit`:: (<>) The maximum `model_memory_limit` property value that can be set for any job on this node. If you try to create a job with @@ -149,6 +144,14 @@ IMPORTANT: This setting assumes some external process is capable of adding {ml} nodes to the cluster. This setting is only useful when used in conjunction with such an external process. +`xpack.ml.max_ml_node_size`:: +(<>) +The maximum node size for {ml} nodes in a deployment that supports automatic +cluster scaling. Defaults to `0b`, which means this value is ignored. If you set +it to the maximum possible size of future {ml} nodes, when a {ml} job is +assigned to a lazy node it can check (and fail quickly) when scaling cannot +support the size of the job. + `xpack.ml.process_connect_timeout`:: (<>) The connection timeout for {ml} processes that run separately from the {es} JVM. Defaults to `10s`. Some {ml} processing From a708d5649219436fd4d4a4eef1fff5f0b621e2be Mon Sep 17 00:00:00 2001 From: lcawl Date: Mon, 14 Dec 2020 15:27:19 -0800 Subject: [PATCH 3/3] [DOCS] Changes static setting to dynamic --- docs/reference/settings/ml-settings.asciidoc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/reference/settings/ml-settings.asciidoc b/docs/reference/settings/ml-settings.asciidoc index f6265b0cb75a0..5bd63f1ae0acf 100644 --- a/docs/reference/settings/ml-settings.asciidoc +++ b/docs/reference/settings/ml-settings.asciidoc @@ -145,7 +145,7 @@ nodes to the cluster. This setting is only useful when used in conjunction with such an external process. `xpack.ml.max_ml_node_size`:: -(<>) +(<>) The maximum node size for {ml} nodes in a deployment that supports automatic cluster scaling. Defaults to `0b`, which means this value is ignored. If you set it to the maximum possible size of future {ml} nodes, when a {ml} job is