Skip to content

Add known issue for zero memory on Debian 8 #1528

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
Jan 26, 2021
Merged
Changes from 4 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
41 changes: 41 additions & 0 deletions docs/en/stack/ml/anomaly-detection/ml-troubleshooting.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -188,3 +188,44 @@ POST _ml/set_upgrade_mode?enabled=false&timeout=10m
DELETE temp_ml_config
--------------------------------------------------
// TEST[skip:TBD]

[discrete]
[[ml-debian8-memory]]
== Suboptimal job assignment on Debian 8

Where possible, {ml} jobs are assigned to nodes based on the memory requirement
of the job and the memory available on the node. However, in certain cases, the
amount of memory on a node cannot be accurately determined, and then jobs are
assigned by balancing numbers of jobs per {ml} node. It may lead to a situation
where all the jobs with high memory requirements are on one node and the less
memory-intensive jobs on another.

One particular case of this problem is that {es} fails to determine the amount
of memory on a machine that is running Debian 8 with the default Cgroups setup,
and certain updates of Java versions earlier than Java 15. For example, Java
8u271 is known to be affected while Java 8u272 is not. Java 15 was fixed from
its initial release.

If you are running {es} on Debian 8 with an old version of Java and have not
already modified the Cgroups setup then it is recommended to do one of the
following:

1. Upgrade Java to version 15.
2. Upgrade to the latest Java update for the version of Java you are running.
3. Enable the "memory" Cgroup by editing `/etc/default/grub` and adding:
+
--
```
GRUB_CMDLINE_LINUX_DEFAULT="quiet cgroup_enable=memory swapaccount=1"
```
--
+
Then update your GRUB configuration by running:
+
--
```
sudo update-grub
```
--
+
Reboot the machine.