Skip to content

[ML] Add total memory available to ML cluster-wide to ML info response #64225

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
droberts195 opened this issue Oct 27, 2020 · 2 comments · Fixed by #65195
Closed

[ML] Add total memory available to ML cluster-wide to ML info response #64225

droberts195 opened this issue Oct 27, 2020 · 2 comments · Fixed by #65195
Labels
>enhancement :ml Machine learning

Comments

@droberts195
Copy link
Contributor

It is useful to know the total amount of native memory ML is allowed to use cluster-wide at a given time, for example when planning which subset of a large number of security jobs to enabled.

It is possible to calculate the quantity in a client given knowledge of the node attributes and cluster settings. However, this breaches encapsulation by duplicating a formula that is used in Elasticsearch code, and runs the risk that client and server diverge in the future.

Therefore, it would be better if the result of the calculation done in Elasticsearch code was made available as one of the outputs of the ML info endpoint.
@droberts195 droberts195 added >enhancement :ml Machine learning labels Oct 27, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (:ml)

@droberts195 droberts195 mentioned this issue Dec 2, 2020
Merged
@droberts195
Copy link
Contributor Author

Closed by #65195

@stevejgordon stevejgordon mentioned this issue Dec 17, 2020
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
>enhancement :ml Machine learning
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[ML] Add total ML memory to ML info droberts195/elasticsearch
2 participants
@droberts195 @elasticmachine