Skip to content

Ability to summarize running total value in long term #59684

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
jehutywong opened this issue Jul 16, 2020 · 3 comments
Closed

Ability to summarize running total value in long term #59684

jehutywong opened this issue Jul 16, 2020 · 3 comments
Labels
:Analytics/Aggregations Aggregations >enhancement :ml/Transform Transform Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo)

Comments

@jehutywong
Copy link

jehutywong commented Jul 16, 2020

For running total values like network traffic, the derivative aggregation will always run into bucket size limit along with the No of date_histogram bucket grow to certain extent. Further the current composite aggs / transforms does not support derivative aggs.

For case to get the max/min rate bucket out of the running total. I have to DIY outside ES. (refers to here https://discuss.elastic.co/t/suggestion-on-summarizing-running-total-value/241339)

I understand that the current arch may have its limitation, what i am thinking is that if we can simply cut time range into pieces and let ES manage and recursive all those pieces to get the final result.

@jehutywong jehutywong added >enhancement needs:triage Requires assignment of a team area label labels Jul 16, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-analytics-geo (:Analytics/Aggregations)

@elasticmachine elasticmachine added the Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) label Jul 16, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (:ml/Transform)

@hendrikmuhs hendrikmuhs removed the needs:triage Requires assignment of a team area label label Jul 16, 2020
@imotov
Copy link
Contributor

imotov commented Apr 20, 2022

If I understand the issue correctly that looks like duplicate of #60619 and something that we are planning to address it as part of #74660. Please feel free to reopen and add additional information if my understanding is incorrect and this will not address the issue.

Closing as a duplicate.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Analytics/Aggregations Aggregations >enhancement :ml/Transform Transform Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo)
Projects
None yet
Development

No branches or pull requests

5 participants