Skip to content

[ML-DataFrame] reset/clear the position after indexer is done #41736

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
May 6, 2019

Conversation

hendrikmuhs
Copy link

reset/clear the position after indexer is done.

@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core

@hendrikmuhs hendrikmuhs added the :StorageEngine/Rollup Turn fine-grained time-based data into coarser-grained data label May 2, 2019
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-analytics-geo

@hendrikmuhs
Copy link
Author

@polyfractal @jimczi

It seemed simple and I did not expected rollup to make trouble, but it did.

For data frames after 1 run of the composite agg the stored position in the indexer should get reset. The position is immutable from the outside - which makes sense.

This change sets the position when the indexer finishes. For rollup the position should be kept, for data frame it should be reset. Please let me know what you think, I am open for other options.

Copy link
Contributor

@polyfractal polyfractal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Makes sense, given the differences in how rollup/dataframe work.

@hendrikmuhs hendrikmuhs merged commit 74580ff into elastic:master May 6, 2019
hendrikmuhs pushed a commit that referenced this pull request May 6, 2019
reset/clear the position after indexer is done
gurkankaymak pushed a commit to gurkankaymak/elasticsearch that referenced this pull request May 27, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:ml/Transform Transform >non-issue :StorageEngine/Rollup Turn fine-grained time-based data into coarser-grained data team-discuss v7.2.0 v8.0.0-alpha1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants