-
Notifications
You must be signed in to change notification settings - Fork 25.2k
[ML] Use results retention time for deleting system annotations #76096
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[ML] Use results retention time for deleting system annotations #76096
Conversation
In elastic#75617 a new setting, system_annotations_retention_days, was added to control how long system annotations are retained for. We now feel that this setting is redundant and that system annotations should be retained for the same period as results. This is intuitive and defensible, as system annotations can be considered a type of result. Followup to elastic#75617
Pinging @elastic/ml-core (Team:ML) |
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
very minor things, but I like the change. Keep it simple!
docs/reference/ml/ml-shared.asciidoc
Outdated
@@ -1433,16 +1433,6 @@ bucket result are deleted from {es}. The default value is null, which means all | |||
results are retained. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We should comment here that system created annotations are also deleted.
@@ -193,7 +192,9 @@ public void writeTo(StreamOutput out) throws IOException { | |||
out.writeOptionalLong(modelSnapshotRetentionDays); | |||
out.writeOptionalLong(dailyModelSnapshotRetentionAfterDays); | |||
out.writeOptionalLong(resultsRetentionDays); | |||
out.writeOptionalLong(systemAnnotationsRetentionDays); | |||
if (out.getVersion().onOrAfter(Version.V_7_15_0) && out.getVersion().before(Version.V_8_0_0)) { | |||
out.writeOptionalLong(null); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think technically this should be out.writeOptionalLong(resultsRetentionDays);
But, that doesn't matter really as when this change is backported this branch is removed.
Remove the last bits of code after the backport PR (elastic#76113) is merged. Followup to elastic#76096
* [ML] Use results retention time for deleting system annotations In #75617 a new setting, system_annotations_retention_days, was added to control how long system annotations are retained for. We now feel that this setting is redundant and that system annotations should be retained for the same period as results. This is intuitive and defensible, as system annotations can be considered a type of result. Backport of #76096 * Fix one more merge clash
* [ML] Removing last traces of system_annotations_retention_days Remove the last bits of code after the backport PR (#76113) is merged. Followup to #76096 * unmute bwc tests Co-authored-by: Elastic Machine <[email protected]> Co-authored-by: Benjamin Trent <[email protected]>
In #75617 a new setting, system_annotations_retention_days, was
added to control how long system annotations are retained for.
We now feel that this setting is redundant and that system
annotations should be retained for the same period as results.
This is intuitive and defensible, as system annotations can be
considered a type of result.
Followup to #75617