Skip to content

[ML] Do not add runtime section to DFA dest index mappings unnecessarily #69329

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conversation

dimitris-athanasiou
Copy link
Contributor

Since config runtime mappings were added to data frame analytics jobs
in #69183, when we create the destination index we add a runtime
section in its mappings regardless of whether the job config contains
any runtime fields. This causes failures in the BWC tests when in a
mixed cluster where there are nodes versioned before runtime fields
were introduced.

This is the first part of the fix were we do not create a runtime section
in the destination index mappings unless necessary.

Since config runtime mappings were added to data frame analytics jobs
in  elastic#69183, when we create the destination index we add a `runtime`
section in its mappings regardless of whether the job config contains
any runtime fields. This causes failures in the BWC tests when in a
mixed cluster where there are nodes versioned before runtime fields
were introduced.

This is the first part of the fix were we do not create a `runtime` section
in the destination index mappings unless necessary.
@elasticmachine elasticmachine added the Team:ML Meta label for the ML team label Feb 22, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (Team:ML)

Copy link
Contributor

@przemekwitek przemekwitek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dimitris-athanasiou dimitris-athanasiou merged commit 914a85a into elastic:master Feb 22, 2021
@dimitris-athanasiou dimitris-athanasiou deleted the do-not-add-runtime-mappings-if-dfa-job-does-not-have-any branch February 22, 2021 11:49
dimitris-athanasiou added a commit to dimitris-athanasiou/elasticsearch that referenced this pull request Feb 22, 2021
…essarily (elastic#69329)

Since config runtime mappings were added to data frame analytics jobs
in  elastic#69183, when we create the destination index we add a `runtime`
section in its mappings regardless of whether the job config contains
any runtime fields. This causes failures in the BWC tests when in a
mixed cluster where there are nodes versioned before runtime fields
were introduced.

This is the first part of the fix were we do not create a `runtime` section
in the destination index mappings unless necessary.

Backport of elastic#69329
dimitris-athanasiou added a commit that referenced this pull request Feb 22, 2021
…essarily (#69329) (#69332)

Since config runtime mappings were added to data frame analytics jobs
in  #69183, when we create the destination index we add a `runtime`
section in its mappings regardless of whether the job config contains
any runtime fields. This causes failures in the BWC tests when in a
mixed cluster where there are nodes versioned before runtime fields
were introduced.

This is the first part of the fix were we do not create a `runtime` section
in the destination index mappings unless necessary.

Backport of #69329
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:ml Machine learning >non-issue Team:ML Meta label for the ML team v7.13.0 v8.0.0-alpha1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants