-
Notifications
You must be signed in to change notification settings - Fork 25.2k
add copy ingest processor #56985
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
add copy ingest processor #56985
Conversation
Pinging @elastic/es-core-features (:Core/Features/Ingest) |
@gaobinlong, thank you for this contribution. It's useful functionality that we would like to incorporate into ingest pipelines. We are reconsidering how we've organized the processors and are trying to determine whether this fits best as part of the existing set processor or as its own separate processor. If you'll bear with us while we consider that, we will let you know and then work to get this PR refactored if necessary and then merged. |
@danhermann, I have tried to use |
@gaobinlong, apologies for the delay on this one. We decided that this is how the |
@danhermann, I'm glad to continue doing that and will refractor the code soon. |
@danhermann , I have refactored the code and opened a new PR #63540, this PR can be closed lately. |
Relates to #55682 and #51046.
The main point of this PR is adding a copy ingest processor which can copy the value of one field to another and even the top level of the document. The supported data types which can be copied are
boolean
,number
,array
,object
,string
,date
.