Skip to content

Add exclude_keys option to KV processor #23856

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
andrewkroh opened this issue Mar 31, 2017 · 2 comments
Closed

Add exclude_keys option to KV processor #23856

andrewkroh opened this issue Mar 31, 2017 · 2 comments
Labels
:Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP >enhancement v5.5.0 v6.0.0-beta1

Comments

@andrewkroh
Copy link
Member

It would be nice to have an exclude_keys configuration option for the key-value processor in Ingest Node. exclude_keys would specify a list of keys that are not included in the final document even if they are present in the raw data parsed by the processor. There is already an include_keys filter.

The kv filter in Logstash has this option.

I want to use this to prevent certain keys from being overwritten by dynamic data coming from the KV processor.
@andrewkroh andrewkroh added :Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP >enhancement labels Mar 31, 2017
@andrewkroh andrewkroh mentioned this issue Mar 31, 2017
Merged
@javanna
Copy link
Member

javanna commented Apr 18, 2017

@talevy what do you think?

@talevy
Copy link
Contributor

talevy commented Apr 18, 2017

this makes sense, I'll get to it soon!

@talevy talevy mentioned this issue May 24, 2017
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
:Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP >enhancement v5.5.0 v6.0.0-beta1
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@clintongormley @colings86 @talevy @javanna @andrewkroh