Skip to content

add ignore_missing option to convert,trim,lowercase,uppercase,grok,rename #20194

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Sep 9, 2016

Conversation

talevy
Copy link
Contributor

@talevy talevy commented Aug 27, 2016

Adds an ignore_missing option for the Convert processor that will enable suppression of exceptions surrounding non-existant fields and null-valued fields.

in response to: #19995

updated to include

  • trim
  • convert
  • uppercase
  • lowercase
  • grok
  • rename

TODO:

  • update documentation
  • figure out alternative to assertIngestDocument since it is not available to the ingest-common module

@talevy talevy added >enhancement review :Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP v5.0.0-beta1 labels Aug 27, 2016
@talevy talevy changed the title add ignore_missing option to ConvertProcessor add ignore_missing option to convert,trim,lowercase,uppercase,grok Sep 7, 2016
@@ -81,6 +96,10 @@ public Grok getGrok() {
return grok;
}

public boolean isIgnoreMissing() {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the isIgnoreMissing getters are only used in tests, right? So then it can be package protected?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

++ I'll update them

@talevy
Copy link
Contributor Author

talevy commented Sep 9, 2016

@martijnvg mind taking another look at this?

@talevy talevy changed the title add ignore_missing option to convert,trim,lowercase,uppercase,grok add ignore_missing option to convert,trim,lowercase,uppercase,grok,rename Sep 9, 2016
/**
*/
public class IngestDocumentMatcher {
public static void assertIngestDocument(Object a, Object b) {
Copy link
Member

@martijnvg martijnvg Sep 9, 2016

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same note as in the json processor PR.

@martijnvg
Copy link
Member

Small note, LGTM otherwise.

@talevy talevy force-pushed the ignore-missing branch 3 times, most recently from f1aaf79 to 94710fc Compare September 9, 2016 17:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP >enhancement v5.0.0-beta1 v6.0.0-alpha1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants