Skip to content

Commit 0b9f3e9

Browse files
authored
[ML] fixing file structure finder multiline merge max for delimited formats (#56023)
This commit correctly sets the maxLinesPerRow in the CsvPreference for delimited files given the file structure finder settings. Previously, it was silently ignored.
1 parent b909cee commit 0b9f3e9

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

x-pack/plugin/ml/src/main/java/org/elasticsearch/xpack/ml/filestructurefinder/DelimitedFileStructureFinderFactory.java

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -71,7 +71,8 @@ public boolean canCreateFromSample(List<String> explanation, String sample, doub
7171
public FileStructureFinder createFromSample(List<String> explanation, String sample, String charsetName, Boolean hasByteOrderMarker,
7272
int lineMergeSizeLimit, FileStructureOverrides overrides, TimeoutChecker timeoutChecker)
7373
throws IOException {
74+
CsvPreference adjustedCsvPreference = new CsvPreference.Builder(csvPreference).maxLinesPerRow(lineMergeSizeLimit).build();
7475
return DelimitedFileStructureFinder.makeDelimitedFileStructureFinder(explanation, sample, charsetName, hasByteOrderMarker,
75-
csvPreference, trimFields, overrides, timeoutChecker);
76+
adjustedCsvPreference, trimFields, overrides, timeoutChecker);
7677
}
7778
}

0 commit comments

Comments
 (0)