Skip to content

[ML] Failures in ML tests in AutodetectMemoryLimitIT #42207

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
edsavage opened this issue May 19, 2019 · 2 comments · Fixed by #42279
Closed

[ML] Failures in ML tests in AutodetectMemoryLimitIT #42207

edsavage opened this issue May 19, 2019 · 2 comments · Fixed by #42279
Assignees
Labels
:ml Machine learning >test-mute Use for PR that only mute tests v7.2.0 v8.0.0-alpha1

Comments

@edsavage
Copy link
Contributor

edsavage commented May 19, 2019

Test failures in:

org.elasticsearch.xpack.ml.integration.AutodetectMemoryLimitIT testManyDistinctOverFields
org.elasticsearch.xpack.ml.integration.AutodetectMemoryLimitIT testTooManyByAndOverFields
org.elasticsearch.xpack.ml.integration.AutodetectMemoryLimitIT testTooManyByFields

are almost certainly due to a race condition in CI intake builds involving changes to the analytics in the backend coming into effect before corresponding changes to ES are ready and available to account for them.

Muting these three tests will give CI intake builds a chance to pass.

relates elastic/ml-cpp#486
relates #42086

@edsavage edsavage added 7x :ml Machine learning >test-mute Use for PR that only mute tests v7.2.0 v8.0.0 labels May 19, 2019
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core

@edsavage edsavage self-assigned this May 19, 2019
@edsavage
Copy link
Contributor Author

Specific details of the failing tests:

java.lang.AssertionError: 
Expected: a value less than <31500000L>
     but: <31762979L> was greater than <31500000L>
	at __randomizedtesting.SeedInfo.seed([73F117FB897DC1B:F9E345AC4D4DBBF6]:0)
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:18)
	at org.junit.Assert.assertThat(Assert.java:956)
	at org.junit.Assert.assertThat(Assert.java:923)
	at org.elasticsearch.xpack.ml.integration.AutodetectMemoryLimitIT.testTooManyByAndOverFields(AutodetectMemoryLimitIT.java:176)


java.lang.AssertionError: 
Expected: a value less than <116000000L>
     but: <116079823L> was greater than <116000000L>
	at __randomizedtesting.SeedInfo.seed([73F117FB897DC1B:B2E73A81DE2DCD9E]:0)
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:18)
	at org.junit.Assert.assertThat(Assert.java:956)
	at org.junit.Assert.assertThat(Assert.java:923)
	at org.elasticsearch.xpack.ml.integration.AutodetectMemoryLimitIT.testManyDistinctOverFields(AutodetectMemoryLimitIT.java:226)

java.lang.AssertionError: 
Expected: a value less than <31500000L>
     but: <32942560L> was greater than <31500000L>
	at __randomizedtesting.SeedInfo.seed([73F117FB897DC1B:96A746C3A04BEF2D]:0)
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:18)
	at org.junit.Assert.assertThat(Assert.java:956)
	at org.junit.Assert.assertThat(Assert.java:923)
	at org.elasticsearch.xpack.ml.integration.AutodetectMemoryLimitIT.testTooManyByFields(AutodetectMemoryLimitIT.java:127)

edsavage added a commit to edsavage/elasticsearch that referenced this issue May 21, 2019
Re-enable muted tests and accommodate recent backend changes
that result in higher memory usage being reported for a job
at the start of its life-cycle

Fixes elastic#42207
@droberts195 droberts195 removed the 7x label May 21, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:ml Machine learning >test-mute Use for PR that only mute tests v7.2.0 v8.0.0-alpha1
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants