Skip to content

Always use one shard in vector REST tests. #51643

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jan 29, 2020

Conversation

jtibshirani
Copy link
Contributor

@jtibshirani jtibshirani commented Jan 29, 2020

This PR tries to address the intermittent vector test failures on 7.x by making
sure we create indices with one shard.

The fix is based on this theory as to what's happening:

  • On 7.x, the default number of shards is 1, but in REST tests we randomly use
    2 in order to cover the multiple shards case. In the failing test run, we use 2
    shards and all documents end up on only one shard.
  • During a search, the response from the empty shard doesn't produce
    deprecation warnings because we never try to execute the script. If not all
    shard responses contain the warning headers, then certain deprecation warnings
    can be lost (due to the bug described in Response headers missing from search response  #33936).

Addresses #50716.
Relates to #50061.

@jtibshirani jtibshirani added >test Issues or PRs that are addressing/adding tests :Search/Search Search-related issues that do not fall into other categories v7.6.1 v7.5.3 labels Jan 29, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-search (:Search/Search)

Copy link
Contributor

@mayya-sharipova mayya-sharipova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @jtibshirani.
Do we also want to have this PR for 7.7?

@jtibshirani
Copy link
Contributor Author

Thanks for pointing that out, I hadn't realized we cut the branch yet.

@jtibshirani jtibshirani merged commit 9dcc3ef into elastic:7.x Jan 29, 2020
@jtibshirani jtibshirani deleted the vector-test-warnings branch January 29, 2020 20:24
jtibshirani added a commit that referenced this pull request Jan 29, 2020
This PR tries to address the intermittent vector test failures on 7.x by making
sure we create indices with one shard.

The fix is based on this theory as to what's happening:
* On 7.x, the default number of shards is 1, but in REST tests we randomly use
2 in order to cover the multiple shards case. In the failing test run, we use 2
shards and all documents end up on only one shard.
* During a search, the response from the empty shard doesn't produce
deprecation warnings because  we never try to execute the script. If not all
shard responses contain the warning headers, then certain deprecation warnings
can be lost (due to the bug described in #33936).

Addresses #50716.
Relates to #50061.
jtibshirani added a commit that referenced this pull request Jan 29, 2020
This PR tries to address the intermittent vector test failures on 7.x by making
sure we create indices with one shard.

The fix is based on this theory as to what's happening:
* On 7.x, the default number of shards is 1, but in REST tests we randomly use
2 in order to cover the multiple shards case. In the failing test run, we use 2
shards and all documents end up on only one shard.
* During a search, the response from the empty shard doesn't produce
deprecation warnings because  we never try to execute the script. If not all
shard responses contain the warning headers, then certain deprecation warnings
can be lost (due to the bug described in #33936).

Addresses #50716.
Relates to #50061.
@polyfractal polyfractal added v7.6.0 and removed v7.6.1 labels Feb 7, 2020
@jtibshirani jtibshirani added :Search Relevance/Vectors Vector search and removed :Search/Search Search-related issues that do not fall into other categories labels Jul 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Search Relevance/Vectors Vector search >test Issues or PRs that are addressing/adding tests v7.5.3 v7.6.0 v7.7.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants