Adding additional wait to avoid eventual consistency issues #6006
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Motivation and Context
The Kinesis stability test is failing often with the following error:
This is despite the fact we are using a waiter that is supposed to verify that the stream is active before operating on it.
Adding logs reveals an eventual consistency issue with Kinesis where the stream state has no propagated server side and causes this exception:
@joviegas has run in the same problem with the KinesisintegTest, so I borrowed his solution and it seems to have fixed the problem. #5949
Testing
Running this test with a
@RepeatedTest(20)
and observed a 25% failure rate. After adding the additional waiting I see a 0% failure rate.