-
Notifications
You must be signed in to change notification settings - Fork 25.2k
Add Azure support for ranged read blob operations #54358
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Azure support for ranged read blob operations #54358
Conversation
Pinging @elastic/es-distributed (:Distributed/Snapshot/Restore) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM :)
@@ -128,7 +135,7 @@ private BlobContainer createBlobContainer(final int maxRetries) { | |||
final AzureStorageService service = new AzureStorageService(clientSettings.build()) { | |||
@Override | |||
RetryPolicyFactory createRetryPolicy(final AzureStorageSettings azureStorageSettings) { | |||
return new RetryExponentialRetry(1, 100, 500, azureStorageSettings.getMaxRetries()); | |||
return new RetryExponentialRetry(1, 10, 100, azureStorageSettings.getMaxRetries()); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why make this way more aggressive? I don't see the harm in doing so ... seems like we don't need these long timeout here, just wondering? :)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
While looking at this class I found them a bit high, specially when a high number of retries (5) is picked up so I lowered them. If that causes any issue on CI I'll restore the previous values.
...azure/src/test/java/org/elasticsearch/repositories/azure/AzureBlobContainerRetriesTests.java
Outdated
Show resolved
Hide resolved
@elasticmachine run elasticsearch-ci/2 |
@elasticmachine update branch |
@elasticmachine run elasticsearch-ci/1 (unrelated failure) |
Thanks a lot Armin! |
This pull request adds support for ranged read blob operations to the repository azure plugin. It adds the necessary plumbing down to the Azure SDK with additionnal unit tests and also adds a QA test for searchable snapshots.
Relates #50999