Skip to content

Allow AWS compatible cloud services #91

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
krzaczek opened this issue Jun 10, 2014 · 3 comments
Closed

Allow AWS compatible cloud services #91

krzaczek opened this issue Jun 10, 2014 · 3 comments
Assignees
Milestone

Comments

@krzaczek
Copy link

Hi,

Could You add the config option to change aws s3 base url so it can be used to interact with s3/ec2 api compatible services like http://e24cloud.com/ which offers a compatible api .. and for me is a lot faster (s3 upload/download) because it's closer then AWS node in Ireland.

repositories:
    s3:
        base_url: https://e24files.com

or

$ curl -XPUT 'http://localhost:9200/_snapshot/my_s3_repository' -d '{
    "type": "s3",
    "settings": {
        "bucket": "my_bucket_name",
        "base_url": "https://e24files.com"
    }
}'

And then if it is present just pass it to aws sdk
http://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/services/s3/AmazonS3.html#setEndpoint(java.lang.String)

@krzaczek krzaczek changed the title Allow AWS compatibile cloud services Allow AWS compatible cloud services Jun 10, 2014
@dadoonet dadoonet added this to the 2.2.0 milestone Jun 19, 2014
@dadoonet dadoonet self-assigned this Jun 19, 2014
@dadoonet
Copy link
Member

Actually, there is a non documented settings s3.endpoint.
See https://github.com/elasticsearch/elasticsearch-cloud-aws/blob/es-1.2/src/main/java/org/elasticsearch/cloud/aws/AwsS3Service.java#L134-134

Could this work for you?

If so, may be it's only a matter of documentation. If this works for you, do you want to send a PR about it for updating the README?

Best

@dadoonet dadoonet added doc and removed new labels Jun 19, 2014
@krzaczek
Copy link
Author

Hi,

It works by adding this to elasticsearch.yml

cloud.aws.s3.endpoint: e24files.com

I will prepare a change in documentation and send a PR next week. Thx for the help.

Best regards,
Pawel

dadoonet added a commit that referenced this issue Jun 20, 2014
Users can use their own endpoints for any ec2/s3 compatible API using: `cloud.aws.ec2.endpoint` or `cloud.aws.s3.endpoint`

Closes #91.
dadoonet added a commit that referenced this issue Jun 20, 2014
Users can use their own endpoints for any ec2/s3 compatible API using: `cloud.aws.ec2.endpoint` or `cloud.aws.s3.endpoint`

Closes #91.
(cherry picked from commit f0fbea5)
@dadoonet
Copy link
Member

Thanks @krzaczek. I just added to the doc as I'll probably release the plugin in some hours.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants