Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add cross region transfer support #155

Closed
igungor opened this issue Apr 13, 2020 · 2 comments · Fixed by #194
Closed

Add cross region transfer support #155

igungor opened this issue Apr 13, 2020 · 2 comments · Fixed by #194
Milestone

Comments

@igungor
Copy link
Member

igungor commented Apr 13, 2020

Currently s5cmd doesn't support cp/mv operations between different s3 buckets. We need a way to specify the source region via a flag.

awscli provides --source-region <value> flag to support this feature.

@TomGudman
Copy link

I believe I have the same problem. I am trying to move a bucket to a different region. Unfortunately, it seems s5cmd expects the source and destination buckets to be in the same region.

Example of copying from the us-west-2 to eu-west-1 (in the purpose of moving)

AWS_DEFAULT_REGION=us-west-2  s5cmd cp s3://source-us/* s3://destination-eu/
[..]
ERROR "cp s3://source-us/file1 s3://destination-us/file1": BucketRegionError: incorrect region, the bucket is not in 'us-west-2' region at endpoint '' status code: 301, request id: , host id:
[..]

I would suggest something similar to @igungor but what's best : --source-region or --destination-region?

In the mean time, I will revert to s4cmd, then s3cmd and finally awscli if it turns out to be that complicated to copy cross region ;-)

@igungor
Copy link
Member Author

igungor commented Jun 8, 2020

Though it doesn't matter that much whether if it's source-region or destination-region, I think the former is better since we have familiarity from awscli.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants