Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Copy from Snowball Edge to local only copies 1000 files #405

Closed
dmbyte opened this issue Feb 2, 2022 · 6 comments
Closed

Copy from Snowball Edge to local only copies 1000 files #405

dmbyte opened this issue Feb 2, 2022 · 6 comments

Comments

@dmbyte
Copy link

dmbyte commented Feb 2, 2022

When performing a copy from an AWS Snowball Edge appliance to local, only 1000 files are copied.

@dmbyte
Copy link
Author

dmbyte commented Feb 2, 2022

Can you add a command line option to disable the use of the v2 list command (as I suspect that is what it is)

@dmbyte
Copy link
Author

dmbyte commented Feb 3, 2022

I've verified via my fork that forcing it back to the same command as the googleapi endpoint causes the copy and list to work. I can read the code generally, but don't understand it enough to contribute the creation of a command line option to disable the flag.

@tianshiz
Copy link

does this happen when you copy from local to the snowball? Does it affect sync as well?

@sonmezonur
Copy link
Member

sonmezonur commented Apr 5, 2022

@dmbyte Could you please try with --use-v1-api flag. If this solves your issue, let us know.

@dmbyte
Copy link
Author

dmbyte commented Apr 5, 2022

Given that @greenpau developed this based on my request and a quick build I had made to eliminate the ListObjectV2 path, I am pretty certain it will work, but will verify as soon as possible.

@igungor
Copy link
Member

igungor commented Apr 6, 2022

Should be fixed by #407

Note that we've changed the flag to --use-list-objects-v1.

Please re-open the issue if your problem is not fixed by the above change.

@igungor igungor closed this as completed Apr 6, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants