8000 s3p sync command keep copying existing files · Issue #68 · generalui/s3p · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

s3p sync command keep copying existing files #68

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
jurampark-pala opened this issue Oct 15, 2022 · 1 comment
Open

s3p sync command keep copying existing files #68

jurampark-pala opened this issue Oct 15, 2022 · 1 comment
Labels
bug Something isn't working question Further information is requested

Comments

@jurampark-pala
Copy link

Hi all, I got something weird result when I ran the command below.

$npx s3p sync --bucket {from-bucket} --to-bucket {to-bucket} --prefix something/43d2csVAS3 --to-key "js:(key) => key.toLowerCase()"

Source bucket has the 100 files and when I first ran the command, it successfully copied files 100 files. However, when I ran the SAME command again, it copied 14 files again. Same happened if I ran the command again and again.

Not sure it could be helpful but let me paste some of logs after command.

parsed-command-line:
  command: sync, options:
    bucket:   from-bucket
    toBucket: to-bucket
    prefix:   project/43d2csVAS3/
    toKey:    (key) => key.toLowerCase()
    verbose:  true

s3p: d: 1s 119ms, items: 0, items/s: 0, listRequests: 2, listWorkers: 1, copied 0/0 0_B/0_B 0_B/s inFlight: 0_B copyWorkers: 0 + 0 same: 0(0_B) toDelete: 0(0_B)
s3p: d: 2s 119ms, items: 0, items/s: 0, listRequests: 2, listWorkers: 4, copied 0/0 0_B/0_B 0_B/s inFlight: 0_B copyWorkers: 0 + 0 same: 0(0_B) toDelete: 0(0_B)
aws s3 rm s3://to-bucket/project/43d2csVAS3/cover.png # you must do this. size: 628.35kB
aws s3 rm s3://to-bucket/project/43d2csVAS3/cover.png.preview # you must do this. size: 41.70kB
aws s3 rm s3://to-bucket/project/43d2csVAS3/cover.png.preview.dot # you must do this. size: 91_B
aws s3 rm s3://to-bucket/project/43d2csVAS3/cover.png.preview.large # you must do this. size: 148.34kB
aws s3 rm s3://to-bucket/project/43d2csVAS3/cover.png.preview.medium # you must do this. size: 41.70kB
aws s3 rm s3://to-bucket/project/43d2csVAS3/cover.png.preview.small # you must do this. size: 12.06kB
aws s3 rm s3://to-bucket/project/43d2csVAS3/cover.png.preview.tiny # you must do this. size: 3.71kB
aws s3 rm s3://to-bucket/project/43d2csVAS3/logo.png # you must do this. size: 49.68kB
aws s3 rm s3://to-bucket/project/43d2csVAS3/logo.png.preview # you must do this. size: 5.52kB
aws s3 rm s3://to-bucket/project/43d2csVAS3/logo.png.preview.dot # you must do this. size: 268_B
aws s3 rm s3://to-bucket/project/43d2csVAS3/logo.png.preview.large # you must do this. size: 12.39kB
aws s3 rm s3://to-bucket/project/43d2csVAS3/logo.png.preview.medium # you must do this. size: 5.52kB
aws s3 rm s3://to-bucket/project/43d2csVAS3/logo.png.preview.small # you must do this. size: 2.42kB
aws s3 rm s3://to-bucket/project/43d2csVAS3/logo.png.preview.tiny # you must do this. size: 1.20kB

Thanks in advance, please save me!
@shanebdavis
Copy link
Member

Sounds like a legit bug. Does it work if you remove the --to-key option?

@shanebdavis shanebdavis added question Further information is requested bug Something isn't working labels Dec 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@shanebdavis @jurampark-pala
0