Skip to content

Persistent EOF errors when trying to sync directory #3

@isabanin

Description

@isabanin

Hey,

We are using s3sync extensively to sync thousands of Subversion and Git repositories to S3. Most of the time it works just great, but recently I had this very strange case when s3sync would fail to sync one specific Subversion repository. I ran s3sync with debugging enabled and noticed this:

s3TreeRecurse xxx xxx /db/revprops/102/
Trying command list_bucket xxx prefix xxx/xxx/db/revprops/102/ max-keys 200 delimiter / with 100 retries left
EOF error: end of file reached
No result available
99 retries left, sleeping for 30 seconds

It would go through all 100 retires, throw the same EOF error every time and then exit. Every time I run it it fails on a different directory inside "db/revprops". This directory contains around 12,000 files.

Any ideas?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions