Moving 23tb of data from AW3 bucket to Box error

General
1

Every time I try to start to copy I receive the following error

rclone view error API Call: ERROR for Sync with status OperationStatus.exception. Details: ClientException: Connection closed while receiving data, uri=http://127.0.0.1:5582/core/command

2

Thanks for reporting this, and sorry for the trouble.

We’ve logged it on our side and it’s being investigated. The message you’re seeing comes from the app losing its connection to the rclone engine while the command is still running, so what we’re checking is what happens to that engine process at the moment the sync starts on a dataset this large.

Two things that would help us:

  • Any application log from around the time it fails
  • Confirmation of the machine’s RAM (your other thread mentions “32mb”, which we assume is 32 GB)

We’ll come back to you here once we have a clearer picture.

3

I figured out the error and data is transferring between AWS and box, but I only get about 8-10 gigs synced every 24 hours.

The computer I am using for the transfer has the following

Windows server 2019 standard

32 GB of ram

I7 processor