rclone: Google drive upload slow
What is your rclone version (eg output from
rclone -V) 1.30Which OS you are using and how many bits (eg Windows 7, 64 bit) Ubuntu 14.04
Which cloud storage system are you using? (eg Google Drive) Google drive
The command you were trying to run (eg
rclone copy /tmp remote:tmp) rclone sync
The drive upload is painfully slow. The original drive client upload is MUCH faster. I always get a 403 Rate Limit exceeded error. I try to upload about 1TB of data and this will last for the next month to get finished… Will it help to add a api key via the dev console and add client_id and client secret?
Thanks Dominic
About this issue
- Original URL
- State: closed
- Created 8 years ago
- Comments: 25 (8 by maintainers)
I’m going to write the conclusions of this up into the drive docs including instructions on how to make a drive developer’s account.
Starting today, Google Drive became so slow that every attempt to copy to Google Drive would fail, never getting past the stage of “building file list”, even if I set a large number of retries. It repeatedly produced rateLimitExceeded errors. Listing a directory at times was as slow as about one file per second.
So I set up my own client ID, and now things are working alright. A couple of weeks ago I was getting 25 MB/s uploads. I’m getting 1.3 MB/s uploads now, but that might be because I’m uploading a lot of small files at the moment.