rclone: Dropbox: insufficient_space not a fatal error
The associated forum post URL from https://forum.rclone.org
What is the problem you are having with rclone?
Rclone doenst stop uploading when there is insufficient storage space on dropbox. (Hard fail)
What is your rclone version (output from rclone version
)
root@Unraid-Server:~# rclone version rclone v1.64.0
- os/version: slackware 15.0+ (64 bit)
- os/kernel: 6.1.49-Unraid (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.21.1
- go/linking: static
- go/tags: none
Which OS you are using and how many bits (e.g. Windows 7, 64 bit)
- os/version: slackware 15.0+ (64 bit)
- os/kernel: 6.1.49-Unraid (x86_64)
Which cloud storage system are you using? (e.g. Google Drive)
Dropbox
The command you were trying to run (e.g. rclone copy /tmp remote:tmp
)
rclone move --rc --rc-addr=192.168.0.110:4000 --delete-empty-src-dirs --bwlimit 30M:off --rc-user=XXX–rc-pass=XXX /mnt/user/XXX/XXX XXX:XXX -vv --drive-chunk-size 256M --checkers 1 --fast-list --transfers 2 --exclude .unionfs/** --exclude fuse_hidden --exclude XXX.XXX --exclude _HIDDEN --exclude .recycle --exclude .backup~ --exclude .partial~ --fast-list --tpslimit 6 --tpslimit-burst 8 --dropbox-pacer-min-sleep 60ms --min-age 7d
A log from the command with the -vv
flag (e.g. output from rclone -vv copy /tmp remote:tmp
)
2023/09/23 20:39:56 ERROR : Dropbox root ‘XXX/is7npm4pf8tr0c9otsuca7omdo’: sync batch commit: failed to commit batch length 1: batch had 1 errors: last error: path/insufficient_space 2023/09/23 20:39:56 ERROR : XXX/XXX: Failed to copy: upload failed: batch upload failed: path/insufficient_space 2023/09/23 20:39:56 ERROR : XXX/XXX: Not deleting source as copy failed: upload failed: batch upload failed: path/insufficient_space 2023/09/23 20:39:57 DEBUG : 86q7hc82rp7ncos682ceq9c0lf9ad7ogua9ctjl11aoisde5ucm1lae58jen4vd66ks28coho4qe0/0k94k1lv8fpl9g16eueadml1dj2c2fjfe242jj7r1fbpldsq3ml2inv7js2d6412bvi2b7t3ql9oi: Uploading chunk 1/480
So it notices the insufficient storage, but still keep going (since hours). It should just hard fail, it doesnt make any sense. Ive found this thread https://forum.rclone.org/t/why-does-a-file-transfer-continue-when-there-is-no-available-storage/13677 where a dev said it should be fixed, but it seems like that is no longer the case.
How to use GitHub
- Please use the 👍 reaction to show that you are affected by the same issue.
- Please don’t comment if you have no relevant information to add. It’s just extra noise for everyone subscribed to this issue.
- Subscribe to receive notifications on status change and new comments.
About this issue
- Original URL
- State: open
- Created 9 months ago
- Reactions: 1
- Comments: 36 (8 by maintainers)
Commits related to this issue
- dropbox: fix return status when full to be fatal error This will stop the sync, but won't stop a mount. Fixes #7334 — committed to rclone/rclone by ncw 9 months ago
- dropbox: fix return status when full to be fatal error This will stop the sync, but won't stop a mount. Fixes #7334 — committed to rclone/rclone by ncw 9 months ago
- dropbox: fix return status when full to be fatal error This will stop the sync, but won't stop a mount. Fixes #7334 — committed to rclone/rclone by ncw 9 months ago
- dropbox: fix return status when full to be fatal error This will stop the sync, but won't stop a mount. Fixes #7334 — committed to rclone/rclone by ncw 9 months ago
OK third time lucky! Parsing the errors from the dropbox SDK is very hard 😦
If that doesn’t work, please send logs as before - they are very useful.
v1.65.0-beta.7451.f2d08250c.fix-7334-dropbox-full on branch fix-7334-dropbox-full (uploaded in 15-30 mins)
Please give this a test
v1.65.0-beta.7390.10490bfd0.fix-7334-dropbox-full on branch fix-7334-dropbox-full (uploaded in 15-30 mins)
This change did get merged in 4b9da601be9422382aaa41c08d6b7eb601c95658
What it does is stop that file being retried. It doesn’t stop the next file being retried though!
We could upgrade that error to a Fatal error which will stop the sync immediately.
I guess since we have a very clear signal from dropbox that the disk is full we should do that.
What do you think @animosity22 and @eihns ?