rclone: dropbox: Unable to decrypt returned paths from changeNotify

What is the problem you are having with rclone?

As soon as many files are tried to be read at the same time, the “too_many_requests/…: Too many requests or write operations. Trying again in 300 seconds.” error occurs. From that point on, no further log entries appear and the mount seems to have hung up. Neither a timeout nor any other attribute helps. Only a restart of the service solves the problem.

An attempt at ‘df -h’ or an ‘ls’ freezes completely.

With my Google Drive mount, the problem does not occur. I get i/o errors sometimes but it does not freeze.

What is your rclone version (output from rclone version)

rclone v1.54.1

Which OS you are using and how many bits (e.g. Windows 7, 64 bit)

Ubuntu 18.04

Which cloud storage system are you using? (e.g. Google Drive)

Dropbox

The command you were trying to run (e.g. rclone copy /tmp remote:tmp)

/usr/bin/rclone mount \
  --user-agent='Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.131 Safari/537.36' \
  --config=/home/admin/.config/rclone/rclone.conf \
  --allow-other \
  --allow-non-empty \
  --rc \
  --rc-addr=localhost:5572 \
  --fast-list \
  --vfs-read-chunk-size=64M \
  --vfs-read-chunk-size-limit=2048M \
  --buffer-size=64M \
  --dir-cache-time=1h \
  --timeout=1m \
  --attr-timeout=10m \
  --dropbox-chunk-size=64M \
  --umask=002 \
  --syslog \
  -vvv \
  dropbox: /mnt/remote

About this issue

  • Original URL
  • State: closed
  • Created 3 years ago
  • Comments: 38 (21 by maintainers)

Commits related to this issue

Most upvoted comments

I think I’ve managed to fix this problem - can you give this a try?

v1.56.0-beta.5412.bba3e3e4f.fix-5165-dropbox-changenotify on branch fix-5165-dropbox-changenotify (uploaded in 15-30 mins)

@dennisoderwald wrote

That would solve the problem with polling but probably not that it freezes at a rate limit?

This should affect the “unable to decrypt returned paths” problem.

See https://github.com/rclone/rclone/issues/5156 too many requests problem - there is a binary to try there too.

I’ll look into this shortly.

Hoping this is the reason my polling has never worked! @wolveix thanks for fixing this!

On the forum PatriotM noted:

it looks like it can’t find the file path because 2 characters are cut off at the beginning cutted

Check the link for an image and more explanation.

This looks like it might be the cause of the problem @wolveix

Huh, I’m not sure how I could’ve missed that, and I’m not sure why it still seems to work in my use case.

Nevertheless, I will look into this today and hopefully resolve the issue.

@dennisoderwald do you happen to be using this with cloudbox? I’ve been trying for weeks to get polling to work. Does not seem to work on encrypted or unencrypted dropbox remotes.

No, outside of cloudbox. However, this has nothing to do with cloudbox, so the issue.

Thanks. Yeah, I’ve noticed the same behaviour a couple of times. It does eventually resolve itself in my experience, but it’s not ideal and I’d like to gain a better understanding as to why it’s happening. I don’t believe it’s an issue strictly with the polling implementation, but I can’t say for sure. I’ll continue reviewing this prior to committing the potential fix for the decryption issue, but it’d be great if @ncw could find the time to also review this.

Working on a fix now. I believe I’ve resolved the decryption issue, but I’m unsure about the original issue described in this request.

I’ll look into this shortly.

@wolveix Have you had time to look at it? 😃

Sorry for the wait, been a busy week. I’ll make sure to review this tomorrow 😃