rclone: Problem with encrypting certain unicode characters

What is the problem you are having with rclone?

I was upgrading from 1.49.5 to 1.50.2 and Rclone suddenly wanted to reupload multiple files it shouldn’t. So after checking i found out that Rclone 1.50.2 does not like these filenames

1 a?a.zip 2 aaa? ? 01-04(a・a).zip 3 aaaaaa* aaaa.zip

It changes * to * and ?to ? This is only an issue with the upload since data uploaded with 1.49.5 can be read just fine on another machine running 1.50.2 but data uploaded with 1.50.2 gets incorrect filenames

Uploaded using 1.49.5 and read using 1.50.2 (or 1.49.5 since it is the same) (mounted): Upload 1 49 5 read on 1 50 2 Uploaded using 1.50.2 and read using 1.50.2 (mounted): Upload 1 50 2 read on 1 50 2

Rclonebrowser shows it like this. TEST is uploaded using 1.49.5. TEST2 is uploaded using 1.50.2. Both were read using 1.50.2 image

What is your rclone version (output from rclone version)

rclone v1.49.5

  • os/arch: windows/amd64
  • go version: go1.12.10

Tested on 1.50.2 stable and latest beta (see below) rclone v1.50.2-094-g207474ab-beta

  • os/arch: windows/amd64
  • go version: go1.13.5

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Windows 10 1909 x64

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

“C:\rclone\rclone.exe” “sync” “–bwlimit” “3M” “–delete-after” “–delete-excluded” “–exclude-from” “C:/rclone/Configs/Exclusions.txt” “–progress” “–log-file” “C:\Users\Monkey\Desktop\MirrorD Log\Rclone TEST 2019-12-31 24203.log” “–log-level” “DEBUG” “E:/Rclone test/” “cryptGDrive:TEST”

A log from the command with the -vv flag (eg output from rclone -vv copy /tmp remote:tmp)

Rclone 1.49.5 TEST 2019-12-31 24203.log.txt Rclone 1.50.2 TEST 2019-12-31 24205.log.txt

Sidenote

The output console is also showing issues again with unicode characters (japanese in this case). This was fixed here https://github.com/rclone/rclone/issues/2501 and worked fine until 1.49.5. Should i create a separate issue for that or is the above related? Output console issue

About this issue

  • Original URL
  • State: closed
  • Created 5 years ago
  • Comments: 17 (8 by maintainers)

Commits related to this issue

Most upvoted comments

In this case i have local windows filenames that have * that are uploaded as *. So it does it the incorrect way –track-renames does not work with crypt

I only upload files from local to gdrive. So rclone should grab the filenames as-is. My local windows filesystem already handles the character restrictions