rclone: [FTPS] transfer hangs

What is the problem you are having with rclone?

After upgrading rclone from v1.53.3 to 1.62.2, the FTP transfers from remote to local sometimes get stuck. By “stuck” I mean no additional data is transferred and process seems to continue running indefinitely. Usually killing the process/restarting the container works - subsequent try succeeds. Note so far I’ve only noticed this when transferring a directory containing multiple files, ie single file transfers have not reproduced the issue yet. To re-iterate, I never saw this issue prior to version upgrade in my year+ usage. After version bump the first reproduction happened within 24h. But service upgrade also updated Alpine from 3.14 to 3.18, so I can’t confidently say it’s 100% related to rclone alone.

What is your rclone version (output from rclone version)

rclone v1.62.2-DEV
- os/version: alpine 3.18.0 (64 bit)
- os/kernel: 5.19.17-Unraid (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.20.4
- go/linking: static
- go/tags: none

Which OS you are using and how many bits (e.g. Windows 7, 64 bit)

64 bit alpine 3.18 running in Docker container; rclone pkg installed from community repo

Which cloud storage system are you using? (e.g. Google Drive)

FTPS. cloud provider host is shared among multiple customers.

rclone.conf

[remote]
type = ftp
host = remote.server.com
user = laur89
port = 21
pass = redacted
tls = false
explicit_tls = true
no_check_certificate = true
disable_tls13 = true

The command you were trying to run (e.g. rclone copy /tmp remote:tmp)

Note we’re running rclone locally, ie we’re pulling data from remote.

"rclone" "copy" "--log-file" "/config/logs/rclone-copy.log" "-vv" "--dump" "bodies" "--config" "/config/rclone.conf"
    "--fast-list" "--bwlimit" "20M" "--use-mmap" "--transfers" "10" "-L"
    "--filter" "- **/{S,s}ample/**" "remote:files/complete" "/data/rclone-tmp"
    "--filter" "+ /Filename\\.S02E08\\.HDR\\.2160p\\.WEB\\.H265-SCENE/**" "--filter" "- *"

Transferred directory as seen on remote

$ ls -lAtr  Filename.S02E08.HDR.2160p.WEB.H265-SCENE/
total 5.5G
drwxr-xr-x 2 laur89 laur89 4.0K May 19 06:31 Sample
-rw-r--r-- 1 laur89 laur89  600 May 19 06:31 filename.s02e08.hdr.2160p.web.h265-scene.sfv
-rw-r--r-- 1 laur89 laur89  621 May 19 06:31 filename.s02e08.hdr.2160p.web.h265-scene.nfo
-rw-r--r-- 1 laur89 laur89 573M May 19 06:31 filename.s02e08.hdr.2160p.web.h265-scene.r02
-rw-r--r-- 1 laur89 laur89 573M May 19 06:31 filename.s02e08.hdr.2160p.web.h265-scene.r04
-rw-r--r-- 1 laur89 laur89 573M May 19 06:31 filename.s02e08.hdr.2160p.web.h265-scene.r03
-rw-r--r-- 1 laur89 laur89 573M May 19 06:31 filename.s02e08.hdr.2160p.web.h265-scene.r06
-rw-r--r-- 1 laur89 laur89 383M May 19 06:31 filename.s02e08.hdr.2160p.web.h265-scene.r08
-rw-r--r-- 1 laur89 laur89 573M May 19 06:31 filename.s02e08.hdr.2160p.web.h265-scene.rar
-rw-r--r-- 1 laur89 laur89 573M May 19 06:31 filename.s02e08.hdr.2160p.web.h265-scene.r05
-rw-r--r-- 1 laur89 laur89 573M May 19 06:31 filename.s02e08.hdr.2160p.web.h265-scene.r01
-rw-r--r-- 1 laur89 laur89 573M May 19 06:31 filename.s02e08.hdr.2160p.web.h265-scene.r07
-rw-r--r-- 1 laur89 laur89 573M May 19 06:31 filename.s02e08.hdr.2160p.web.h265-scene.r00

Transferred directory as seen locally (in /data/rclone-tmp) at the time of termination

$ ls -lAtr  Filename.S02E08.HDR.2160p.WEB.H265-SCENE/
total 4.9G
-rw-r--r-- 1 laur users   0 May 22 12:20 filename.s02e08.hdr.2160p.web.h265-scene.r06
-rw-r--r-- 1 laur users   0 May 22 12:20 filename.s02e08.hdr.2160p.web.h265-scene.r05
-rw-r--r-- 1 laur users   0 May 22 12:20 filename.s02e08.hdr.2160p.web.h265-scene.r01
-rw-r--r-- 1 laur users   0 May 22 12:20 filename.s02e08.hdr.2160p.web.h265-scene.r08
-rw-r--r-- 1 laur users   0 May 22 12:20 filename.s02e08.hdr.2160p.web.h265-scene.r04
-rw-r--r-- 1 laur users   0 May 22 12:20 filename.s02e08.hdr.2160p.web.h265-scene.r03
-rw-r--r-- 1 laur users   0 May 22 12:20 filename.s02e08.hdr.2160p.web.h265-scene.r02
-rw-r--r-- 1 laur users   0 May 22 12:20 filename.s02e08.hdr.2160p.web.h265-scene.r00
-rw-r--r-- 1 laur users   0 May 22 12:20 filename.s02e08.hdr.2160p.web.h265-scene.r07
-rw-r--r-- 1 laur users 621 May 22 12:20 filename.s02e08.hdr.2160p.web.h265-scene.nfo

A log from the command with the -vv flag (e.g. output from rclone -vv copy /tmp remote:tmp)

See gist

How to use GitHub

• Please use the 👍 reaction to show that you are affected by the same issue.
• Please don’t comment if you have no relevant information to add. It’s just extra noise for everyone subscribed to this issue.
• Subscribe to receive notifications on status change and new comments.