cloudflared: Cloudflare Tunnel randomly stops serving traffic
Cloudflare tunnel randomly not working The daemon is still running but no traffic reaches it… restarting the daemon fixes it for a while, but then it happens again. No pattern observed, just randomly stops working
Environment and versions
- OS: Ubuntu Server 20.04
- Architecture: AMD64
- Version: 2022.7.1
- Running as a systemd service
Logs and errors
Jul 17 12:08:33 phoenix cloudflared[470354]: 2022-07-17T06:38:33Z ERR error="Incoming request ended abruptly: context canceled" cfRay=>
Jul 17 12:08:33 phoenix cloudflared[470354]: 2022-07-17T06:38:33Z ERR error="Incoming request ended abruptly: context canceled" cfRay=>
Jul 17 12:08:34 phoenix cloudflared[470354]: 2022-07-17T06:38:34Z ERR error="Incoming request ended abruptly: context canceled" cfRay=>
Jul 17 12:08:34 phoenix cloudflared[470354]: 2022-07-17T06:38:34Z ERR error="Incoming request ended abruptly: context canceled" cfRay=>
Jul 17 12:08:34 phoenix cloudflared[470354]: 2022-07-17T06:38:34Z ERR error="Incoming request ended abruptly: context canceled" cfRay=>
Jul 17 12:08:34 phoenix cloudflared[470354]: 2022-07-17T06:38:34Z ERR error="Incoming request ended abruptly: context canceled" cfRay=>
Jul 17 12:08:35 phoenix cloudflared[470354]: 2022-07-17T06:38:35Z ERR error="Incoming request ended abruptly: context canceled" cfRay=>
Jul 17 12:08:35 phoenix cloudflared[470354]: 2022-07-17T06:38:35Z ERR error="Incoming request ended abruptly: context canceled" cfRay=>
Jul 17 12:08:36 phoenix cloudflared[470354]: 2022-07-17T06:38:36Z ERR error="Incoming request ended abruptly: context canceled" cfRay=>
Jul 17 12:08:36 phoenix cloudflared[470354]: 2022-07-17T06:38:36Z ERR error="Incoming request ended abruptly: context canceled" cfRay=>
Jul 17 12:08:36 phoenix cloudflared[470354]: 2022-07-17T06:38:36Z ERR error="Incoming request ended abruptly: context canceled" cfRay=>
Jul 17 12:08:36 phoenix cloudflared[470354]: 2022-07-17T06:38:36Z ERR error="Incoming request ended abruptly: context canceled" cfRay=>
Jul 17 12:08:36 phoenix cloudflared[470354]: 2022-07-17T06:38:36Z ERR error="Incoming request ended abruptly: context canceled" cfRay=>
Its showing this error, but it used to show some TCP connect error for the URL inside LAN
Additional context
I am using the --protocol http2 flag because quic doesn’t work
host: mirror.albony.xyz
cloudflare email: albonycal@gmail.com
About this issue
- Original URL
- State: closed
- Created 2 years ago
- Reactions: 1
- Comments: 53 (38 by maintainers)
I have two servers located in North Carolina and Germany. I encountered the same issue using Debian 11 and the latest version of Cloudflared (2023.5.0). With the same configuration, the server in Germany can establish a gRPC connection using “–protocol quic”, but the server in North Carolina doesn’t work and requires “–protocol http2” or “h2mux” to function. I’ve tried switching tunnel versions (–edge-ip-version 6/4), but it didn’t help.
@cynorfleet You’re right. In my case, the server in Germany proxies traffic from localhost:1234, while the server in North Carolina proxies traffic from 10.0.0.100:1234 instead of localhost. I believe this could be a bug.
I am going to raise my hand and say we have been very frustrated by this and a litany of issues with the tunnel recently. We were seeing requests truncated (return 200), but have no body, causing P1 downstream issues since standard retry logic wasn’t activated. We saw issues under
2022.4.1and2022.8.2@tomhuang12 is working with support under ticket 2535568 – but please let us know what we can do to support. We would like to see this stabilized ASAP.
This happens when cloudflared and its requested service are running on different nodes
ok. Since this thread has already several sub-threads and problems/solutions, I am going to close it for now. Feel free to re-open, or better yet, open a new one so we don’t lose the focus on the specific problem.
Again thanks for the reports and help.
I think I know what caused my issues : I have two machines on different networks (my local server and my VPS) and they both had cloudflared on them configured on the same tunnel, I removed the VPS from that and now it works like a charm.
This still happens 😦
Hi @Albonycal ,
We did some improvements, but looking at this issue, I don’t know if they are related to the particular one you mention here.
Looking at the logs, as @sudarshan-reddy mentioned, it just seems that eyeball left before the request finished. We are doing a release next week, let’s see if any of the fixes actually helped here.
That is expected behaviour since your bandwidth is shared.