kubernetes: Dockerd process leaking handles in K8s Windows worker nodes
What happened:
The dockerd process is leaking handles (~2M) in Kubernetes Windows worker nodes, leading to huge (lot more than usual) memory and cpu consumption.
What you expected to happen:
The process is not expected to open so many handles as it is doing now. It’s usual inter-process communication is probably expected to open lot less than 2 million handles.
How to reproduce it (as minimally and precisely as possible):
Windows server minimal installation with Docker and Kubernetes should be able to reproduce this issue.
Anything else we need to know?:
The handle leak goes on increasing with time until and unless the system is rebooted for maintenance, which implies unless the dockerd process is restarted.
Environment:
- Kubernetes version (use
kubectl version
): 1.19.11 - Cloud provider or hardware configuration: Hyper-V Virtual Machine
- OS : Windows Server 20H2 SAC
- OS Version: 10.0.19042
- Install tools: Docker
- CNI : Calico (Vxlan)
####Other details:
`PS C:> get-process -Name dockerd
Handles NPM(K) PM(K) WS(K) CPU(s) Id SI ProcessName
1953515 27 145448 78128 250,658.44 2980 0 dockerd `
About this issue
- Original URL
- State: closed
- Created 3 years ago
- Comments: 19 (12 by maintainers)
Upgraded to Docker EE 20.10.9 and the issue of docker leaking handles still persists. Can we please re-open this issue and try triaging it @marosset ?