moby: Kernel panic (3.16) on debian jessie when running docker containers with healthchecks
BUG REPORT INFORMATION
Description
Kernel panic (3.16) on debian jessie when running docker containers with healthchecks.
Steps to reproduce the issue:
- Install latest debian jessie 8.7,
apt updateand installdockerfollowing the official instructions. - pull
solr:alpineimage and build a new one with healthchecks using aDockerfile. - deploy 20 - 25 containers
- server crash / kernel panic in about 1h max
Describe the results you received: kernel panic, server crashes.
Describe the results you expected: no crash
Additional information you deem important (e.g. issue happens only occasionally):
Output of docker version:
$ docker version
Client:
Version: 1.13.0
API version: 1.25
Go version: go1.7.3
Git commit: 49bf474
Built: Tue Jan 17 09:44:08 2017
OS/Arch: linux/amd64
Server:
Version: 1.13.0
API version: 1.25 (minimum version 1.12)
Go version: go1.7.3
Git commit: 49bf474
Built: Tue Jan 17 09:44:08 2017
OS/Arch: linux/amd64
Experimental: false
Output of docker info:
$ docker info
Containers: 25
Running: 3
Paused: 0
Stopped: 22
Images: 5
Server Version: 1.13.0
Storage Driver: aufs
Root Dir: /var/lib/docker/aufs
Backing Filesystem: extfs
Dirs: 94
Dirperm1 Supported: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
Volume: local
Network: bridge host macvlan null overlay
Swarm: inactive
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 03e5862ec0d8d3b3f750e19fca3ee367e13c090e
runc version: 2f7393a47307a16f8cee44a37b262e8b81021e3e
init version: 949e6fa
Kernel Version: 3.16.0-4-amd64
Operating System: Debian GNU/Linux 8 (jessie)
OSType: linux
Architecture: x86_64
CPUs: 5
Total Memory: 6.402 GiB
Name: deb00
ID: RE6C:VVHI:KH5X:ANQK:NCAC:APCP:JD47:OUBG:C4LZ:MGUR:AMPD:7FIH
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): true
File Descriptors: 33
Goroutines: 34
System Time: 2017-01-24T04:56:35.547683852-05:00
EventsListeners: 0
Registry: https://index.docker.io/v1/
WARNING: No memory limit support
WARNING: No swap limit support
WARNING: No kernel memory limit support
WARNING: No oom kill disable support
WARNING: No cpu cfs quota support
WARNING: No cpu cfs period support
Experimental: false
Insecure Registries:
my-registry:41238
127.0.0.0/8
Live Restore Enabled: false
Additional environment details (AWS, VirtualBox, physical, etc.):
I was able to reproduce with both 1.12.5 and 1.13.0 docker versions on physical servers and VirtualBox VMs, all running jessie with 1.16 kernel. Kernel Panic screenshots are available.
I was able to reproduce with 1m healthcheck intervals as well.
$ uname -a
Linux deb00 3.16.0-4-amd64 #1 SMP Debian 3.16.39-1 (2016-12-30) x86_64 GNU/Linux
$ cat /etc/debian_version
8.7
$ uname -a
Linux deb00 3.16.0-4-amd64 #1 SMP Debian 3.16.39-1 (2016-12-30) x86_64 GNU/Linux
CPU/RAM
$ free -m
total used free shared buffers cached
Mem: 6555 5045 1509 10 18 390
-/+ buffers/cache: 4636 1919
Swap: 0 0 0
$ nproc
5
systemd config (running on Debug mode with private registry enabled)
$ cat /lib/systemd/system/docker.service
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target docker.socket firewalld.service
Requires=docker.socket
[Service]
Type=notify
# the default is not to use systemd for cgroups because the delegate issues still
# exists and systemd currently does not support the cgroup feature set required
# for containers run by docker
ExecStart=/usr/bin/dockerd -D -H fd:// --insecure-registry=my-registry:41238
ExecReload=/bin/kill -s HUP $MAINPID
LimitNOFILE=1048576
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
#TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
Dockerfile and image build
$ cat df/Dockerfile
FROM solr:alpine
USER root
RUN apk --no-cache add curl
USER $SOLR_USER
HEALTHCHECK --interval=10s --timeout=30s --retries=3 \
CMD curl -sb -H "Accept: application/json" "http://localhost:8983/solr/" | grep "solr" || exit 1
$ cd df/
$ docker build -t solr:alpine_foo .
$ cd ~
$ docker images | grep alpine_foo
solr alpine_foo de916b07eb1f 3 minutes ago 286 MB
deployment of 25 containers
$ for i in `seq 1 25`; do docker run --name=solr$i -d -P solr:alpine_foo solr-create -c mycore; done
$ docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
0e2d4127b121 solr:alpine_foo "docker-entrypoint..." 2 seconds ago Up 1 second (health: starting) 0.0.0.0:32792->8983/tcp solr25
d6e204e16e1e solr:alpine_foo "docker-entrypoint..." 5 seconds ago Up 4 seconds (health: starting) 0.0.0.0:32791->8983/tcp solr24
f27d85c6d85e solr:alpine_foo "docker-entrypoint..." 7 seconds ago Up 6 seconds (health: starting) 0.0.0.0:32790->8983/tcp solr23
edb99c47dce4 solr:alpine_foo "docker-entrypoint..." 10 seconds ago Up 10 seconds (health: starting) 0.0.0.0:32789->8983/tcp solr22
6afe1b850284 solr:alpine_foo "docker-entrypoint..." 23 seconds ago Up 22 seconds (healthy) 0.0.0.0:32788->8983/tcp solr21
c62ad83e267e solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32787->8983/tcp solr20
785a185a0fcc solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32786->8983/tcp solr19
6d5f0613b87a solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32785->8983/tcp solr18
8956d70c7eba solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32784->8983/tcp solr17
02a98144aa09 solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32783->8983/tcp solr16
16b5de44ba96 solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32782->8983/tcp solr15
d65215e558a5 solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32781->8983/tcp solr14
e625c1371df2 solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32780->8983/tcp solr13
73372f71b447 solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32779->8983/tcp solr12
f5972ccf1e91 solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32778->8983/tcp solr11
4ecc7b1f77dd solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32777->8983/tcp solr10
d574d528446b solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32776->8983/tcp solr9
54042f7bbb25 solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32775->8983/tcp solr8
c91e7be83158 solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32774->8983/tcp solr7
5c1dc6ef2984 solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32773->8983/tcp solr6
ba01f507100b solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32772->8983/tcp solr5
df9dd6f20d85 solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32771->8983/tcp solr4
c6efe430c12c solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32770->8983/tcp solr3
466711c8bb38 solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32769->8983/tcp solr2
9a72d27349b9 solr:alpine_foo "docker-entrypoint..." 51 minutes ago Up 51 minutes (healthy) 0.0.0.0:32768->8983/tcp solr1
kern.log log
root@deb00:~# tail -f /var/log/kern.log
Jan 24 05:14:13 deb00 kernel: [61066.239971] docker0: port 3(veth1f50700) entered disabled state
Jan 24 05:14:13 deb00 kernel: [61066.295894] docker0: port 3(veth1f50700) entered disabled state
Jan 24 05:14:13 deb00 kernel: [61066.296537] device veth1f50700 left promiscuous mode
Jan 24 05:14:13 deb00 kernel: [61066.296543] docker0: port 3(veth1f50700) entered disabled state
Jan 24 05:14:13 deb00 kernel: [61066.348712] docker0: port 1(veth7983bb8) entered disabled state
Jan 24 05:14:13 deb00 kernel: [61066.349502] device veth7983bb8 left promiscuous mode
Jan 24 05:14:13 deb00 kernel: [61066.349509] docker0: port 1(veth7983bb8) entered disabled state
Jan 24 05:14:13 deb00 kernel: [61066.451630] docker0: port 2(vethed02b3b) entered disabled state
Jan 24 05:14:13 deb00 kernel: [61066.452480] device vethed02b3b left promiscuous mode
Jan 24 05:14:13 deb00 kernel: [61066.452486] docker0: port 2(vethed02b3b) entered disabled state
Jan 24 06:05:06 deb00 kernel: [64119.060363] aufs au_opts_verify:1570:dockerd[7742]: dirperm1 breaks the protection by the permission bits on the lower branch
Jan 24 06:05:06 deb00 kernel: [64119.106266] aufs au_opts_verify:1570:dockerd[7742]: dirperm1 breaks the protection by the permission bits on the lower branch
Jan 24 06:05:06 deb00 kernel: [64119.138685] aufs au_opts_verify:1570:dockerd[5590]: dirperm1 breaks the protection by the permission bits on the lower branch
Jan 24 06:05:06 deb00 kernel: [64119.155874] device vethb111342 entered promiscuous mode
Jan 24 06:05:06 deb00 kernel: [64119.155903] IPv6: ADDRCONF(NETDEV_UP): vethb111342: link is not ready
Jan 24 06:05:06 deb00 kernel: [64119.155905] docker0: port 1(vethb111342) entered forwarding state
Jan 24 06:05:06 deb00 kernel: [64119.155907] docker0: port 1(vethb111342) entered forwarding state
Jan 24 06:05:06 deb00 kernel: [64119.156296] docker0: port 1(vethb111342) entered disabled state
Jan 24 06:05:06 deb00 kernel: [64119.915571] IPv6: ADDRCONF(NETDEV_CHANGE): vethb111342: link becomes ready
Jan 24 06:05:06 deb00 kernel: [64119.915591] docker0: port 1(vethb111342) entered forwarding state
Jan 24 06:05:06 deb00 kernel: [64119.915597] docker0: port 1(vethb111342) entered forwarding state
Jan 24 06:05:19 deb00 kernel: [64132.101267] aufs au_opts_verify:1570:dockerd[22281]: dirperm1 breaks the protection by the permission bits on the lower branch
Jan 24 06:05:19 deb00 kernel: [64132.132114] aufs au_opts_verify:1570:dockerd[22281]: dirperm1 breaks the protection by the permission bits on the lower branch
Jan 24 06:05:19 deb00 kernel: [64132.186436] aufs au_opts_verify:1570:dockerd[13684]: dirperm1 breaks the protection by the permission bits on the lower branch
Jan 24 06:05:19 deb00 kernel: [64132.187419] device vethc70fcda entered promiscuous mode
Jan 24 06:05:19 deb00 kernel: [64132.187448] IPv6: ADDRCONF(NETDEV_UP): vethc70fcda: link is not ready
Jan 24 06:05:19 deb00 kernel: [64132.187450] docker0: port 2(vethc70fcda) entered forwarding state
Jan 24 06:05:19 deb00 kernel: [64132.187453] docker0: port 2(vethc70fcda) entered forwarding state
Jan 24 06:05:19 deb00 kernel: [64132.188356] docker0: port 2(vethc70fcda) entered disabled state
Jan 24 06:05:19 deb00 kernel: [64132.415258] IPv6: ADDRCONF(NETDEV_CHANGE): vethc70fcda: link becomes ready
Jan 24 06:05:19 deb00 kernel: [64132.415282] docker0: port 2(vethc70fcda) entered forwarding state
Jan 24 06:05:19 deb00 kernel: [64132.415289] docker0: port 2(vethc70fcda) entered forwarding state
Jan 24 06:05:21 deb00 kernel: [64134.929534] docker0: port 1(vethb111342) entered forwarding state
Jan 24 06:05:22 deb00 kernel: [64135.107574] aufs au_opts_verify:1570:dockerd[13684]: dirperm1 breaks the protection by the permission bits on the lower branch
Jan 24 06:05:22 deb00 kernel: [64135.154440] aufs au_opts_verify:1570:dockerd[13684]: dirperm1 breaks the protection by the permission bits on the lower branch
Jan 24 06:05:22 deb00 kernel: [64135.214953] aufs au_opts_verify:1570:dockerd[22281]: dirperm1 breaks the protection by the permission bits on the lower branch
Jan 24 06:05:22 deb00 kernel: [64135.227971] device vethec89273 entered promiscuous mode
Jan 24 06:05:22 deb00 kernel: [64135.228005] IPv6: ADDRCONF(NETDEV_UP): vethec89273: link is not ready
Jan 24 06:05:22 deb00 kernel: [64135.228007] docker0: port 3(vethec89273) entered forwarding state
Jan 24 06:05:22 deb00 kernel: [64135.228011] docker0: port 3(vethec89273) entered forwarding state
Jan 24 06:05:22 deb00 kernel: [64135.228691] docker0: port 3(vethec89273) entered disabled state
Jan 24 06:05:22 deb00 kernel: [64135.439325] IPv6: ADDRCONF(NETDEV_CHANGE): vethec89273: link becomes ready
Jan 24 06:05:22 deb00 kernel: [64135.439350] docker0: port 3(vethec89273) entered forwarding state
Jan 24 06:05:22 deb00 kernel: [64135.439356] docker0: port 3(vethec89273) entered forwarding state
Jan 24 06:05:24 deb00 kernel: [64137.875979] aufs au_opts_verify:1570:dockerd[798]: dirperm1 breaks the protection by the permission bits on the lower branch
Jan 24 06:05:24 deb00 kernel: [64137.904122] aufs au_opts_verify:1570:dockerd[798]: dirperm1 breaks the protection by the permission bits on the lower branch
Jan 24 06:05:24 deb00 kernel: [64137.943760] aufs au_opts_verify:1570:dockerd[798]: dirperm1 breaks the protection by the permission bits on the lower branch
Jan 24 06:05:24 deb00 kernel: [64137.944868] device veth0e73444 entered promiscuous mode
Jan 24 06:05:24 deb00 kernel: [64137.944907] IPv6: ADDRCONF(NETDEV_UP): veth0e73444: link is not ready
Jan 24 06:05:24 deb00 kernel: [64137.944910] docker0: port 24(veth0e73444) entered forwarding state
Jan 24 06:05:24 deb00 kernel: [64137.944914] docker0: port 24(veth0e73444) entered forwarding state
Jan 24 06:05:24 deb00 kernel: [64137.945418] docker0: port 24(veth0e73444) entered disabled state
Jan 24 06:05:25 deb00 kernel: [64138.124250] IPv6: ADDRCONF(NETDEV_CHANGE): veth0e73444: link becomes ready
Jan 24 06:05:25 deb00 kernel: [64138.124273] docker0: port 24(veth0e73444) entered forwarding state
Jan 24 06:05:25 deb00 kernel: [64138.124279] docker0: port 24(veth0e73444) entered forwarding state
Jan 24 06:05:27 deb00 kernel: [64140.469756] aufs au_opts_verify:1570:dockerd[31573]: dirperm1 breaks the protection by the permission bits on the lower branch
Jan 24 06:05:27 deb00 kernel: [64140.528564] aufs au_opts_verify:1570:dockerd[31573]: dirperm1 breaks the protection by the permission bits on the lower branch
Jan 24 06:05:27 deb00 kernel: [64140.580007] aufs au_opts_verify:1570:dockerd[14822]: dirperm1 breaks the protection by the permission bits on the lower branch
Jan 24 06:05:27 deb00 kernel: [64140.580961] device veth4e45fad entered promiscuous mode
Jan 24 06:05:27 deb00 kernel: [64140.581001] IPv6: ADDRCONF(NETDEV_UP): veth4e45fad: link is not ready
Jan 24 06:05:27 deb00 kernel: [64140.581004] docker0: port 25(veth4e45fad) entered forwarding state
Jan 24 06:05:27 deb00 kernel: [64140.581008] docker0: port 25(veth4e45fad) entered forwarding state
Jan 24 06:05:27 deb00 kernel: [64140.583610] docker0: port 25(veth4e45fad) entered disabled state
Jan 24 06:05:27 deb00 kernel: [64140.799238] IPv6: ADDRCONF(NETDEV_CHANGE): veth4e45fad: link becomes ready
Jan 24 06:05:27 deb00 kernel: [64140.799281] docker0: port 25(veth4e45fad) entered forwarding state
Jan 24 06:05:27 deb00 kernel: [64140.799288] docker0: port 25(veth4e45fad) entered forwarding state
Jan 24 06:05:34 deb00 kernel: [64147.470937] docker0: port 2(vethc70fcda) entered forwarding state
Jan 24 06:05:37 deb00 kernel: [64150.478787] docker0: port 3(vethec89273) entered forwarding state
Jan 24 06:05:40 deb00 kernel: [64153.166907] docker0: port 24(veth0e73444) entered forwarding state
Jan 24 06:05:42 deb00 kernel: [64155.854926] docker0: port 25(veth4e45fad) entered forwarding state
journalctl docker.service log
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.687202920-05:00" level=debug msg="Health check for container f27d85c6d85ecb5d4b4da33d2f80db6a0c1e6e25ff47322a9b27010d8286874a done (exitCode=0)"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.826251206-05:00" level=debug msg="libcontainerd: received containerd event: &types.Event{Type:\"start-process\", Id:\"5c1dc6ef2984b779b2908e65227a7b08340316a8d885c46af3026ce2b33a60fd\", Status:0x0, Pid:\"75cdbe367c5d4a39bcc36abe55d2075bd0e53c584b7ade767b541ac63a91af78\", Timestamp:(*timestamp.Timestamp)(0xc42258b540)}"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.826306190-05:00" level=debug msg="libcontainerd: event unhandled: type:\"start-process\" id:\"5c1dc6ef2984b779b2908e65227a7b08340316a8d885c46af3026ce2b33a60fd\" pid:\"75cdbe367c5d4a39bcc36abe55d2075bd0e53c584b7ade767b541ac63a91af78\" timestamp:<seconds:1485256066 nanos:825781474 > "
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.923630832-05:00" level=debug msg="containerd: process exited" id=c6efe430c12cb26df844ce89684fdf635094cf1d7753f47ef144e5c80d7a3961 pid=3acabb3e02b3a94208f0ad82ded31e35cf493d900131060242f3aad275b5eb37 status=0 systemPid=10874
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.923768909-05:00" level=debug msg="containerd: process exited" id=466711c8bb38384e2ded29ee65c74745938518bc3d154a36ea68dc810743701f pid=1d3c900a7bf1fb131551eb42df4946fa9aa8f53f9fa56c575bd9cdd34a1c4b2a status=0 systemPid=10899
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.923870866-05:00" level=debug msg="containerd: process exited" id=e625c1371df27b6b584aa6a89246dd317ae7284b63ee7a0f13b221cec9ebdf0e pid=1dcdfc1504b96d067b1709ebb6f5fc7cd0ce20bd9beeb247bbde1c79df3b8d3b status=0 systemPid=10924
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.923955838-05:00" level=debug msg="containerd: process exited" id=6d5f0613b87a0a6b0d9287244d060d465c4e8fc58b1f8e5e939897dfc1a02331 pid=da793799a6f09b2c08746d5a9541150fcd46655bf92e016e0cf1c845d0097a26 status=0 systemPid=10952
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.924061267-05:00" level=debug msg="containerd: process exited" id=f5972ccf1e91e227bca28daaf306a4428a352ff20f22e37917bd478e475c0474 pid=1d4d89df42b2727d75e2806049aaff4511cd05aa9bed9164e2c3c8fb912c9965 status=0 systemPid=10983
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.924145329-05:00" level=debug msg="containerd: process exited" id=d574d528446b370208a1a7bb6feb9c68c3286cbb5e709b5f4bc8ec0c0687224e pid=302e71450682dd715058183d75e921366cac12ef73163a275b579d5210b3217b status=0 systemPid=11009
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.924232799-05:00" level=debug msg="containerd: process exited" id=54042f7bbb25861e2c185fb1f688df3e387f6b3267033b3c7009795e0518ab65 pid=57fd314c8c3ca9014470a5f2fad63218dcd81382953029175f63060edec5b429 status=0 systemPid=11035
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.924313674-05:00" level=debug msg="containerd: process exited" id=4ecc7b1f77dde35cdc3e4f2b66af227a08d7002de55ed969c1fe73a1771e5e13 pid=44d26c7e44b3ba2d35e4e4917e1580279af80b76d770de13c8b52bb36f3cc712 status=0 systemPid=11060
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.92439678-05:00" level=debug msg="containerd: process exited" id=5c1dc6ef2984b779b2908e65227a7b08340316a8d885c46af3026ce2b33a60fd pid=75cdbe367c5d4a39bcc36abe55d2075bd0e53c584b7ade767b541ac63a91af78 status=0 systemPid=11087
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925035538-05:00" level=debug msg="libcontainerd: received containerd event: &types.Event{Type:\"start-process\", Id:\"02a98144aa096b066ec8208cf20e8b73f97a12af117f8e71b0f009c3eb156803\", Status:0x0, Pid:\"d93650074d3bc447a15035e8b88b325187fad5491941d82eaa5c21daf76f470d\", Timestamp:(*timestamp.Timestamp)(0xc42258b780)}"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925082085-05:00" level=debug msg="libcontainerd: event unhandled: type:\"start-process\" id:\"02a98144aa096b066ec8208cf20e8b73f97a12af117f8e71b0f009c3eb156803\" pid:\"d93650074d3bc447a15035e8b88b325187fad5491941d82eaa5c21daf76f470d\" timestamp:<seconds:1485256066 nanos:923592156 > "
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925134521-05:00" level=debug msg="libcontainerd: received containerd event: &types.Event{Type:\"exit\", Id:\"5c1dc6ef2984b779b2908e65227a7b08340316a8d885c46af3026ce2b33a60fd\", Status:0x0, Pid:\"75cdbe367c5d4a39bcc36abe55d2075bd0e53c584b7ade767b541ac63a91af78\", Timestamp:(*timestamp.Timestamp)(0xc42258b980)}"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925198780-05:00" level=debug msg="libcontainerd: received containerd event: &types.Event{Type:\"exit\", Id:\"c6efe430c12cb26df844ce89684fdf635094cf1d7753f47ef144e5c80d7a3961\", Status:0x0, Pid:\"3acabb3e02b3a94208f0ad82ded31e35cf493d900131060242f3aad275b5eb37\", Timestamp:(*timestamp.Timestamp)(0xc42258ba80)}"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925245670-05:00" level=debug msg="libcontainerd: received containerd event: &types.Event{Type:\"exit\", Id:\"466711c8bb38384e2ded29ee65c74745938518bc3d154a36ea68dc810743701f\", Status:0x0, Pid:\"1d3c900a7bf1fb131551eb42df4946fa9aa8f53f9fa56c575bd9cdd34a1c4b2a\", Timestamp:(*timestamp.Timestamp)(0xc42258bb80)}"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925285513-05:00" level=debug msg="libcontainerd: received containerd event: &types.Event{Type:\"exit\", Id:\"e625c1371df27b6b584aa6a89246dd317ae7284b63ee7a0f13b221cec9ebdf0e\", Status:0x0, Pid:\"1dcdfc1504b96d067b1709ebb6f5fc7cd0ce20bd9beeb247bbde1c79df3b8d3b\", Timestamp:(*timestamp.Timestamp)(0xc42258bc80)}"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925336801-05:00" level=debug msg="libcontainerd: received containerd event: &types.Event{Type:\"exit\", Id:\"6d5f0613b87a0a6b0d9287244d060d465c4e8fc58b1f8e5e939897dfc1a02331\", Status:0x0, Pid:\"da793799a6f09b2c08746d5a9541150fcd46655bf92e016e0cf1c845d0097a26\", Timestamp:(*timestamp.Timestamp)(0xc42258bd80)}"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925389067-05:00" level=debug msg="libcontainerd: received containerd event: &types.Event{Type:\"exit\", Id:\"f5972ccf1e91e227bca28daaf306a4428a352ff20f22e37917bd478e475c0474\", Status:0x0, Pid:\"1d4d89df42b2727d75e2806049aaff4511cd05aa9bed9164e2c3c8fb912c9965\", Timestamp:(*timestamp.Timestamp)(0xc42258be80)}"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925453559-05:00" level=debug msg="libcontainerd: received containerd event: &types.Event{Type:\"exit\", Id:\"d574d528446b370208a1a7bb6feb9c68c3286cbb5e709b5f4bc8ec0c0687224e\", Status:0x0, Pid:\"302e71450682dd715058183d75e921366cac12ef73163a275b579d5210b3217b\", Timestamp:(*timestamp.Timestamp)(0xc42258bf90)}"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925493496-05:00" level=debug msg="libcontainerd: received containerd event: &types.Event{Type:\"exit\", Id:\"54042f7bbb25861e2c185fb1f688df3e387f6b3267033b3c7009795e0518ab65\", Status:0x0, Pid:\"57fd314c8c3ca9014470a5f2fad63218dcd81382953029175f63060edec5b429\", Timestamp:(*timestamp.Timestamp)(0xc422530090)}"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925560423-05:00" level=debug msg="libcontainerd: received containerd event: &types.Event{Type:\"exit\", Id:\"4ecc7b1f77dde35cdc3e4f2b66af227a08d7002de55ed969c1fe73a1771e5e13\", Status:0x0, Pid:\"44d26c7e44b3ba2d35e4e4917e1580279af80b76d770de13c8b52bb36f3cc712\", Timestamp:(*timestamp.Timestamp)(0xc422530190)}"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925628581-05:00" level=debug msg="attach: stderr: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925651890-05:00" level=debug msg="attach: stderr: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925672400-05:00" level=debug msg="attach: stderr: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925688682-05:00" level=debug msg="attach: stderr: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925702981-05:00" level=debug msg="attach: stderr: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925714115-05:00" level=debug msg="attach: stderr: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925725705-05:00" level=debug msg="attach: stderr: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925741190-05:00" level=debug msg="attach: stderr: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925760157-05:00" level=debug msg="attach: stderr: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925767679-05:00" level=debug msg="attach: stdout: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925783010-05:00" level=debug msg="Health check for container 4ecc7b1f77dde35cdc3e4f2b66af227a08d7002de55ed969c1fe73a1771e5e13 done (exitCode=0)"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925798701-05:00" level=debug msg="attach: stdout: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925813227-05:00" level=debug msg="Health check for container 5c1dc6ef2984b779b2908e65227a7b08340316a8d885c46af3026ce2b33a60fd done (exitCode=0)"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925826147-05:00" level=debug msg="attach: stdout: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925840091-05:00" level=debug msg="Health check for container c6efe430c12cb26df844ce89684fdf635094cf1d7753f47ef144e5c80d7a3961 done (exitCode=0)"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925856902-05:00" level=debug msg="attach: stdout: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925870755-05:00" level=debug msg="Health check for container 466711c8bb38384e2ded29ee65c74745938518bc3d154a36ea68dc810743701f done (exitCode=0)"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925883904-05:00" level=debug msg="attach: stdout: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925895322-05:00" level=debug msg="Health check for container e625c1371df27b6b584aa6a89246dd317ae7284b63ee7a0f13b221cec9ebdf0e done (exitCode=0)"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925904500-05:00" level=debug msg="attach: stdout: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925914345-05:00" level=debug msg="Health check for container 6d5f0613b87a0a6b0d9287244d060d465c4e8fc58b1f8e5e939897dfc1a02331 done (exitCode=0)"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925923895-05:00" level=debug msg="attach: stdout: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925932839-05:00" level=debug msg="Health check for container f5972ccf1e91e227bca28daaf306a4428a352ff20f22e37917bd478e475c0474 done (exitCode=0)"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925941144-05:00" level=debug msg="attach: stdout: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925951870-05:00" level=debug msg="Health check for container d574d528446b370208a1a7bb6feb9c68c3286cbb5e709b5f4bc8ec0c0687224e done (exitCode=0)"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925964701-05:00" level=debug msg="attach: stdout: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.925976209-05:00" level=debug msg="Health check for container 54042f7bbb25861e2c185fb1f688df3e387f6b3267033b3c7009795e0518ab65 done (exitCode=0)"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.931357764-05:00" level=debug msg="containerd: process exited" id=02a98144aa096b066ec8208cf20e8b73f97a12af117f8e71b0f009c3eb156803 pid=d93650074d3bc447a15035e8b88b325187fad5491941d82eaa5c21daf76f470d status=0 systemPid=11113
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.931753083-05:00" level=debug msg="libcontainerd: received containerd event: &types.Event{Type:\"exit\", Id:\"02a98144aa096b066ec8208cf20e8b73f97a12af117f8e71b0f009c3eb156803\", Status:0x0, Pid:\"d93650074d3bc447a15035e8b88b325187fad5491941d82eaa5c21daf76f470d\", Timestamp:(*timestamp.Timestamp)(0xc42278a850)}"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.931882110-05:00" level=debug msg="attach: stderr: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.931892183-05:00" level=debug msg="attach: stdout: end"
Jan 24 06:07:46 deb00 dockerd[510]: time="2017-01-24T06:07:46.931907482-05:00" level=debug msg="Health check for container 02a98144aa096b066ec8208cf20e8b73f97a12af117f8e71b0f009c3eb156803 done (exitCode=0)"
Jan 24 06:07:49 deb00 dockerd[510]: time="2017-01-24T06:07:49.327408426-05:00" level=debug msg="Running health check for container 9a72d27349b98d703be01c0824cd79651b4ba264a296bf795b76aeb13b2a7819 ..."
Jan 24 06:07:49 deb00 dockerd[510]: time="2017-01-24T06:07:49.327477546-05:00" level=debug msg="starting exec command 839b336433a84b11c21306cf91b8e1106e93322fe760ab409790a0c34d016b13 in container 9a72d27349b98d703be01c0824cd79651b4ba264a296bf795b76aeb13b2a7819"
Jan 24 06:07:49 deb00 dockerd[510]: time="2017-01-24T06:07:49.327964123-05:00" level=debug msg="attach: stdout: begin"
Jan 24 06:07:49 deb00 dockerd[510]: time="2017-01-24T06:07:49.328020158-05:00" level=debug msg="attach: stderr: begin"
About this issue
- Original URL
- State: closed
- Created 7 years ago
- Reactions: 4
- Comments: 18 (5 by maintainers)
I there anything actionable here? Or is this a kernel bug? Debian 9 “stretch” is currently in “full freeze” (https://wiki.debian.org/DebianStretch) and hopefully available as “stable” soon.