minikube: docker driver: don't mount to /var as it causes race condition

Steps to reproduce the issue:

Im following the official guide to use minikube and i am getting an error inside the container image

INFO: ensuring we can execute /bin/mount even with userns-remap

INFO: remounting /sys read-only

INFO: making mounts shared

INFO: fix cgroup mounts for all subsystems

INFO: clearing and regenerating /etc/machine-id

Initializing machine ID from random generator.

INFO: faking /sys/class/dmi/id/product_name to be “kind”

INFO: faking /sys/class/dmi/id/product_uuid to be random

INFO: faking /sys/devices/virtual/dmi/id/product_uuid as well

INFO: setting iptables to detected mode: legacy

update-alternatives: error: no alternatives for iptables

i use windows 10 and my docker desktop version is 2.3.0.2

Full output of failed command: I0516 17:24:50.867547 12524 start.go:99] hostinfo: {“hostname”:“DESKTOP-CFDRBNO”,“uptime”:28728,“bootTime”:1589631962,“procs”:243,“os”:“windows”,“platform”:“Microsoft Windows 10 Enterprise”,“platformFamily”:“Standalone Workstation”,“platformVersion”:“10.0.18362 Build 18362”,“kernelVersion”:“”,“virtualizationSystem”:“”,“virtualizationRole”:“”,“hostid”:“d16cd74e-4922-43f3-8935-a8a21e85fb43”} W0516 17:24:50.867547 12524 start.go:107] gopshost.Virtualization returned error: not implemented yet

  • minikube v1.10.1 on Microsoft Windows 10 Enterprise 10.0.18362 Build 18362 I0516 17:24:50.881545 12524 notify.go:125] Checking for updates… I0516 17:24:50.884546 12524 driver.go:253] Setting default libvirt URI to qemu:///system I0516 17:24:51.279998 12524 docker.go:95] docker version: linux-19.03.8
  • Using the docker driver based on existing profile I0516 17:24:51.285999 12524 start.go:215] selected driver: docker I0516 17:24:51.286998 12524 start.go:594] validating driver “docker” against &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 Memory:1989 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio KubernetesConfig:{KubernetesVersion:v1.18.2 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.244.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.2 ControlPlane:true Worker:true}] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true]} I0516 17:24:51.286998 12524 start.go:600] status for docker: {Installed:true Healthy:true Error:<nil> Fix: Doc:} I0516 17:24:51.287999 12524 start.go:917] auto setting extra-config to “kubeadm.pod-network-cidr=10.244.0.0/16”.
  • Starting control plane node minikube in cluster minikube I0516 17:24:51.292004 12524 cache.go:104] Beginning downloading kic artifacts for docker with docker I0516 17:24:51.464001 12524 image.go:88] Found gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 in local docker daemon, skipping pull I0516 17:24:51.464001 12524 preload.go:81] Checking if preload exists for k8s version v1.18.2 and runtime docker I0516 17:24:51.465998 12524 preload.go:96] Found local preload: C:\Users\Lepa.minikube\cache\preloaded-tarball\preloaded-images-k8s-v3-v1.18.2-docker-overlay2-amd64.tar.lz4 I0516 17:24:51.465998 12524 cache.go:48] Caching tarball of preloaded images I0516 17:24:51.466999 12524 preload.go:122] Found C:\Users\Lepa.minikube\cache\preloaded-tarball\preloaded-images-k8s-v3-v1.18.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download I0516 17:24:51.467999 12524 cache.go:51] Finished verifying existence of preloaded tar for v1.18.2 on docker I0516 17:24:51.468998 12524 profile.go:156] Saving config to C:\Users\Lepa.minikube\profiles\minikube\config.json … I0516 17:24:51.470998 12524 cache.go:132] Successfully downloaded all kic artifacts I0516 17:24:51.471998 12524 start.go:223] acquiring machines lock for minikube: {Name:mkd0ecf026d95e036f7a91a8d78fbc6cb8d50d6f Clock:{} Delay:500ms Timeout:15m0s Cancel:<nil>} I0516 17:24:51.471998 12524 start.go:227] acquired machines lock for “minikube” in 0s I0516 17:24:51.471998 12524 start.go:87] Skipping create…Using existing machine configuration I0516 17:24:51.472998 12524 fix.go:53] fixHost starting: I0516 17:24:51.519001 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:51.656003 12524 fix.go:105] recreateIfNeeded on minikube: state=Stopped err=<nil> W0516 17:24:51.656998 12524 fix.go:131] unexpected machine state, will restart: <nil>
  • Restarting existing docker container for “minikube” … I0516 17:24:51.687998 12524 cli_runner.go:108] Run: docker start minikube I0516 17:24:52.246999 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:52.604000 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:52.758997 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:52.918001 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:53.080999 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:53.245998 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:53.409997 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:53.568998 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:53.736997 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:53.896998 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:54.072998 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:54.263997 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:54.476998 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:54.679004 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:54.936998 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:55.223011 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:55.602012 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:56.047013 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:56.602057 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:57.632049 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:58.584195 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:24:59.911981 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:02.223268 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:06.390494 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:14.200094 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:21.035955 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:31.262799 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:31.408802 12524 fix.go:55] fixHost completed within 39.9348019s I0516 17:25:31.408802 12524 start.go:74] releasing machines lock for “minikube”, held for 39.9368033s ! StartHost failed, but will try again: driver start: expected container state be running but got “Stopped” I0516 17:25:36.411282 12524 start.go:223] acquiring machines lock for minikube: {Name:mkd0ecf026d95e036f7a91a8d78fbc6cb8d50d6f Clock:{} Delay:500ms Timeout:15m0s Cancel:<nil>} I0516 17:25:36.412285 12524 start.go:227] acquired machines lock for “minikube” in 0s I0516 17:25:36.414276 12524 start.go:87] Skipping create…Using existing machine configuration I0516 17:25:36.414276 12524 fix.go:53] fixHost starting: I0516 17:25:36.465281 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:36.609284 12524 fix.go:105] recreateIfNeeded on minikube: state=Stopped err=<nil> W0516 17:25:36.609284 12524 fix.go:131] unexpected machine state, will restart: <nil>
  • Restarting existing docker container for “minikube” … I0516 17:25:36.637277 12524 cli_runner.go:108] Run: docker start minikube I0516 17:25:37.097246 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:37.408239 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:37.569241 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:37.726240 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:37.892239 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:38.052244 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:38.218241 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:38.388240 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:38.553239 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:38.727241 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:38.892241 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:39.079242 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:39.267241 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:39.495240 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:39.734409 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:40.002405 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:40.386424 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:40.914258 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:42.952233 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:43.788253 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:45.090653 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:46.497019 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:25:48.603142 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:26:10.953385 12524 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}} I0516 17:26:11.106385 12524 fix.go:55] fixHost completed within 34.6921086s I0516 17:26:11.106385 12524 start.go:74] releasing machines lock for “minikube”, held for 34.6931059s
  • Failed to start docker container. “minikube start” may fix it: driver start: expected container state be running but got “Stopped” I0516 17:26:11.109383 12524 exit.go:58] WithError(error provisioning host)=Failed to start host: driver start: expected container state be running but got “Stopped” called from: goroutine 1 [running]: runtime/debug.Stack(0x40acf1, 0x18d3660, 0x18b8300) /usr/local/go/src/runtime/debug/stack.go:24 +0xa4 k8s.io/minikube/pkg/minikube/exit.WithError(0x1b3f8de, 0x17, 0x1dfc340, 0xc000396640) /app/pkg/minikube/exit/exit.go:58 +0x3b k8s.io/minikube/cmd/minikube/cmd.runStart(0x2b53760, 0xc0002f5410, 0x0, 0x1) /app/cmd/minikube/cmd/start.go:170 +0xac9 github.com/spf13/cobra.(*Command).execute(0x2b53760, 0xc0002f5400, 0x1, 0x1, 0x2b53760, 0xc0002f5400) /go/pkg/mod/github.com/spf13/cobra@v1.0.0/command.go:846 +0x2b1 github.com/spf13/cobra.(*Command).ExecuteC(0x2b527a0, 0x0, 0x0, 0xc000005001) /go/pkg/mod/github.com/spf13/cobra@v1.0.0/command.go:950 +0x350 github.com/spf13/cobra.(*Command).Execute(…) /go/pkg/mod/github.com/spf13/cobra@v1.0.0/command.go:887 k8s.io/minikube/cmd/minikube/cmd.Execute() /app/cmd/minikube/cmd/root.go:112 +0x6f5 main.main() /app/cmd/minikube/main.go:66 +0xf1 W0516 17:26:11.110383 12524 out.go:201] error provisioning host: Failed to start host: driver start: expected container state be running but got “Stopped”

Optional: Full output of minikube logs command:

About this issue

  • Original URL
  • State: closed
  • Created 4 years ago
  • Reactions: 1
  • Comments: 16 (1 by maintainers)

Most upvoted comments

@priyawadhwa cloud code team also has this issue on mac

they seem to fix it with minikube delete --all