minikube: hyperkit start: Could not find an IP address for 6a:c7:25:8a:7f:2b

Is this a BUG REPORT or FEATURE REQUEST?: Bug

Please provide the following details:

Environment:

Minikube version: 0.22.0

  • OS: macOS 10.12.6
  • VM Driver: hyperkit
  • ISO version: minikube-v0.23.3.iso
  • Install tools:
  • Others:

What happened: Cluster did not start:

$ minikube start --vm-driver hyperkit -v 10
Starting local Kubernetes v1.7.5 cluster...
Starting VM...
Found binary path at /usr/local/bin/docker-machine-driver-hyperkit
Launching plugin server for driver hyperkit
Plugin server listening at address 127.0.0.1:58797
() Calling .GetVersion
Using API Version  1
() Calling .SetConfigRaw
() Calling .GetMachineName
(minikube) Calling .GetState
(minikube) Calling .Start
(minikube) Generated UUID 23bf5b8b-93fe-11e7-b603-784f43517719
(minikube) Generated MAC 6a:c7:25:8a:7f:2b
(minikube) Starting with cmdline: loglevel=3 user=docker console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes base host=minikube
E0907 11:56:39.075265   54829 start.go:143] Error starting host: Error starting stopped host: IP address never found in dhcp leases file Temporary Error: Could not find an IP address for 6a:c7:25:8a:7f:2b
Temporary Error: Could not find an IP address for 6a:c7:25:8a:7f:2b
[... snip a ton of these errors...]

What you expected to happen: The cluster starts normally.

How to reproduce it (as minimally and precisely as possible): See above command

Output of minikube logs (if applicable):

Anything else do we need to know: I built docker-machine-driver-hyperkit myself, but got the minikube binary from the latest official release here on Github. If there’s a more official place to get docker-machine-driver-hyperkit, I’ll try using that one.

About this issue

  • Original URL
  • State: closed
  • Created 7 years ago
  • Reactions: 9
  • Comments: 46 (18 by maintainers)

Most upvoted comments

~The problem is~ In my experience, this problem has been that the hyperkit.pid file (e.g. ~/.minikube/machines/minikube/hyperkit.pid) is taken as gospel, and the PID recorded in the file is not validated as a running hyperkit process. This is why the problem shows up when you e.g. reboot without first stopping minikube. When I get a little bit of time, I’m planning to take a deeper dive into the source. My first superficial search seems to indicate that the bug is actually in upstream Moby, but I don’t have much confidence in that guess.

UPDATE: This means that the manual fix/workaround would be to simply delete the hyperkit.pid file and try starting again.

After running minikube delete then minikube start --vm-driver hyperkit I am back into a working state.

I’ve just run into this issue, also (to quote above)

Only occurred after starting an initially working cluster then restarting my computer.

I observe (a) stopping and restarting a hyperkit-based minikube machine regenerates the mac address (b) after restarting the osx host, the hyperkit-based minikube machine will not update /var/db/dhcpd_leases at all.

It seems that a hyperkit-base minikube will not survive a host reboot, and that if you reboot, you must minikube delete and rebuild. At least with v0.24.1

I still have the same issue

$ ls -la $(which docker-machine-driver-hyperkit)
-rwsr-xr-x 1 root wheel 27779836 Mar 12 17:51 /usr/local/bin/docker-machine-driver-hyperkit

As I found out the issue is related to Cisco AnyConnect client. When I turn off corporate VPN the error goes away.

Based on @paljsingh’s suggestion, I turned off my VPN connection and it worked. Haven’t debugged the root cause but I now have:

macbook:~ me$ minikube start --vm-driver=hyperkit
😄  minikube v1.5.2 on Darwin 10.13.6
🔥  Creating hyperkit VM (CPUs=2, Memory=2000MB, Disk=20000MB) ...
🐳  Preparing Kubernetes v1.16.2 on Docker '18.09.9' ...
💾  Downloading kubelet v1.16.2
💾  Downloading kubeadm v1.16.2
🚜  Pulling images ...
🚀  Launching Kubernetes ...
⌛  Waiting for: apiserver
🏄  Done! kubectl is now configured to use "minikube"

I got this error when working over VPN. minikube start works after I disconnect from the VPN.

$ minikube start --vm-driver=hyperkit --cpus=4 --memory=8192
😄  minikube v1.3.1 on Darwin 10.13.6
🔥  Creating hyperkit VM (CPUs=4, Memory=8192MB, Disk=20000MB) ...
E0821 12:21:12.559082    5427 start.go:723] StartHost: create: Error creating machine: Error in driver during machine creation: IP address never found in dhcp leases file Temporary error: could not find an IP address for 86:ac:fd:ec:6:cf

💣  Unable to start VM: create: Error creating machine: Error in driver during machine creation: IP address never found in dhcp leases file Temporary error: could not find an IP address for 86:ac:fd:ec:6:cf

😿  Sorry that minikube crashed. If this was unexpected, we would love to hear from you:
👉  https://github.com/kubernetes/minikube/issues/new/choose
$ cat /var/db/dhcpd_leases
{
	name=minikube
	ip_address=192.168.64.5
	hw_address=1,da:ce:5c:8f:89:1
	identifier=1,da:ce:5c:8f:89:1
	lease=0x5d5e39e7
}
{
	name=minikube
	ip_address=192.168.64.4
	hw_address=1,66:f3:ea:fa:78:5f
	identifier=1,66:f3:ea:fa:78:5f
	lease=0x5d5e3709
}
{
	name=minikube
	ip_address=192.168.64.3
	hw_address=1,1a:9b:39:de:59:b8
	identifier=1,1a:9b:39:de:59:b8
	lease=0x5d5e32c7
}
{
	name=minikube
	ip_address=192.168.64.2
	hw_address=1,e6:79:d3:af:bb:24
	identifier=1,e6:79:d3:af:bb:24
	lease=0x5d5e3291
}

I believe this is fixed with the latest hyperkit driver, released with v0.34.0. If you are running into this, please try running:

curl -LO https://storage.googleapis.com/minikube/releases/latest/docker-machine-driver-hyperkit && sudo install -o root -g wheel -m 4755 docker-machine-driver-hyperkit /usr/local/bin/

Then run minikube delete && minikube start --vm-driver=hyperkit to recreate your VM.

If this is still broken, please re-open the bug, and include the output of:

ls -la $(which docker-machine-driver-hyperkit)

Thanks!

I don’t get why this issue is closed while a few people still facing this issue like myself.

 ❯ ls -la $(which docker-machine-driver-hyperkit)                                                                                                   
-rwsr-xr-x  1 root  wheel    32M Jul 18 12:24 /usr/local/bin/docker-machine-driver-hyperkit
cat /var/db/dhcpd_leases                                                                                                                         [12:38:47]
{
	name=minikube
	ip_address=192.168.64.11
	hw_address=1,1e:5:8b:4e:8a:9e
	identifier=1,1e:5:8b:4e:8a:9e
	lease=0x5d31490f
}
{
	name=minikube
	ip_address=192.168.64.10
	hw_address=1,ce:2f:32:5f:a8:e5
	identifier=1,ce:2f:32:5f:a8:e5
	lease=0x5d314672
}
{
	name=minikube
	ip_address=192.168.64.9
	hw_address=1,16:3d:ea:b1:6a:a3
	identifier=1,16:3d:ea:b1:6a:a3
	lease=0x5d3143c6
}
{
	name=minikube
	ip_address=192.168.64.8
	hw_address=1,d6:75:91:e3:60:e2
	identifier=1,d6:75:91:e3:60:e2
	lease=0x5d3141fe
}
{
	name=minikube
	ip_address=192.168.64.7
	hw_address=1,1a:3d:ef:82:b4:51
	identifier=1,1a:3d:ef:82:b4:51
	lease=0x5d3140b9
}
{
	name=minikube
	ip_address=192.168.64.6
	hw_address=1,86:f6:79:16:f5:3e
	identifier=1,86:f6:79:16:f5:3e
	lease=0x5d313f6b
}
{
	name=minikube
	ip_address=192.168.64.5
	hw_address=1,be:66:a9:db:16:6f
	identifier=1,be:66:a9:db:16:6f
	lease=0x5d313d72
}
{
	name=minikube
	ip_address=192.168.64.4
	hw_address=1,62:1c:b0:bb:db:46
	identifier=1,62:1c:b0:bb:db:46
	lease=0x5d306e19
}
{
	name=minikube
	ip_address=192.168.64.3
	hw_address=1,2:15:3b:5d:35:55
	identifier=1,2:15:3b:5d:35:55
	lease=0x5d2ee694
}
{
	name=minikube
	ip_address=192.168.64.2
	hw_address=1,72:26:31:e0:8e:97
	identifier=1,72:26:31:e0:8e:97
	lease=0x5c3079d7
}
minikube delete && minikube start --vm-driver=hyperkit                                                                                           [12:42:41]
🔥  Deleting "minikube" from hyperkit ...
💔  The "minikube" cluster has been deleted.
😄  minikube v1.2.0 on darwin (amd64)
🔥  Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
E0718 12:43:47.957695   28017 start.go:559] StartHost: create: Error creating machine: Error in driver during machine creation: IP address never found in dhcp leases file Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9

💣  Unable to start VM: create: Error creating machine: Error in driver during machine creation: IP address never found in dhcp leases file Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9
Temporary Error: could not find an IP address for 7a:af:ee:e8:d7:a9

@antoineco Is there a less intrusive option than having to delete the VM as per your comment. My issue is sometimes having the minikube VM failing to start after putting the Mac to sleep. Deleting the VM would make it impossible to continue working existing clusters on minikube.

Would love to hear if there is anything else I can try?

Dear @antoineco, I’ve had problem with HyperKit driver but it IMO was solved by disabling VPN driver. Now I no have problem. Thank you.

@antoineco Thank you for your answer! Sure I’ve tried (many times) do it with have no a result. But when I disabled the ExpressVPN it did worked May be my steps will be useful to somebody:

disable  and quit ExpressVPN
di@💻:kuber$ minikube delete
di@💻:kuber$ rm  -rf ~/.minikube
di@💻:kuber$ sudo rm /var/db/dhcpd_leases
restart docker by menu 
di@💻:kuber$ minikube start --vm-driver hyperkit  -v 10
....
di@💻:kuber$ minikube status
minikube: Running
cluster: Running
kubectl: Correctly Configured: pointing to minikube-vm at 192.168.64.2
di@💻:kuber$ cat /var/db/dhcpd_leases
{
	name=minikube
	ip_address=192.168.64.2
	hw_address=1,2:f4:d4:c4:a0:99
	identifier=1,2:f4:d4:c4:a0:99
	lease=0x5af1527a
}

@antoineco Indeed, merci gamin. When replacing my steps:

$ make out/docker-machine-driver-hyperkit  # build docker-machine-driver-hyperkit
$ export PATH=$PATH:/Users/myuser/dev/go/src/k8s.io/minikube/out/

by:

$ make install-hyperkit-driver

then it works fine, and without sudo.

It also works fine using the official version v0.23.0.

I’ve managed to make it work temporarily by deleting hyperkit.pid and emptying /var/db/dhcpd_leases. But this issue comes back quite often.