minishift: Cluster up fails with getsockopt: connection refused ()

General information

Minishift version: 1.22
OS: RHEL 7.5
Hypervisor: KVM

Steps to reproduce

[hudson@agajdosi-test1 ~]$ minishift start
-- Starting profile 'minishift'
[...]
   Version: v3.9.0
-- Pulling the Openshift Container Image ........................................ OK
-- Copying oc binary from the OpenShift container image to VM ... OK
-- Starting OpenShift cluster ...........................Error during 'cluster up' execution: Error starting the cluster. ssh command error:
command : /var/lib/minishift/bin/oc cluster up --use-existing-config --host-config-dir /var/lib/minishift/openshift.local.config --host-data-dir /var/lib/minishift/hostdata --host-volumes-dir /var/lib/minishift/openshift.local.volumes --host-pv-dir /var/lib/minishift/openshift.local.pv --public-hostname 192.168.42.206 --routing-suffix 192.168.42.206.nip.io
err     : exit status 1
output  : Using nsenter mounter for OpenShift volumes
Using public hostname IP 192.168.42.206 as the host IP
Using 192.168.42.206 as the server IP
Starting OpenShift using openshift/origin:v3.9.0 ...
-- Starting OpenShift container ... 
   Creating initial OpenShift configuration
   Starting OpenShift using container 'origin'
   Waiting for API server to start listening
FAIL
   Error: timed out waiting for OpenShift container "origin" 
   WARNING: 192.168.42.206:8443 may be blocked by firewall rules
   Details:
     Last 10 lines of "origin" container log:
     E0807 13:04:13.932270    2468 leaderelection.go:224] error retrieving resource lock kube-system/kube-controller-manager: Get https://127.0.0.1:8443/api/v1/namespaces/kube-system/configmaps/kube-controller-manager: net/http: TLS handshake timeout
     E0807 13:04:15.511476    2468 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/kubernetes/plugin/cmd/kube-scheduler/app/server.go:594: Failed to list *v1.Pod: Get https://127.0.0.1:8443/api/v1/pods?fieldSelector=spec.schedulerName%3Ddefault-scheduler%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded&limit=500&resourceVersion=0: net/http: TLS handshake timeout
     E0807 13:04:15.713451    2468 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/client-go/informers/factory.go:86: Failed to list *v1beta1.ReplicaSet: Get https://127.0.0.1:8443/apis/extensions/v1beta1/replicasets?limit=500&resourceVersion=0: net/http: TLS handshake timeout
     E0807 13:04:15.784421    2468 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/client-go/informers/factory.go:86: Failed to list *v1.Node: Get https://127.0.0.1:8443/api/v1/nodes?limit=500&resourceVersion=0: net/http: TLS handshake timeout
     E0807 13:04:15.787247    2468 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/client-go/informers/factory.go:86: Failed to list *v1beta1.StatefulSet: Get https://127.0.0.1:8443/apis/apps/v1beta1/statefulsets?limit=500&resourceVersion=0: net/http: TLS handshake timeout
     E0807 13:04:15.793474    2468 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/client-go/informers/factory.go:86: Failed to list *v1beta1.PodDisruptionBudget: Get https://127.0.0.1:8443/apis/policy/v1beta1/poddisruptionbudgets?limit=500&resourceVersion=0: net/http: TLS handshake timeout
     E0807 13:04:15.795902    2468 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/client-go/informers/factory.go:86: Failed to list *v1.PersistentVolume: Get https://127.0.0.1:8443/api/v1/persistentvolumes?limit=500&resourceVersion=0: net/http: TLS handshake timeout
     E0807 13:04:15.798232    2468 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/client-go/informers/factory.go:86: Failed to list *v1.Service: Get https://127.0.0.1:8443/api/v1/services?limit=500&resourceVersion=0: net/http: TLS handshake timeout
     E0807 13:04:15.802930    2468 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/client-go/informers/factory.go:86: Failed to list *v1.PersistentVolumeClaim: Get https://127.0.0.1:8443/api/v1/persistentvolumeclaims?limit=500&resourceVersion=0: net/http: TLS handshake timeout
     E0807 13:04:15.805170    2468 reflector.go:205] github.com/openshift/origin/vendor/k8s.io/client-go/informers/factory.go:86: Failed to list *v1.ReplicationController: Get https://127.0.0.1:8443/api/v1/replicationcontrollers?limit=500&resourceVersion=0: net/http: TLS handshake timeout


   Solution:
     Ensure that you can access 192.168.42.206:8443 from your machine

Any ideas what to try?

Logs

Full log here: https://gist.github.com/agajdosi/11008377248500a4dd6e9c01607d65f0

About this issue

Original URL
State: closed
Created 6 years ago
Comments: 32 (14 by maintainers)

Most upvoted comments

Running into, what looks like, the same symptom but with CDK 3.5.0-1.

CDK v3.5.0-1 (minishift v1.20.0+1bd6d5c)
OS Windows 10 (1709)
Hypervisor: Hyper-V

About to run SSH command:
/var/lib/minishift/bin/oc cluster up --public-hostname 192.168.10.10 --routing-suffix apps.local.domain.com --base-dir /var/lib/minishift/base
................................................................SSH cmd err, output: exit status 1: Getting a Docker client ...
Checking if image registry.access.redhat.com/openshift3/ose-control-plane:v3.10 is available ...
Checking type of volume mount ...
Determining server IP ...
Using public hostname IP 192.168.10.10 as the host IP
Checking if OpenShift is already running ...
Checking for supported Docker version (=>1.22) ...
Checking if insecured registry is configured properly in Docker ...
Checking if required ports are available ...
Checking if OpenShift client is configured properly ...
Checking if image registry.access.redhat.com/openshift3/ose-control-plane:v3.10 is available ...
Starting OpenShift using registry.access.redhat.com/openshift3/ose-control-plane:v3.10 ...
I0814 05:53:28.142732    3055 config.go:42] Running "create-master-config"
I0814 05:53:31.467132    3055 config.go:46] Running "create-node-config"
I0814 05:53:32.464421    3055 flags.go:30] Running "create-kubelet-flags"
I0814 05:53:33.282728    3055 run_kubelet.go:48] Running "start-kubelet"
I0814 05:53:33.539952    3055 run_self_hosted.go:172] Waiting for the kube-apiserver to be ready ...
E0814 05:58:33.553325    3055 run_self_hosted.go:542] API server error: Get https://192.168.10.10:8443/healthz?timeout=32s: dial tcp 192.168.10.10:8443: getsock                    opt: connection refused ()
Error: timed out waiting for the condition

Error during 'cluster up' execution: Error starting the cluster. ssh command error:
command : /var/lib/minishift/bin/oc cluster up --public-hostname 192.168.10.10 --routing-suffix apps.local.domain.com --base-dir /var/lib/minishift/base
err     : exit status 1
output  : Getting a Docker client ...
Checking if image registry.access.redhat.com/openshift3/ose-control-plane:v3.10 is available ...
Checking type of volume mount ...
Determining server IP ...
Using public hostname IP 192.168.10.10 as the host IP
Checking if OpenShift is already running ...
Checking for supported Docker version (=>1.22) ...
Checking if insecured registry is configured properly in Docker ...
Checking if required ports are available ...
Checking if OpenShift client is configured properly ...
Checking if image registry.access.redhat.com/openshift3/ose-control-plane:v3.10 is available ...
Starting OpenShift using registry.access.redhat.com/openshift3/ose-control-plane:v3.10 ...
I0814 05:53:28.142732    3055 config.go:42] Running "create-master-config"
I0814 05:53:31.467132    3055 config.go:46] Running "create-node-config"
I0814 05:53:32.464421    3055 flags.go:30] Running "create-kubelet-flags"
I0814 05:53:33.282728    3055 run_kubelet.go:48] Running "start-kubelet"
I0814 05:53:33.539952    3055 run_self_hosted.go:172] Waiting for the kube-apiserver to be ready ...
E0814 05:58:33.553325    3055 run_self_hosted.go:542] API server error: Get https://192.168.10.10:8443/healthz?timeout=32s: dial tcp 192.168.10.10:8443: getsock                    opt: connection refused ()
Error: timed out waiting for the condition

pjos on Aug 14, 2018