kubeadm: kubeadm init --kubernetes-version ci-cross/latest fails to pull the images

Is this a BUG REPORT or FEATURE REQUEST?

Choose one: BUG REPORT

Versions

kubeadm version (use kubeadm version):

root@ip:~ # kubeadm version kubeadm version: &version.Info{Major:“1”, Minor:“12+”, GitVersion:“v1.12.0-alpha.0.2473+fea4ad2783f59d”, GitCommit:“fea4ad2783f59d44cc0db907523a07499db172ec”, GitTreeState:“clean”, BuildDate:“2018-07-27T03:13:19Z”, GoVersion:“go1.10.3”, Compiler:“gc”, Platform:“linux/ppc64le”} root@ip:~ #

Environment:

  • Kubernetes version (use kubectl version): root@ip:~ # kubectl version Client Version: version.Info{Major:“1”, Minor:“12+”, GitVersion:“v1.12.0-alpha.0.2473+fea4ad2783f59d”, GitCommit:“fea4ad2783f59d44cc0db907523a07499db172ec”, GitTreeState:“clean”, BuildDate:“2018-07-27T03:16:27Z”, GoVersion:“go1.10.3”, Compiler:“gc”, Platform:“linux/ppc64le”} The connection to the server ip:8001 was refused - did you specify the right host or port? root@ip:~ #
  • Cloud provider or hardware configuration: ppc64le
  • OS (e.g. from /etc/os-release): root@ip:~ # cat /etc/os-release NAME=“Ubuntu” VERSION=“16.04.4 LTS (Xenial Xerus)” ID=ubuntu ID_LIKE=debian PRETTY_NAME=“Ubuntu 16.04.4 LTS” VERSION_ID=“16.04” HOME_URL=“http://www.ubuntu.com/” SUPPORT_URL=“http://help.ubuntu.com/” BUG_REPORT_URL=“http://bugs.launchpad.net/ubuntu/” VERSION_CODENAME=xenial UBUNTU_CODENAME=xenial root@ip:~ #
  • Kernel (e.g. uname -a): root@ip:~ # uname -a Linux ip 4.4.0-130-generic #156-Ubuntu SMP Thu Jun 14 08:51:21 UTC 2018 ppc64le ppc64le ppc64le GNU/Linux root@ip:~ #
  • Others:

What happened?

root@ip:~ # kubeadm init --kubernetes-version ci-cross/latest [init] using Kubernetes version: v1.12.0-alpha.0.2473+fea4ad2783f59d [preflight] running pre-flight checks I0726 23:51:46.864964 11860 kernel_validator.go:81] Validating kernel version I0726 23:51:46.865467 11860 kernel_validator.go:96] Validating kernel config [WARNING SystemVerification]: docker version is greater than the most recently validated version. Docker version: 18.03.1-ce. Max validated version: 17.03 [WARNING Service-Kubelet]: kubelet service is not enabled, please run ‘systemctl enable kubelet.service’ [preflight/images] Pulling images required for setting up a Kubernetes cluster [preflight/images] This might take a minute or two, depending on the speed of your internet connection [preflight/images] You can also perform this action in beforehand using ‘kubeadm config images pull’ [preflight] Some fatal errors occurred: [ERROR ImagePull]: failed to check if image gcr.io/kubernetes-ci-images/kube-apiserver-ppc64le:v1.12.0-alpha.0.2473_fea4ad2783f59d exists: output: [] Error: No such object: gcr.io/kubernetes-ci-images/kube-apiserver-ppc64le:v1.12.0-alpha.0.2473_fea4ad2783f59d , error: exit status 1 [ERROR ImagePull]: failed to check if image gcr.io/kubernetes-ci-images/kube-controller-manager-ppc64le:v1.12.0-alpha.0.2473_fea4ad2783f59d exists: output: [] Error: No such object: gcr.io/kubernetes-ci-images/kube-controller-manager-ppc64le:v1.12.0-alpha.0.2473_fea4ad2783f59d , error: exit status 1 [ERROR ImagePull]: failed to check if image gcr.io/kubernetes-ci-images/kube-scheduler-ppc64le:v1.12.0-alpha.0.2473_fea4ad2783f59d exists: output: [] Error: No such object: gcr.io/kubernetes-ci-images/kube-scheduler-ppc64le:v1.12.0-alpha.0.2473_fea4ad2783f59d , error: exit status 1 [ERROR ImagePull]: failed to check if image gcr.io/kubernetes-ci-images/kube-proxy-ppc64le:v1.12.0-alpha.0.2473_fea4ad2783f59d exists: output: [] Error: No such object: gcr.io/kubernetes-ci-images/kube-proxy-ppc64le:v1.12.0-alpha.0.2473_fea4ad2783f59d , error: exit status 1 [preflight] If you know what you are doing, you can make a check non-fatal with --ignore-preflight-errors=... root@ip:~ #

What you expected to happen?

cluster should have come up

How to reproduce it (as minimally and precisely as possible)?

run kubeadm init --kubernetes-version ci-cross/latest with latest version of kubeadm on ppc64le

About this issue

  • Original URL
  • State: closed
  • Created 6 years ago
  • Comments: 20 (15 by maintainers)

Commits related to this issue

Most upvoted comments

@rosti

The problem here is that we generate kubeadm packages for ppc, but we don’t have Docker images for it.

but this: docker pull gcr.io/kubernetes-ci-images/kube-apiserver-ppc64le:v1.12.0-alpha.0.2554_24fa5edb60e64b works for me

@bart0sh

It works for me just fine:

hm. my mistake, debugging early in the morning.

I think runtime shoudn’t return error in this case. I’ll prepare PR.

yes, seems like so. it attempts to pull images right after so it should not treat missing images like fatal errors.

@mkumatag @neolit123 let me leave a few notes here that may help.

The build job output for ci-cross is here : http://gcsweb.k8s.io/gcs/kubernetes-jenkins/logs/ci-kubernetes-cross-build/?marker=logs%2Fci-kubernetes-cross-build%2F7153%2F

if you pick one of the runs say : https://storage.googleapis.com/kubernetes-jenkins/logs/ci-kubernetes-cross-build/7141/build-log.txt

you can see the following :

I0618 05:50:28.230] Pushing gcr.io/kubernetes-ci-images/hyperkube-amd64:v1.12.0-alpha.0.1067_6d3f5b75f56323:

So if you run the following you can see the image there …

docker run -it --entrypoint /bin/sh "gcr.io/kubernetes-ci-images/hyperkube:v1.12.0-alpha.0.1067_6d3f5b75f56323"

and if i stick in the version+sha from your output, that image is there too …

docker run -it --entrypoint /bin/sh "gcr.io/kubernetes-ci-images/hyperkube:v1.12.0-alpha.0.2473_fea4ad2783f59d"

You can also go view the images here: https://console.cloud.google.com/gcr/images/kubernetes-ci-images/GLOBAL/kube-apiserver?gcrImageListsize=50

Does that give you enough clues to figure out why kubeadm may be tripping?