kops: NODEUP Error got error running nodeup (will retry in 30s): error building loader: error finding containerd version

1. What kops version are you running? The command kops version, will display this information. 1.19.9

2. What Kubernetes version are you running? kubectl version will print the version if a cluster is running or provide the Kubernetes version specified as a kops flag.

Client Version: version.Info{Major:“1”, Minor:“18”, GitVersion:“v1.18.6”, GitCommit:“dff82dc0de47299ab66c83c626e08b245ab19037”, GitTreeState:“clean”, BuildDate:“2020-07-15T16:58:53Z”, GoVersion:“go1.13.9”, Compiler:“gc”, Platform:“darwin/amd64”} The connection to the server api.xxxxx.com was refused - did you specify the right host or port?

3. What cloud provider are you using? AWS

4. What commands did you run? What is the simplest way to reproduce this issue? Initiate my autoscaling nodes in AWS - I have 1 master node, and 2 worker nodes in each of the three availability zones

5. What happened after the commands executed? Nothing, my master node fails to come up

6. What did you expect to happen? My master mode would come up and I would be able to use LENS to connect on 443 to view the nodes/pods

7. Please provide your cluster manifest. Execute kops get --name my.example.com -o yaml to display your cluster manifest. You may want to remove your cluster name and other sensitive information.

apiVersion: kops.k8s.io/v1alpha2
kind: Cluster
metadata:
  creationTimestamp: "2018-05-24T14:02:57Z"
  generation: 16
  name: xxx.com
spec:
  api:
    dns: {}
  authorization:
    rbac: {}
  channel: stable
  cloudProvider: aws
  configBase: s3://xxx.com
  etcdClusters:
  - etcdMembers:
    - instanceGroup: master-eu-west-1a
      name: a
    name: main
  - etcdMembers:
    - instanceGroup: master-eu-west-1a
      name: a
    name: events
  iam:
    allowContainerRegistry: true
    legacy: false
  kubernetesApiAccess:
  - 0.0.0.0/0
  kubernetesVersion: 1.18.0
  masterInternalName: api.internal.xxx.com
  masterPublicName: api.xxx.com
  networkCIDR: 172.20.0.0/16
  networking:
    kubenet: {}
  nonMasqueradeCIDR: 100.64.0.0/10
  sshAccess:
  - 0.0.0.0/0
  subnets:
  - cidr: 172.20.32.0/19
    name: eu-west-1a
    type: Public
    zone: eu-west-1a
  - cidr: 172.20.64.0/19
    name: eu-west-1b
    type: Public
    zone: eu-west-1b
  - cidr: 172.20.96.0/19
    name: eu-west-1c
    type: Public
    zone: eu-west-1c
  topology:
    dns:
      type: Public
    masters: public
    nodes: public

---

apiVersion: kops.k8s.io/v1alpha2
kind: InstanceGroup
metadata:
  creationTimestamp: "2019-09-04T10:15:09Z"
  generation: 1
  labels:
    kops.k8s.io/cluster: xxx.com
  name: large-nodes
spec:
  image: kope.io/k8s-1.12-debian-stretch-amd64-hvm-ebs-2019-06-21
  machineType: m4.2xlarge
  maxPrice: "0.25"
  maxSize: 2
  minSize: 2
  nodeLabels:
    kops.k8s.io/instancegroup: large-nodes
  role: Node
  subnets:
  - eu-west-1a
  - eu-west-1b
  - eu-west-1c

---

apiVersion: kops.k8s.io/v1alpha2
kind: InstanceGroup
metadata:
  creationTimestamp: "2018-05-24T14:02:57Z"
  labels:
    kops.k8s.io/cluster: xxx.com
  name: master-eu-west-1a
spec:
  image: kope.io/k8s-1.12-debian-stretch-amd64-hvm-ebs-2019-05-13
  machineType: m4.large
  maxPrice: "0.10"
  maxSize: 1
  minSize: 1
  nodeLabels:
    kops.k8s.io/instancegroup: master-eu-west-1a
  role: Master
  subnets:
  - eu-west-1a

---

apiVersion: kops.k8s.io/v1alpha2
kind: InstanceGroup
metadata:
  creationTimestamp: "2018-05-24T14:02:57Z"
  generation: 1
  labels:
    kops.k8s.io/cluster: xxx.com
  name: nodes
spec:
  image: kope.io/k8s-1.16-debian-stretch-amd64-hvm-ebs-2020-01-17
  machineType: m4.xlarge
  maxPrice: "0.25"
  maxSize: 2
  minSize: 2
  nodeLabels:
    kops.k8s.io/instancegroup: nodes
  role: Node
  subnets:
  - eu-west-1a
  - eu-west-1b
  - eu-west-1c

8. Please run the commands with most verbose logging by adding the -v 10 flag. Paste the logs into this report, or in a gist and provide the gist link here.

My nodes not up so not sure what I can run

9. Anything else do we need to know?

When I view the system.log in the EC2 instance I see this I think the last error is significant, but I have no idea why this has all stopped when it was running smoothly.

however I can SSH to the instance and run “docker version”

admin@ip-172-20-55-65:~$ docker version
Client:
 Version:           18.06.3-ce
 API version:       1.38
 Go version:        go1.10.3
 Git commit:        d7080c1
 Built:             Wed Feb 20 02:28:26 2019
 OS/Arch:           linux/amd64
 Experimental:      false
Got permission denied while trying to connect to the Docker daemon socket at unix:///var/run/docker.sock: Get http://%2Fvar%2Frun%2Fdocker.sock/v1.38/version: dial unix /var/run/docker.sock: connect: permission denied
admin@ip-172-20-55-65:~$ 

SYSLOG:

Feb 20 14:32:34 ip-172-20-55-65 cloud-init[743]: Downloading nodeup (https://artifacts.k8s.io/binaries/kops/1.18.2/linux/amd64/nodeup https://github.com/kubernetes/kops/releases/download/v1.18.2/linux-amd64-nodeup https://kubeupv2.s3.amazonaws.com/kops/1.18.2/linux/amd64/nodeup)
Feb 20 14:32:34 ip-172-20-55-65 cloud-init[743]: Attempting download with: curl -f --ipv4 --compressed -Lo nodeup --connect-timeout 20 --retry 6 --retry-delay 10 {url}
Feb 20 14:32:34 ip-172-20-55-65 cloud-init[743]:   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
Feb 20 14:32:34 ip-172-20-55-65 cloud-init[743]:                                  Dload  Upload   Total   Spent    Left  Speed
Feb 20 14:32:34 ip-172-20-55-65 ntpd[563]: Soliciting pool server 64.62.190.177
Feb 20 14:32:34 ip-172-20-55-65 ntpd[563]: Soliciting pool server 163.237.218.19
Feb 20 14:32:34 ip-172-20-55-65 ntpd[563]: Soliciting pool server 162.159.200.123
Feb 20 14:32:34 ip-172-20-55-65 ntpd[563]: Soliciting pool server 144.172.118.20
Feb 20 14:32:35 ip-172-20-55-65 ntpd[563]: Soliciting pool server 85.91.1.180
Feb 20 14:32:35 ip-172-20-55-65 ntpd[563]: Soliciting pool server 192.81.135.252
Feb 20 14:32:35 ip-172-20-55-65 ntpd[563]: Soliciting pool server 198.60.22.240
Feb 20 14:32:35 ip-172-20-55-65 ntpd[563]: Soliciting pool server 216.229.0.50
Feb 20 14:32:35 ip-172-20-55-65 cloud-init[743]: #015  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0#015 35 75.3M   35 26.7M    0     0  30.3M      0  0:00:02 --:--:--  0:00:02 30.3M#015100 75.3M  100 75.3M    0     0  47.1M      0  0:00:01  0:00:01 --:--:-- 47.1M
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: == Downloaded https://artifacts.k8s.io/binaries/kops/1.18.2/linux/amd64/nodeup (SHA1 = 25e9b6ddc3bc4d1a272cd9e06acf3334025f40bde02ef1fa6496d8ac105ddc23) ==
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: Running nodeup
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: nodeup version 1.18.2 (git-84495481e4)
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: I0220 14:32:36.398023     820 install.go:194] Built service manifest "kops-configuration.service"
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: [Unit]
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: Description=Run kops bootstrap (nodeup)
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: Documentation=https://github.com/kubernetes/kops
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: [Service]
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: Environment="AWS_REGION=eu-west-1"
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: EnvironmentFile=/etc/environment
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: ExecStart=/opt/kops/bin/nodeup --conf=/opt/kops/conf/kube_env.yaml --v=8
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: Type=oneshot
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: [Install]
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: WantedBy=multi-user.target
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: I0220 14:32:36.398068     820 task.go:97] task *nodetasks.Service does not implement HasLifecycle
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: I0220 14:32:36.398082     820 install.go:68] No package task found; won't update packages
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: I0220 14:32:36.436973     820 topological_sort.go:64] Dependencies:
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: I0220 14:32:36.437028     820 topological_sort.go:66] #011Service/kops-configuration.service:#011[]
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: I0220 14:32:36.437079     820 executor.go:103] Tasks: 0 done / 1 total; 1 can run
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: I0220 14:32:36.437138     820 executor.go:174] Executing task "Service/kops-configuration.service": Service: kops-configuration.service
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: I0220 14:32:36.437307     820 changes.go:81] Field changed "Definition" actual="<nil>" expected="[Unit]\nDescription=Run kops bootstrap (nodeup)\nDocumentation=https://github.com/kubernetes/kops\n\n[Service]\nEnvironment=\"AWS_REGION=eu-west-1\" \nEnvironmentFile=/etc/environment\nExecStart=/opt/kops/bin/nodeup --conf=/opt/kops/conf/kube_env.yaml --v=8\nType=oneshot\n\n[Install]\nWantedBy=multi-user.target\n"
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: I0220 14:32:36.437378     820 changes.go:81] Field changed "Running" actual="false" expected="true"
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: I0220 14:32:36.437409     820 changes.go:81] Field changed "Enabled" actual="<nil>" expected="true"
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: I0220 14:32:36.437432     820 changes.go:81] Field changed "ManageState" actual="<nil>" expected="true"
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: I0220 14:32:36.437457     820 changes.go:81] Field changed "SmartRestart" actual="<nil>" expected="true"
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: I0220 14:32:36.437653     820 files.go:50] Writing file "/lib/systemd/system/kops-configuration.service"
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: I0220 14:32:36.437779     820 service.go:266] Reloading systemd configuration
Feb 20 14:32:36 ip-172-20-55-65 systemd[1]: Reloading.
Feb 20 14:32:36 ip-172-20-55-65 ntpd[563]: Soliciting pool server 44.4.53.2
Feb 20 14:32:36 ip-172-20-55-65 ntpd[563]: Soliciting pool server 45.79.109.111
Feb 20 14:32:36 ip-172-20-55-65 cloud-init[743]: I0220 14:32:36.572542     820 service.go:329] Restarting service "kops-configuration.service"
Feb 20 14:32:36 ip-172-20-55-65 systemd[1]: Starting Run kops bootstrap (nodeup)...
Feb 20 14:32:36 ip-172-20-55-65 nodeup[865]: nodeup version 1.18.2 (git-84495481e4)
Feb 20 14:32:36 ip-172-20-55-65 nodeup[865]: I0220 14:32:36.607480     865 http.go:78] Downloading "https://storage.googleapis.com/kubernetes-release/release/v1.19.1/bin/linux/amd64/kubelet"
Feb 20 14:32:37 ip-172-20-55-65 ntpd[563]: Soliciting pool server 2001:470:1f06:56f::2
Feb 20 14:32:37 ip-172-20-55-65 ntpd[563]: Soliciting pool server 103.149.144.100
Feb 20 14:32:38 ip-172-20-55-65 nodeup[865]: I0220 14:32:38.746598     865 files.go:100] Hash matched for "/var/cache/nodeup/sha256:2ca2a3104d4cce26db128e3a0b7a042385df4f2c51bdbe740e067fdfaa2fcdd1_https___storage_googleapis_com_kubernetes-release_release_v1_19_1_bin_linux_amd64_kubelet": sha256:2ca2a3104d4cce26db128e3a0b7a042385df4f2c51bdbe740e067fdfaa2fcdd1
Feb 20 14:32:38 ip-172-20-55-65 nodeup[865]: I0220 14:32:38.747215     865 assetstore.go:225] added asset "kubelet" for &{"/var/cache/nodeup/sha256:2ca2a3104d4cce26db128e3a0b7a042385df4f2c51bdbe740e067fdfaa2fcdd1_https___storage_googleapis_com_kubernetes-release_release_v1_19_1_bin_linux_amd64_kubelet"}
Feb 20 14:32:38 ip-172-20-55-65 nodeup[865]: I0220 14:32:38.761753     865 http.go:78] Downloading "https://storage.googleapis.com/kubernetes-release/release/v1.19.1/bin/linux/amd64/kubectl"
Feb 20 14:32:39 ip-172-20-55-65 nodeup[865]: I0220 14:32:39.817525     865 files.go:100] Hash matched for "/var/cache/nodeup/sha256:da4de99d4e713ba0c0a5ef6efe1806fb09c41937968ad9da5c5f74b79b3b38f5_https___storage_googleapis_com_kubernetes-release_release_v1_19_1_bin_linux_amd64_kubectl": sha256:da4de99d4e713ba0c0a5ef6efe1806fb09c41937968ad9da5c5f74b79b3b38f5
Feb 20 14:32:39 ip-172-20-55-65 nodeup[865]: I0220 14:32:39.817581     865 assetstore.go:225] added asset "kubectl" for &{"/var/cache/nodeup/sha256:da4de99d4e713ba0c0a5ef6efe1806fb09c41937968ad9da5c5f74b79b3b38f5_https___storage_googleapis_com_kubernetes-release_release_v1_19_1_bin_linux_amd64_kubectl"}
Feb 20 14:32:39 ip-172-20-55-65 nodeup[865]: I0220 14:32:39.817718     865 http.go:78] Downloading "https://storage.googleapis.com/k8s-artifacts-cni/release/v0.8.6/cni-plugins-linux-amd64-v0.8.6.tgz"
Feb 20 14:32:40 ip-172-20-55-65 nodeup[865]: I0220 14:32:40.731252     865 files.go:100] Hash matched for "/var/cache/nodeup/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz": sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5
Feb 20 14:32:40 ip-172-20-55-65 nodeup[865]: I0220 14:32:40.731304     865 assetstore.go:225] added asset "cni-plugins-linux-amd64-v0.8.6.tgz" for &{"/var/cache/nodeup/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz"}
Feb 20 14:32:40 ip-172-20-55-65 nodeup[865]: I0220 14:32:40.731549     865 assetstore.go:296] running extract command [tar zxf /var/cache/nodeup/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz -C /var/cache/nodeup/extracted/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz.tmp-1613831560731356024]
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.470848     865 assetstore.go:335] added asset "bandwidth" for &{"/var/cache/nodeup/extracted/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz/bandwidth"}
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.471464     865 assetstore.go:335] added asset "bridge" for &{"/var/cache/nodeup/extracted/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz/bridge"}
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.471504     865 assetstore.go:335] added asset "dhcp" for &{"/var/cache/nodeup/extracted/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz/dhcp"}
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.471529     865 assetstore.go:335] added asset "firewall" for &{"/var/cache/nodeup/extracted/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz/firewall"}
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.471555     865 assetstore.go:335] added asset "flannel" for &{"/var/cache/nodeup/extracted/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz/flannel"}
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.471581     865 assetstore.go:335] added asset "host-device" for &{"/var/cache/nodeup/extracted/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz/host-device"}
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.471612     865 assetstore.go:335] added asset "host-local" for &{"/var/cache/nodeup/extracted/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz/host-local"}
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.471636     865 assetstore.go:335] added asset "ipvlan" for &{"/var/cache/nodeup/extracted/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz/ipvlan"}
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.471661     865 assetstore.go:335] added asset "loopback" for &{"/var/cache/nodeup/extracted/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz/loopback"}
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.471689     865 assetstore.go:335] added asset "macvlan" for &{"/var/cache/nodeup/extracted/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz/macvlan"}
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.471714     865 assetstore.go:335] added asset "portmap" for &{"/var/cache/nodeup/extracted/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz/portmap"}
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.471745     865 assetstore.go:335] added asset "ptp" for &{"/var/cache/nodeup/extracted/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz/ptp"}
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.471770     865 assetstore.go:335] added asset "sbr" for &{"/var/cache/nodeup/extracted/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz/sbr"}
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.471794     865 assetstore.go:335] added asset "static" for &{"/var/cache/nodeup/extracted/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz/static"}
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.471818     865 assetstore.go:335] added asset "tuning" for &{"/var/cache/nodeup/extracted/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz/tuning"}
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.471842     865 assetstore.go:335] added asset "vlan" for &{"/var/cache/nodeup/extracted/sha256:994fbfcdbb2eedcfa87e48d8edb9bb365f4e2747a7e47658482556c12fd9b2f5_https___storage_googleapis_com_k8s-artifacts-cni_release_v0_8_6_cni-plugins-linux-amd64-v0_8_6_tgz/vlan"}
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.504772     865 s3context.go:213] found bucket in region "eu-west-1"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.504803     865 s3fs.go:290] Reading file "s3://acme-kops-state/xxx.com/cluster.spec"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.553987     865 s3fs.go:290] Reading file "s3://acme-kops-state/xxx.com/instancegroup/master-eu-west-1a"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.794232     865 command.go:606] Using supported docker storage "overlay2"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.794298     865 command.go:181] Config tags: [_automatic_upgrades _aws]
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.794318     865 command.go:182] OS tags: [_debian_family _systemd]
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.794330     865 command.go:195] Building SecretStore at "s3://acme-kops-state/xxx.com/secrets"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.794352     865 command.go:207] Building KeyStore at "s3://acme-kops-state/xxx.com/pki"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.794374     865 command.go:646] Doing modprobe for module br_netfilter
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796627     865 tree_walker.go:98] visit "nodeup/_automatic_upgrades"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796664     865 tree_walker.go:125] Descending into directory, as tag is present: "nodeup/_automatic_upgrades"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796678     865 tree_walker.go:98] visit "nodeup/_automatic_upgrades/_debian_family"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796693     865 tree_walker.go:125] Descending into directory, as tag is present: "nodeup/_automatic_upgrades/_debian_family"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796706     865 tree_walker.go:98] visit "nodeup/_automatic_upgrades/_debian_family/files"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796724     865 tree_walker.go:98] visit "nodeup/_automatic_upgrades/_debian_family/files/etc"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796743     865 tree_walker.go:98] visit "nodeup/_automatic_upgrades/_debian_family/files/etc/apt"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796762     865 tree_walker.go:98] visit "nodeup/_automatic_upgrades/_debian_family/files/etc/apt/apt.conf.d"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796781     865 tree_walker.go:98] visit "nodeup/_automatic_upgrades/_debian_family/files/etc/apt/apt.conf.d/20auto-upgrades"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796798     865 tree_walker.go:98] visit "nodeup/_automatic_upgrades/_debian_family/packages"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796815     865 tree_walker.go:98] visit "nodeup/_automatic_upgrades/_debian_family/packages/unattended-upgrades"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796834     865 tree_walker.go:98] visit "nodeup/resources"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796850     865 tree_walker.go:98] visit "nodeup/resources/_lyft_vpc_cni"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796867     865 tree_walker.go:121] Skipping directory "nodeup/resources/_lyft_vpc_cni" as tag "_lyft_vpc_cni" not present
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796882     865 tree_walker.go:98] visit "nodeup/_automatic_upgrades"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796895     865 tree_walker.go:125] Descending into directory, as tag is present: "nodeup/_automatic_upgrades"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796906     865 tree_walker.go:98] visit "nodeup/_automatic_upgrades/_debian_family"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796921     865 tree_walker.go:125] Descending into directory, as tag is present: "nodeup/_automatic_upgrades/_debian_family"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796934     865 tree_walker.go:98] visit "nodeup/_automatic_upgrades/_debian_family/files"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796953     865 tree_walker.go:98] visit "nodeup/_automatic_upgrades/_debian_family/files/etc"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796969     865 tree_walker.go:98] visit "nodeup/_automatic_upgrades/_debian_family/files/etc/apt"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.796986     865 tree_walker.go:98] visit "nodeup/_automatic_upgrades/_debian_family/files/etc/apt/apt.conf.d"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797005     865 tree_walker.go:98] visit "nodeup/_automatic_upgrades/_debian_family/files/etc/apt/apt.conf.d/20auto-upgrades"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797027     865 loader.go:250] path "nodeup/_automatic_upgrades/_debian_family/files/etc/apt/apt.conf.d/20auto-upgrades" -> task File: "/etc/apt/apt.conf.d/20auto-upgrades"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797058     865 tree_walker.go:98] visit "nodeup/_automatic_upgrades/_debian_family/packages"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797076     865 tree_walker.go:98] visit "nodeup/_automatic_upgrades/_debian_family/packages/unattended-upgrades"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797103     865 tree_walker.go:98] visit "nodeup/resources"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797120     865 tree_walker.go:98] visit "nodeup/resources/_lyft_vpc_cni"
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797136     865 tree_walker.go:121] Skipping directory "nodeup/resources/_lyft_vpc_cni" as tag "_lyft_vpc_cni" not present
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797153     865 task.go:97] task *nodetasks.Package does not implement HasLifecycle
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797171     865 task.go:97] task *nodetasks.File does not implement HasLifecycle
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797184     865 task.go:97] task *nodetasks.Service does not implement HasLifecycle
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797203     865 task.go:97] task *nodetasks.Package does not implement HasLifecycle
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797212     865 task.go:97] task *nodetasks.Package does not implement HasLifecycle
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797221     865 task.go:97] task *nodetasks.Package does not implement HasLifecycle
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797230     865 task.go:97] task *nodetasks.Package does not implement HasLifecycle
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797242     865 task.go:97] task *nodetasks.Package does not implement HasLifecycle
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797250     865 task.go:97] task *nodetasks.Package does not implement HasLifecycle
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797267     865 update_service.go:42] UpdatePolicy not set in Cluster Spec; skipping creation of update-service
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797281     865 volumes.go:40] Skipping the volume builder, no volumes defined for this instancegroup
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797292     865 task.go:97] task *nodetasks.File does not implement HasLifecycle
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: I0220 14:32:41.797302     865 task.go:97] task *nodetasks.File does not implement HasLifecycle
Feb 20 14:32:41 ip-172-20-55-65 nodeup[865]: W0220 14:32:41.797319     865 main.go:138] got error running nodeup (will retry in 30s): error building loader: error finding containerd version