microk8s: microk8s enable cilium has warnings and causes the node to become inaccessible.
After enabling cilium with microk8s cilium enable inbound communication to the node does not work.
ICMP -> node = timeout Node ICMP -> anything = fine SSH -> node = timeout Node ssh -> anything = fine
There were also warnings about depreciated/non functional sections from the helm chart.
Enabled addons:
- cilium
- dns
- ha-cluster
- helm3
- ingress
- metallb
- metrics-server
- storage
The node remains inaccessible after disabling cilium.
After a bit of work to re-run the command from the console session:
:~$ microk8s enable cilium
Addon helm3 is already enabled.
Restarting kube-apiserver
[sudo] password for user:
Restarting kubelet
Enabling Cilium
Fetching cilium version v1.10.
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 131 100 131 0 0 592 0 --:--:-- --:--:-- --:--:-- 592
100 32.2M 100 32.2M 0 0 4466k 0 0:00:07 0:00:07 --:--:-- 4848k
Deploying /var/snap/microk8s/3052/actions/cilium.yaml. This may take several minutes.
serviceaccount/cilium created
serviceaccount/cilium-operator created
configmap/cilium-config created
clusterrole.rbac.authorization.k8s.io/cilium created
clusterrole.rbac.authorization.k8s.io/cilium-operator created
clusterrolebinding.rbac.authorization.k8s.io/cilium created
clusterrolebinding.rbac.authorization.k8s.io/cilium-operator created
Warning: spec.template.spec.affinity.nodeAffinity.requiredDuringSchedulingIgnoredDuringExecution.nod
eSelectorTerms[1].matchExpressions[0].key: beta.kubernetes.io/os is deprecated since v1.14; use "kub
ernetes.io/os" instead
Warning: spec.template.metadata.annotations[scheduler.alpha.kubernetes.io/critical-pod]: non-functio
nal in v1.16+; use the "priorityClassName" field instead
daemonset.apps/cilium created
deployment.apps/cilium-operator created
Waiting for daemon set spec update to be observed...
Waiting for daemon set "cilium" rollout to finish: 0 out of 1 new pods have been updated...
Waiting for daemon set "cilium" rollout to finish: 0 of 1 updated pods are available...
daemon set "cilium" successfully rolled out
Warning: policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use poli
cy/v1 PodDisruptionBudget
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": configmaps "calico-config" not found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": customresourcedefinitions.apiextensions.k8s.io "bgpconfigurations.crd.projectcalico.org" not foun
d
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": customresourcedefinitions.apiextensions.k8s.io "bgppeers.crd.projectcalico.org" not found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": customresourcedefinitions.apiextensions.k8s.io "blockaffinities.crd.projectcalico.org" not found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": customresourcedefinitions.apiextensions.k8s.io "clusterinformations.crd.projectcalico.org" not fo
und
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": customresourcedefinitions.apiextensions.k8s.io "felixconfigurations.crd.projectcalico.org" not fo
und
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": customresourcedefinitions.apiextensions.k8s.io "globalnetworkpolicies.crd.projectcalico.org" not
found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": customresourcedefinitions.apiextensions.k8s.io "globalnetworksets.crd.projectcalico.org" not foun
d
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": customresourcedefinitions.apiextensions.k8s.io "hostendpoints.crd.projectcalico.org" not found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": customresourcedefinitions.apiextensions.k8s.io "ipamblocks.crd.projectcalico.org" not found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": customresourcedefinitions.apiextensions.k8s.io "ipamconfigs.crd.projectcalico.org" not found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": customresourcedefinitions.apiextensions.k8s.io "ipamhandles.crd.projectcalico.org" not found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": customresourcedefinitions.apiextensions.k8s.io "ippools.crd.projectcalico.org" not found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": customresourcedefinitions.apiextensions.k8s.io "kubecontrollersconfigurations.crd.projectcalico.o
rg" not found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": customresourcedefinitions.apiextensions.k8s.io "networkpolicies.crd.projectcalico.org" not found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": customresourcedefinitions.apiextensions.k8s.io "networksets.crd.projectcalico.org" not found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": clusterroles.rbac.authorization.k8s.io "calico-kube-controllers" not found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": clusterrolebindings.rbac.authorization.k8s.io "calico-kube-controllers" not found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": clusterroles.rbac.authorization.k8s.io "calico-node" not found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": clusterrolebindings.rbac.authorization.k8s.io "calico-node" not found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": daemonsets.apps "calico-node" not found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": serviceaccounts "calico-node" not found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": deployments.apps "calico-kube-controllers" not found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": serviceaccounts "calico-kube-controllers" not found
Error from server (NotFound): error when deleting "/var/snap/microk8s/3052/args/cni-network/cni.yaml
": poddisruptionbudgets.policy "calico-kube-controllers" not found
About this issue
- Original URL
- State: closed
- Created 2 years ago
- Reactions: 1
- Comments: 17 (1 by maintainers)
Hi @AllardKrings, the cilium addon is rather outdated and will not work on multi-node clusters. Until we find the right maintenance formula for it, we recommend you follow upstream instructions.