kubernetes: [Failing Test] skew-cluster-latest-kubectl-stable1-gce (ci-kubernetes-e2e-gce-master-new-gci-kubectl-skew)

Which jobs are failing: skew-cluster-latest-kubectl-stable1-gce (ci-kubernetes-e2e-gce-master-new-gci-kubectl-skew)

Which test(s) are failing: [sig-cli] Kubectl client kubectl get output should contain custom columns for each resource

Since when has it been failing: 18th Feb 15:58 PST

Testgrid link: https://testgrid.k8s.io/sig-release-master-blocking#skew-cluster-latest-kubectl-stable1-gce

Reason for failure:

I0219 14:19:56.563] Feb 19 14:19:51.041: INFO: stderr: ""
I0219 14:19:56.564] Feb 19 14:19:51.041: INFO: stdout: "NAMESPACE      NAME             MIN AVAILABLE   MAX UNAVAILABLE   ALLOWED DISRUPTIONS   AGE\nkubectl-3164   pdb1fnwxvkq26m   N/A             N/A               0                     1s\n"
I0219 14:19:56.564] Feb 19 14:19:51.159: INFO: Running '/workspace/kubernetes_skew/platforms/linux/amd64/kubectl --server=https://104.196.241.219 --kubeconfig=/workspace/.kube/config get roles --all-namespaces'
I0219 14:19:56.564] Feb 19 14:19:51.520: INFO: stderr: ""
I0219 14:19:56.565] Feb 19 14:19:51.520: INFO: stdout: "NAMESPACE      NAME                                             CREATED AT\nkube-public    system:controller:bootstrap-signer               2020-02-19T14:17:56Z\nkube-system    cloud-provider                                   2020-02-19T14:18:17Z\nkube-system    extension-apiserver-authentication-reader        2020-02-19T14:17:56Z\nkube-system    gce:cloud-provider                               2020-02-19T14:18:17Z\nkube-system    kubernetes-dashboard-minimal                     2020-02-19T14:18:16Z\nkube-system    system::leader-locking-kube-controller-manager   2020-02-19T14:17:56Z\nkube-system    system::leader-locking-kube-scheduler            2020-02-19T14:17:57Z\nkube-system    system:controller:bootstrap-signer               2020-02-19T14:17:56Z\nkube-system    system:controller:cloud-provider                 2020-02-19T14:17:56Z\nkube-system    system:controller:glbc                           2020-02-19T14:18:17Z\nkube-system    system:controller:token-cleaner                  2020-02-19T14:17:56Z\nkube-system    system:fluentd-gcp-scaler                        2020-02-19T14:18:13Z\nkube-system    volume-snapshot-controller-leaderelection        2020-02-19T14:18:15Z\nkubectl-3164   role3fnwxvkq26m                                  2020-02-19T14:19:51Z\n"
I0219 14:19:56.566] Feb 19 14:19:51.520: FAIL: expected non-default fields for namespaced resource: roles
I0219 14:19:56.566] Expected
I0219 14:19:56.566]     <[]string | len:4, cap:4>: ["NAMESPACE", "NAME", "CREATED", "AT"]
I0219 14:19:56.566] not to equal
I0219 14:19:56.566]     <[]string | len:4, cap:4>: ["NAMESPACE", "NAME", "CREATED", "AT"]
I0219 14:19:56.566] [AfterEach] [sig-cli] Kubectl client
skipped 215 lines unfold_more
I0219 14:19:56.633] Latency metrics for node bootstrap-e2e-minion-group-g65p
I0219 14:19:56.633] Feb 19 14:19:56.217: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
I0219 14:19:56.633] STEP: Destroying namespace "kubectl-3164" for this suite.
I0219 14:19:56.633] 
I0219 14:19:56.634] 
I0219 14:19:56.634] • Failure [23.237 seconds]
I0219 14:19:56.634] [sig-cli] Kubectl client
I0219 14:19:56.634] /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/framework.go:23
I0219 14:19:56.634]   kubectl get output
I0219 14:19:56.634]   /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:422
I0219 14:19:56.635]     should contain custom columns for each resource [It]
skipped 2619 lines unfold_more
I0219 14:20:48.207] 
I0219 14:20:48.208] [Fail] [sig-cli] Kubectl client kubectl get output [It] should contain custom columns for each resource 
I0219 14:20:48.208] /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:2630
I0219 14:20:48.209] 
I0219 14:20:48.210] Ran 55 of 4843 Specs in 87.006 seconds
I0219 14:20:48.210] FAIL! -- 54 Passed | 1 Failed | 0 Pending | 4788 Skipped

Anything else we need to know: /sig cli /cc @kubernetes/ci-signal /priority critical-urgent /milestone v1.18 /cc @soltysh

About this issue

  • Original URL
  • State: closed
  • Created 4 years ago
  • Comments: 18 (18 by maintainers)

Most upvoted comments

https://github.com/kubernetes/test-infra/blob/d766f5c0c27cea83aefcbbeed9b79ab8b0da0225/kubetest/extract_k8s.go#L145

https://github.com/kubernetes/test-infra/blob/master/kubetest/e2e.go#L186

The --extract=ci/k8s-stable1 downloads and extracts this into the kubernetes dir The second --extract=ci/latest renames the k8s-stable1 kubernetes dir as kubernetes_skew and then downloads latest into a new kubernetes. The --skew flag causes it to run tests in kubernetes_skew.

Thus the expected behavior is:

  • kubernetes_skew has k8s-stable1
  • kubernetes has latest
  • Tests run from the kubernetes_skew dir, aka k8s-stable1

this doesn’t appear to be get-kube issues currently at least.

I0227 06:19:37.098] Feb 27 06:19:32.528: FAIL: expected non-default fields for namespaced resource: roles
I0227 06:19:37.098] Expected
I0227 06:19:37.098]     <[]string | len:4, cap:4>: ["NAMESPACE", "NAME", "CREATED", "AT"]
I0227 06:19:37.099] not to equal
I0227 06:19:37.099]     <[]string | len:4, cap:4>: ["NAMESPACE", "NAME", "CREATED", "AT"]

what a great error 😕 /remove-sig testing /sig cli @kubernetes/sig-cli-test-failures