rancher: Continuous panics seen when deploying rook

Rancher versions: rancher/server: 2.0-beta3 rancher/agent:

Docker version: (docker version,docker info preferred) 17.03.2-ce Operating system and kernel: (cat /etc/os-release, uname -r preferred) 16.04.4 LTS Type/provider of hosts: (VirtualBox/Bare-metal/AWS/GCE/DO) KVM

Steps to Reproduce: unknown Results: beta3 is crashing repeatedly, cause is unknown. I’ve got only the following logs:

rancher_1  | E0417 11:47:55.668250       1 generic_controller.go:204] ReplicaSetController rook/rook-ceph-mon1 recovered from panic "runtime error: invalid memory address or nil pointer dereference". (err=<nil>) Call stack:
rancher_1  | /go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:72
rancher_1  | /go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:153
rancher_1  | /usr/local/go/src/runtime/asm_amd64.s:509
rancher_1  | /usr/local/go/src/runtime/panic.go:491
rancher_1  | /usr/local/go/src/runtime/panic.go:63
rancher_1  | /usr/local/go/src/runtime/signal_unix.go:367
rancher_1  | /go/src/github.com/rancher/rancher/pkg/controllers/user/endpoints/workload_endpoints.go:42
rancher_1  | /go/src/github.com/rancher/rancher/pkg/controllers/user/endpoints/endpoints.go:79
rancher_1  | /go/src/github.com/rancher/rancher/pkg/controllers/user/workload/workload_common.go:155
rancher_1  | /go/src/github.com/rancher/rancher/pkg/controllers/user/workload/workload_common.go:114
rancher_1  | /go/src/github.com/rancher/rancher/vendor/github.com/rancher/types/apis/apps/v1beta2/zz_generated_replica_set_controller.go:124
rancher_1  | /go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:250
rancher_1  | /go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:190
rancher_1  | /go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:178
rancher_1  | /go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:170
rancher_1  | /go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133
rancher_1  | /go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134
rancher_1  | /go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88
rancher_1  | /usr/local/go/src/runtime/asm_amd64.s:2337
rancher_1  | panic: runtime error: index out of range

About this issue

  • Original URL
  • State: closed
  • Created 6 years ago
  • Comments: 20 (7 by maintainers)

Most upvoted comments

Reproduced on master of 5/30. Can be reproduced using the quick start deploy of Rook: https://github.com/rook/rook/blob/master/Documentation/quickstart.md#tldr

Exactly the same here. Rancher permanently crashes because of the huge amount of log messages in conjunction with rook.