rancher: Continuous panics seen when deploying rook
Rancher versions: rancher/server: 2.0-beta3 rancher/agent:
Docker version: (docker version
,docker info
preferred)
17.03.2-ce
Operating system and kernel: (cat /etc/os-release
, uname -r
preferred)
16.04.4 LTS
Type/provider of hosts: (VirtualBox/Bare-metal/AWS/GCE/DO)
KVM
Steps to Reproduce: unknown Results: beta3 is crashing repeatedly, cause is unknown. I’ve got only the following logs:
rancher_1 | E0417 11:47:55.668250 1 generic_controller.go:204] ReplicaSetController rook/rook-ceph-mon1 recovered from panic "runtime error: invalid memory address or nil pointer dereference". (err=<nil>) Call stack:
rancher_1 | /go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:72
rancher_1 | /go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:153
rancher_1 | /usr/local/go/src/runtime/asm_amd64.s:509
rancher_1 | /usr/local/go/src/runtime/panic.go:491
rancher_1 | /usr/local/go/src/runtime/panic.go:63
rancher_1 | /usr/local/go/src/runtime/signal_unix.go:367
rancher_1 | /go/src/github.com/rancher/rancher/pkg/controllers/user/endpoints/workload_endpoints.go:42
rancher_1 | /go/src/github.com/rancher/rancher/pkg/controllers/user/endpoints/endpoints.go:79
rancher_1 | /go/src/github.com/rancher/rancher/pkg/controllers/user/workload/workload_common.go:155
rancher_1 | /go/src/github.com/rancher/rancher/pkg/controllers/user/workload/workload_common.go:114
rancher_1 | /go/src/github.com/rancher/rancher/vendor/github.com/rancher/types/apis/apps/v1beta2/zz_generated_replica_set_controller.go:124
rancher_1 | /go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:250
rancher_1 | /go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:190
rancher_1 | /go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:178
rancher_1 | /go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:170
rancher_1 | /go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133
rancher_1 | /go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134
rancher_1 | /go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88
rancher_1 | /usr/local/go/src/runtime/asm_amd64.s:2337
rancher_1 | panic: runtime error: index out of range
About this issue
- Original URL
- State: closed
- Created 6 years ago
- Comments: 20 (7 by maintainers)
Reproduced on
master
of 5/30. Can be reproduced using the quick start deploy of Rook: https://github.com/rook/rook/blob/master/Documentation/quickstart.md#tldrExactly the same here. Rancher permanently crashes because of the huge amount of log messages in conjunction with rook.