rancher: App upgrade failure: panic at go/src/k8s.io/helm/pkg/tiller/release_update.go:166

What kind of request is this (question/bug/enhancement/feature request): panic: runtime error: invalid memory address or nil pointer dereference [signal SIGSEGV: segmentation violation code=0x1 addr=0x50 pc=0x12e8cc8]

goroutine 15 [running]: k8s.io/helm/pkg/tiller.(*ReleaseServer).performUpdateForce(0xc420819860, 0xc42052a8c0, 0x0, 0x0, 0x17b7b40) /go/src/k8s.io/helm/pkg/tiller/release_update.go:166 +0x188 k8s.io/helm/pkg/tiller.(*ReleaseServer).UpdateRelease(0xc420819860, 0x17d8960, 0xc420932210, 0xc42052a8c0, 0xc420819860, 0x16b98a6, 0xd) /go/src/k8s.io/helm/pkg/tiller/release_update.go:43 +0x245 k8s.io/helm/pkg/proto/hapi/services._ReleaseService_UpdateRelease_Handler.func1(0x17d8960, 0xc420932210, 0x16066c0, 0xc42052a8c0, 0x32, 0xc42052aa50, 0x1, 0x1681d11) /go/src/k8s.io/helm/pkg/proto/hapi/services/tiller.pb.go:1244 +0x86 k8s.io/helm/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*ServerMetrics).UnaryServerInterceptor.func1(0x17d8960, 0xc420932210, 0x16066c0, 0xc42052a8c0, 0xc42094e6e0, 0xc42094e700, 0x48, 0xc42094e5c0, 0xc420a37a40, 0x4108c8) /go/src/k8s.io/helm/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/server_metrics.go:86 +0xdb k8s.io/helm/pkg/tiller.newUnaryInterceptor.func1(0x17d8960, 0xc420932210, 0x16066c0, 0xc42052a8c0, 0xc42094e6e0, 0xc42094e700, 0xc420655ab0, 0x4108c8, 0x50, 0x15d88a0) /go/src/k8s.io/helm/pkg/tiller/server.go:60 +0xab k8s.io/helm/pkg/proto/hapi/services._ReleaseService_UpdateRelease_Handler(0x1640500, 0xc420819860, 0x17d8960, 0xc420932210, 0xc42052a870, 0x1715568, 0x0, 0x0, 0xc4207a2800, 0x0) /go/src/k8s.io/helm/pkg/proto/hapi/services/tiller.pb.go:1246 +0x167 k8s.io/helm/vendor/google.golang.org/grpc.(*Server).processUnaryRPC(0xc4200d1540, 0x17e14a0, 0xc42031f1e0, 0xc4204b4100, 0xc4208198f0, 0x2162cf0, 0x0, 0x0, 0x0) /go/src/k8s.io/helm/vendor/google.golang.org/grpc/server.go:826 +0x9c8 k8s.io/helm/vendor/google.golang.org/grpc.(*Server).handleStream(0xc4200d1540, 0x17e14a0, 0xc42031f1e0, 0xc4204b4100, 0x0) /go/src/k8s.io/helm/vendor/google.golang.org/grpc/server.go:1023 +0x1318 k8s.io/helm/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc42080efc0, 0xc4200d1540, 0x17e14a0, 0xc42031f1e0, 0xc4204b4100) /go/src/k8s.io/helm/vendor/google.golang.org/grpc/server.go:572 +0x9f created by k8s.io/helm/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 /go/src/k8s.io/helm/vendor/google.golang.org/grpc/server.go:570 +0xa1 2019/06/23 01:41:27 [ERROR] AppController p-pqlm4/cluster-alerting [helm-controller] failed with : failed to install app cluster-alerting. Error: UPGRADE FAILED: transport is closing

Steps to reproduce (least amount of steps as possible):

Result:

Other details that may be helpful:

Environment information

  • Rancher version (rancher/rancher/rancher/server image tag or shown bottom left in the UI):
  • Installation option (single install/HA):

Cluster information

  • Cluster type (Hosted/Infrastructure Provider/Custom/Imported):
  • Machine type (cloud/VM/metal) and specifications (CPU/memory):
  • Kubernetes version (use kubectl version):
(paste the output here)
  • Docker version (use docker version): 18.09.6-3.el7.x86_64
(paste the output here)

About this issue

  • Original URL
  • State: closed
  • Created 5 years ago
  • Comments: 21 (11 by maintainers)

Most upvoted comments

This error isn’t longhorn specific. We set tiller max history to 1. When the upgrade to 0.6.0 (invalid version) was unsuccessful, the revision created for it went in “PENDING_UPGRADE” state. When rolling back to 0.5.0, tiller tries getting all releases in “DEPLOYED” state. It doesn’t get any, and tries creating a new revision replacing any existing ones. However this is allowed only if the existing revision is in “DELETED” or “FAILED” state. Since the release corresponding to 0.6.0 is still in “PENDING_UPGRADE” this returns an error