external-secrets: Controller CrashLoopBackOff after upgrade to 0.5.0

Describe the solution you’d like Possibly the wrong endpoint is being called after upgrading to chart 0.5.0.

Give us examples of the outcome

❯ kubectl get clustersecretstores.v1beta1.external-secrets.io
Error from server: conversion webhook for external-secrets.io/v1alpha1, Kind=ClusterSecretStore failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

❯ kubectl get clustersecretstores.v1alpha1.external-secrets.io
Warning: external-secrets.io/v1alpha1 ClusterSecretStore is deprecated; use external-secrets.io/v1beta1 ClusterSecretStore
NAME           AGE   STATUS
google-cloud   8d    Valid

Observations (Constraints, Context, etc):

❯ kubectl version
Client Version: version.Info{Major:"1", Minor:"22", GitVersion:"v1.22.5", GitCommit:"5c99e2ac2ff9a3c549d9ca665e7bc05a3e18f07e", GitTreeState:"clean", BuildDate:"2021-12-16T08:38:33Z", GoVersion:"go1.16.12", Compiler:"gc", Platform:"darwin/amd64"}
Server Version: version.Info{Major:"1", Minor:"23", GitVersion:"v1.23.4-gke.1600", GitCommit:"150429c27c90cb27a70ab5eab35dfef7b01b3381", GitTreeState:"clean", BuildDate:"2022-03-11T09:26:55Z", GoVersion:"go1.17.7b7", Compiler:"gc", Platform:"linux/amd64"}

Deployment: helm-chart 0.5.0

  values:
    ingress:
      annotations:
        cert-manager.io/cluster-issuer: letsencrypt
        ingress.kubernetes.io/ssl-redirect: "true"
      className: haproxy
      enabled: false

Controller also CrashLoopBackOff due to this.

❯ kubectl get pods 
NAME                                               READY   STATUS             RESTARTS       AGE
external-secrets-74f8b78697-hlxdc                  0/1     CrashLoopBackOff   5 (112s ago)   16m
external-secrets-cert-controller-8c6756b45-l2sbm   1/1     Running            0              16m
external-secrets-webhook-6769b646c4-vv645          1/1     Running            0              16m

❯ kubectl logs --tail=-1 --timestamps external-secrets-74f8b78697-hlxdc
2022-04-05T16:39:42.247329450Z I0405 16:39:42.246955       1 request.go:665] Waited for 1.036044731s due to client-side throttling, not priority and fairness, request: GET:https://10.52.0.1:443/apis/acme.cert-manager.io/v1?timeout=32s
2022-04-05T16:39:42.701256019Z {"level":"info","ts":1649176782.7011034,"logger":"controller-runtime.metrics","msg":"Metrics server is starting to listen","addr":":8080"}
2022-04-05T16:39:42.701950082Z {"level":"info","ts":1649176782.7017944,"logger":"setup","msg":"starting manager"}
2022-04-05T16:39:42.703415794Z {"level":"info","ts":1649176782.7022958,"msg":"Starting server","path":"/metrics","kind":"metrics","addr":"[::]:8080"}
2022-04-05T16:39:42.703435259Z {"level":"info","ts":1649176782.7024202,"logger":"controller.externalsecret","msg":"Starting EventSource","reconciler group":"external-secrets.io","reconciler kind":"ExternalSecret","source":"kind source: *v1beta1.ExternalSecret"}
2022-04-05T16:39:42.703457753Z {"level":"info","ts":1649176782.7024615,"logger":"controller.clustersecretstore","msg":"Starting EventSource","reconciler group":"external-secrets.io","reconciler kind":"ClusterSecretStore","source":"kind source: *v1beta1.ClusterSecretStore"}
2022-04-05T16:39:42.703469658Z {"level":"info","ts":1649176782.702492,"logger":"controller.externalsecret","msg":"Starting EventSource","reconciler group":"external-secrets.io","reconciler kind":"ExternalSecret","source":"kind source: *v1.PartialObjectMetadata"}
2022-04-05T16:39:42.703475297Z {"level":"info","ts":1649176782.7024887,"logger":"controller.clustersecretstore","msg":"Starting Controller","reconciler group":"external-secrets.io","reconciler kind":"ClusterSecretStore"}
2022-04-05T16:39:42.703480294Z {"level":"info","ts":1649176782.702507,"logger":"controller.externalsecret","msg":"Starting Controller","reconciler group":"external-secrets.io","reconciler kind":"ExternalSecret"}
2022-04-05T16:39:42.703485492Z {"level":"info","ts":1649176782.702714,"logger":"controller.clusterexternalsecret","msg":"Starting EventSource","reconciler group":"external-secrets.io","reconciler kind":"ClusterExternalSecret","source":"kind source: *v1beta1.ClusterExternalSecret"}
2022-04-05T16:39:42.703490888Z {"level":"info","ts":1649176782.7027214,"logger":"controller.secretstore","msg":"Starting EventSource","reconciler group":"external-secrets.io","reconciler kind":"SecretStore","source":"kind source: *v1beta1.SecretStore"}
2022-04-05T16:39:42.703496316Z {"level":"info","ts":1649176782.702742,"logger":"controller.secretstore","msg":"Starting Controller","reconciler group":"external-secrets.io","reconciler kind":"SecretStore"}
2022-04-05T16:39:42.703501154Z {"level":"info","ts":1649176782.7027383,"logger":"controller.clusterexternalsecret","msg":"Starting EventSource","reconciler group":"external-secrets.io","reconciler kind":"ClusterExternalSecret","source":"kind source: *v1.PartialObjectMetadata"}
2022-04-05T16:39:42.703506531Z {"level":"info","ts":1649176782.7027738,"logger":"controller.clusterexternalsecret","msg":"Starting Controller","reconciler group":"external-secrets.io","reconciler kind":"ClusterExternalSecret"}
2022-04-05T16:40:12.711668132Z W0405 16:40:12.711256       1 reflector.go:324] pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.PartialObjectMetadata: conversion webhook for external-secrets.io/v1alpha1, Kind=ExternalSecret failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": dial tcp 10.56.2.69:9443: i/o timeout (Client.Timeout exceeded while awaiting headers)
2022-04-05T16:40:12.711736517Z W0405 16:40:12.711332       1 reflector.go:324] pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1beta1.ClusterSecretStore: conversion webhook for external-secrets.io/v1alpha1, Kind=ClusterSecretStore failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2022-04-05T16:40:12.711850235Z I0405 16:40:12.711365       1 trace.go:205] Trace[305231242]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167 (05-Apr-2022 16:39:42.702) (total time: 30008ms):
2022-04-05T16:40:12.711863436Z Trace[305231242]: ---"Objects listed" error:conversion webhook for external-secrets.io/v1alpha1, Kind=ExternalSecret failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": dial tcp 10.56.2.69:9443: i/o timeout (Client.Timeout exceeded while awaiting headers) 30008ms (16:40:12.711)
2022-04-05T16:40:12.711870188Z Trace[305231242]: [30.008366404s] [30.008366404s] END
2022-04-05T16:40:12.711880533Z E0405 16:40:12.711385       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: conversion webhook for external-secrets.io/v1alpha1, Kind=ExternalSecret failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": dial tcp 10.56.2.69:9443: i/o timeout (Client.Timeout exceeded while awaiting headers)
2022-04-05T16:40:12.711885391Z I0405 16:40:12.711390       1 trace.go:205] Trace[152117410]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167 (05-Apr-2022 16:39:42.703) (total time: 30008ms):
2022-04-05T16:40:12.711892310Z Trace[152117410]: ---"Objects listed" error:conversion webhook for external-secrets.io/v1alpha1, Kind=ClusterSecretStore failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 30008ms (16:40:12.711)
2022-04-05T16:40:12.711897486Z Trace[152117410]: [30.00821905s] [30.00821905s] END
2022-04-05T16:40:12.711902781Z E0405 16:40:12.711422       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1beta1.ClusterSecretStore: failed to list *v1beta1.ClusterSecretStore: conversion webhook for external-secrets.io/v1alpha1, Kind=ClusterSecretStore failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2022-04-05T16:40:12.711908070Z W0405 16:40:12.711505       1 reflector.go:324] pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1beta1.ExternalSecret: conversion webhook for external-secrets.io/v1alpha1, Kind=ExternalSecret failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2022-04-05T16:40:12.711913198Z I0405 16:40:12.711535       1 trace.go:205] Trace[617299536]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167 (05-Apr-2022 16:39:42.704) (total time: 30007ms):
2022-04-05T16:40:12.711917993Z Trace[617299536]: ---"Objects listed" error:conversion webhook for external-secrets.io/v1alpha1, Kind=ExternalSecret failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 30007ms (16:40:12.711)
2022-04-05T16:40:12.711923157Z Trace[617299536]: [30.007405253s] [30.007405253s] END
2022-04-05T16:40:12.711934850Z E0405 16:40:12.711541       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1beta1.ExternalSecret: failed to list *v1beta1.ExternalSecret: conversion webhook for external-secrets.io/v1alpha1, Kind=ExternalSecret failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2022-04-05T16:40:44.031258511Z W0405 16:40:44.031055       1 reflector.go:324] pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1beta1.ExternalSecret: conversion webhook for external-secrets.io/v1alpha1, Kind=ExternalSecret failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2022-04-05T16:40:44.031366583Z I0405 16:40:44.031161       1 trace.go:205] Trace[1256966951]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167 (05-Apr-2022 16:40:14.023) (total time: 30007ms):
2022-04-05T16:40:44.031383997Z Trace[1256966951]: ---"Objects listed" error:conversion webhook for external-secrets.io/v1alpha1, Kind=ExternalSecret failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 30007ms (16:40:44.031)
2022-04-05T16:40:44.031392785Z Trace[1256966951]: [30.007601411s] [30.007601411s] END
2022-04-05T16:40:44.031412322Z E0405 16:40:44.031237       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1beta1.ExternalSecret: failed to list *v1beta1.ExternalSecret: conversion webhook for external-secrets.io/v1alpha1, Kind=ExternalSecret failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2022-04-05T16:40:44.072910133Z W0405 16:40:44.072637       1 reflector.go:324] pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1beta1.ClusterSecretStore: conversion webhook for external-secrets.io/v1alpha1, Kind=ClusterSecretStore failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2022-04-05T16:40:44.072959776Z I0405 16:40:44.072720       1 trace.go:205] Trace[2131429643]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167 (05-Apr-2022 16:40:14.066) (total time: 30006ms):
2022-04-05T16:40:44.072969853Z Trace[2131429643]: ---"Objects listed" error:conversion webhook for external-secrets.io/v1alpha1, Kind=ClusterSecretStore failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 30006ms (16:40:44.072)
2022-04-05T16:40:44.072978479Z Trace[2131429643]: [30.00654033s] [30.00654033s] END
2022-04-05T16:40:44.072986150Z E0405 16:40:44.072766       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1beta1.ClusterSecretStore: failed to list *v1beta1.ClusterSecretStore: conversion webhook for external-secrets.io/v1alpha1, Kind=ClusterSecretStore failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2022-04-05T16:40:44.193485474Z W0405 16:40:44.193237       1 reflector.go:324] pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.PartialObjectMetadata: conversion webhook for external-secrets.io/v1alpha1, Kind=ExternalSecret failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
2022-04-05T16:40:44.193536397Z I0405 16:40:44.193335       1 trace.go:205] Trace[169496380]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167 (05-Apr-2022 16:40:14.188) (total time: 30005ms):
2022-04-05T16:40:44.193570561Z Trace[169496380]: ---"Objects listed" error:conversion webhook for external-secrets.io/v1alpha1, Kind=ExternalSecret failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 30005ms (16:40:44.193)
2022-04-05T16:40:44.193578139Z Trace[169496380]: [30.005173521s] [30.005173521s] END
2022-04-05T16:40:44.193597138Z E0405 16:40:44.193414       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: conversion webhook for external-secrets.io/v1alpha1, Kind=ExternalSecret failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
2022-04-05T16:41:15.734503185Z W0405 16:41:15.734270       1 reflector.go:324] pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1beta1.ExternalSecret: conversion webhook for external-secrets.io/v1alpha1, Kind=ExternalSecret failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2022-04-05T16:41:15.734566110Z I0405 16:41:15.734344       1 trace.go:205] Trace[360646300]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167 (05-Apr-2022 16:40:45.725) (total time: 30008ms):
2022-04-05T16:41:15.734576872Z Trace[360646300]: ---"Objects listed" error:conversion webhook for external-secrets.io/v1alpha1, Kind=ExternalSecret failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 30008ms (16:41:15.734)
2022-04-05T16:41:15.734584107Z Trace[360646300]: [30.008984546s] [30.008984546s] END
2022-04-05T16:41:15.734590678Z E0405 16:41:15.734362       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1beta1.ExternalSecret: failed to list *v1beta1.ExternalSecret: conversion webhook for external-secrets.io/v1alpha1, Kind=ExternalSecret failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2022-04-05T16:41:15.745722969Z W0405 16:41:15.745542       1 reflector.go:324] pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1beta1.ClusterSecretStore: conversion webhook for external-secrets.io/v1alpha1, Kind=ClusterSecretStore failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2022-04-05T16:41:15.745794085Z I0405 16:41:15.745598       1 trace.go:205] Trace[87221652]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167 (05-Apr-2022 16:40:45.739) (total time: 30005ms):
2022-04-05T16:41:15.745844852Z Trace[87221652]: ---"Objects listed" error:conversion webhook for external-secrets.io/v1alpha1, Kind=ClusterSecretStore failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 30005ms (16:41:15.745)
2022-04-05T16:41:15.745853926Z Trace[87221652]: [30.005593225s] [30.005593225s] END
2022-04-05T16:41:15.745860614Z E0405 16:41:15.745621       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1beta1.ClusterSecretStore: failed to list *v1beta1.ClusterSecretStore: conversion webhook for external-secrets.io/v1alpha1, Kind=ClusterSecretStore failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2022-04-05T16:41:17.018357286Z W0405 16:41:17.018081       1 reflector.go:324] pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.PartialObjectMetadata: conversion webhook for external-secrets.io/v1alpha1, Kind=ExternalSecret failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2022-04-05T16:41:17.018449350Z I0405 16:41:17.018164       1 trace.go:205] Trace[1267145983]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167 (05-Apr-2022 16:40:47.010) (total time: 30007ms):
2022-04-05T16:41:17.018472837Z Trace[1267145983]: ---"Objects listed" error:conversion webhook for external-secrets.io/v1alpha1, Kind=ExternalSecret failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 30007ms (16:41:17.018)
2022-04-05T16:41:17.018481985Z Trace[1267145983]: [30.00782324s] [30.00782324s] END
2022-04-05T16:41:17.018491433Z E0405 16:41:17.018183       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: conversion webhook for external-secrets.io/v1alpha1, Kind=ExternalSecret failed: Post "https://external-secrets-webhook.external-secrets.svc:443/convert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2022-04-05T16:41:42.703594917Z {"level":"error","ts":1649176902.703248,"logger":"controller.clustersecretstore","msg":"Could not wait for Cache to sync","reconciler group":"external-secrets.io","reconciler kind":"ClusterSecretStore","error":"failed to wait for clustersecretstore caches to sync: timed out waiting for cache to be synced","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2\n\t/home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:208\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start\n\t/home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:234\nsigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1\n\t/home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:218"}
2022-04-05T16:41:42.704263016Z {"level":"error","ts":1649176902.7033157,"logger":"controller.secretstore","msg":"Could not wait for Cache to sync","reconciler group":"external-secrets.io","reconciler kind":"SecretStore","error":"failed to wait for secretstore caches to sync: timed out waiting for cache to be synced","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2\n\t/home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:208\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start\n\t/home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:234\nsigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1\n\t/home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:218"}
2022-04-05T16:41:42.704314207Z {"level":"error","ts":1649176902.7034206,"logger":"controller.clusterexternalsecret","msg":"Could not wait for Cache to sync","reconciler group":"external-secrets.io","reconciler kind":"ClusterExternalSecret","error":"failed to wait for clusterexternalsecret caches to sync: timed out waiting for cache to be synced","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2\n\t/home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:208\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start\n\t/home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:234\nsigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1\n\t/home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:218"}
2022-04-05T16:41:42.704355925Z {"level":"error","ts":1649176902.7035124,"logger":"controller.externalsecret","msg":"Could not wait for Cache to sync","reconciler group":"external-secrets.io","reconciler kind":"ExternalSecret","error":"failed to wait for externalsecret caches to sync: timed out waiting for cache to be synced","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2\n\t/home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:208\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start\n\t/home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:234\nsigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1\n\t/home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:218"}
2022-04-05T16:41:42.704972976Z {"level":"error","ts":1649176902.7045138,"msg":"error received after stop sequence was engaged","error":"failed to wait for secretstore caches to sync: timed out waiting for cache to be synced","stacktrace":"sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1\n\t/home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/internal.go:541"}
2022-04-05T16:41:42.705007316Z {"level":"error","ts":1649176902.704921,"msg":"error received after stop sequence was engaged","error":"failed to wait for clusterexternalsecret caches to sync: timed out waiting for cache to be synced","stacktrace":"sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1\n\t/home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/internal.go:541"}
2022-04-05T16:41:42.705382585Z {"level":"error","ts":1649176902.705297,"msg":"error received after stop sequence was engaged","error":"failed to wait for externalsecret caches to sync: timed out waiting for cache to be synced","stacktrace":"sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1\n\t/home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/internal.go:541"}
2022-04-05T16:41:42.705699032Z {"level":"info","ts":1649176902.7047925,"msg":"Stopping and waiting for non leader election runnables"}
2022-04-05T16:41:42.705718063Z {"level":"info","ts":1649176902.7056382,"msg":"Stopping and waiting for leader election runnables"}
2022-04-05T16:41:42.705995985Z {"level":"info","ts":1649176902.7056556,"msg":"Stopping and waiting for caches"}
2022-04-05T16:41:42.706427137Z I0405 16:41:42.706306       1 trace.go:205] Trace[1494115957]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167 (05-Apr-2022 16:41:22.412) (total time: 20294ms):
2022-04-05T16:41:42.706452647Z Trace[1494115957]: [20.294109526s] [20.294109526s] END
2022-04-05T16:41:42.706459446Z I0405 16:41:42.706358       1 trace.go:205] Trace[1719893492]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167 (05-Apr-2022 16:41:22.129) (total time: 20577ms):
2022-04-05T16:41:42.706465281Z Trace[1719893492]: [20.577252238s] [20.577252238s] END
2022-04-05T16:41:42.706471112Z I0405 16:41:42.706381       1 trace.go:205] Trace[903287388]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167 (05-Apr-2022 16:41:19.187) (total time: 23518ms):
2022-04-05T16:41:42.706493643Z Trace[903287388]: [23.51868304s] [23.51868304s] END
2022-04-05T16:41:42.706905147Z {"level":"info","ts":1649176902.7068157,"msg":"Stopping and waiting for webhooks"}
2022-04-05T16:41:42.707026413Z {"level":"info","ts":1649176902.7069576,"msg":"Wait completed, proceeding to shutdown the manager"}
2022-04-05T16:41:42.707266621Z {"level":"error","ts":1649176902.7071161,"logger":"setup","msg":"problem running manager","error":"failed to wait for clustersecretstore caches to sync: timed out waiting for cache to be synced","stacktrace":"github.com/external-secrets/external-secrets/cmd.glob..func2\n\t/home/runner/work/external-secrets/external-secrets/cmd/root.go:161\ngithub.com/spf13/cobra.(*Command).execute\n\t/home/runner/go/pkg/mod/github.com/spf13/cobra@v1.4.0/command.go:860\ngithub.com/spf13/cobra.(*Command).ExecuteC\n\t/home/runner/go/pkg/mod/github.com/spf13/cobra@v1.4.0/command.go:974\ngithub.com/spf13/cobra.(*Command).Execute\n\t/home/runner/go/pkg/mod/github.com/spf13/cobra@v1.4.0/command.go:902\ngithub.com/external-secrets/external-secrets/cmd.Execute\n\t/home/runner/work/external-secrets/external-secrets/cmd/root.go:169\nmain.main\n\t/home/runner/work/external-secrets/external-secrets/main.go:21\nruntime.main\n\t/opt/hostedtoolcache/go/1.17.8/x64/src/runtime/proc.go:255"}