karmada: create karmada 1.7.0 by operator offline error

create karmada 1.7.0 by operator on offline env fail the operator log is

E1012 07:47:21.428138       1 planner.go:93] "failed to executed the workflow" err="failed to install etcd component, err: error when creating etcd client service, err: Service \"karmada-etcd\" is invalid: metadata.resourceVersion: Invalid value: \"\": must be specified for an update" workflow=init karmada="karmada-system/karmada"
I1012 07:47:21.435441       1 controller.go:51] "Finished syncing karmada" karmada="karmada-system/karmada" duration="71.770163ms"
E1012 07:47:21.435477       1 controller.go:324] "Reconciler error" err="failed to install etcd component, err: error when creating etcd client service, err: Service \"karmada-etcd\" is invalid: metadata.resourceVersion: Invalid value: \"\": must be specified for an update" controller="karmada" controllerGroup="operator.karmada.io" controllerKind="Karmada" Karmada="karmada-system/karmada" namespace="karmada-system" name="karmada" reconcileID=4e417ee7-25e7-4330-8d8c-5580a391460a
I1012 07:47:31.675809       1 controller.go:49] "Started syncing karmada" karmada="karmada-system/karmada" startTime="2023-10-12 07:47:31.675788066 +0000 UTC m=+536.870029385"
I1012 07:47:31.675902       1 controller.go:84] "Reconciling karmada" name="karmada"
I1012 07:47:31.675937       1 planner.go:87] "Start execute the workflow" workflow=init karmada="karmada-system/karmada"
I1012 07:47:31.687851       1 crd.go:48] "[prepare-crds] Running prepare-crds task" karmada="karmada-system/karmada"
I1012 07:47:31.687866       1 crd.go:49] "[prepare-crds] Using crd folder" folder="/var/lib/karmada/1.6.0" karmada="karmada-system/karmada"
I1012 07:47:31.688168       1 crd.go:69] "[download-crds] Skip download crd yaml files, the crd tar exists on disk" karmada="karmada-system/karmada"
I1012 07:47:31.688186       1 crd.go:126] "[unpack] These crds yaml files have been decompressed in the path" path="/var/lib/karmada/1.6.0/crds" karmada="karmada-system/karmada"
I1012 07:47:31.688193       1 crd.go:129] "[unpack] Successfully unpacked crd tar" karmada="karmada-system/karmada"
I1012 07:47:31.690973       1 cert.go:53] "[certs] Successfully loaded certs form secret" secret="karmada-cert" karmada="karmada-system/karmada"
I1012 07:47:31.690989       1 cert.go:54] "[certs] Skip certs task, found previous certificates in secret" karmada="karmada-system/karmada"
I1012 07:47:31.690995       1 namespace.go:28] "[namespace] Running namespace task" karmada="karmada-system/karmada"
I1012 07:47:31.692876       1 upload.go:168] "[upload-certs] Running upload-certs task" karmada="karmada-system/karmada"
I1012 07:47:31.702091       1 upload.go:201] "[upload-KarmadaCert] Successfully uploaded karmada certs to secret" karmada="karmada-system/karmada"
I1012 07:47:31.709210       1 upload.go:235] "[upload-etcdCert] Successfully uploaded etcd certs to secret" karmada="karmada-system/karmada"
I1012 07:47:31.715711       1 upload.go:262] "[upload-webhookCert] Successfully uploaded webhook certs to secret" karmada="karmada-system/karmada"
I1012 07:47:31.715725       1 etcd.go:39] "[etcd] Running etcd task" karmada="karmada-system/karmada"
E1012 07:47:31.732013       1 planner.go:93] "failed to executed the workflow" err="failed to install etcd component, err: error when creating etcd client service, err: Service \"karmada-etcd\" is invalid: metadata.resourceVersion: Invalid value: \"\": must be specified for an update" workflow=init karmada="karmada-system/karmada"
I1012 07:47:31.739111       1 controller.go:51] "Finished syncing karmada" karmada="karmada-system/karmada" duration="63.313038ms"
E1012 07:47:31.739149       1 controller.go:324] "Reconciler error" err="failed to install etcd component, err: error when creating etcd client service, err: Service \"karmada-etcd\" is invalid: metadata.resourceVersion: Invalid value: \"\": must be specified for an update" controller="karmada" controllerGroup="operator.karmada.io" controllerKind="Karmada" Karmada="karmada-system/karmada" namespace="karmada-system" name="karmada" reconcileID=bf68d217-5e8e-4334-983a-3ee95245a2ec
I1012 07:47:52.220098       1 controller.go:49] "Started syncing karmada" karmada="karmada-system/karmada" startTime="2023-10-12 07:47:52.220075637 +0000 UTC m=+557.414316956"
I1012 07:47:52.220199       1 controller.go:84] "Reconciling karmada" name="karmada"
I1012 07:47:52.220225       1 planner.go:87] "Start execute the workflow" workflow=init karmada="karmada-system/karmada"
I1012 07:47:52.235017       1 crd.go:48] "[prepare-crds] Running prepare-crds task" karmada="karmada-system/karmada"
I1012 07:47:52.235034       1 crd.go:49] "[prepare-crds] Using crd folder" folder="/var/lib/karmada/1.6.0" karmada="karmada-system/karmada"
I1012 07:47:52.235348       1 crd.go:69] "[download-crds] Skip download crd yaml files, the crd tar exists on disk" karmada="karmada-system/karmada"
I1012 07:47:52.235368       1 crd.go:126] "[unpack] These crds yaml files have been decompressed in the path" path="/var/lib/karmada/1.6.0/crds" karmada="karmada-system/karmada"
I1012 07:47:52.235376       1 crd.go:129] "[unpack] Successfully unpacked crd tar" karmada="karmada-system/karmada"
I1012 07:47:52.237969       1 cert.go:53] "[certs] Successfully loaded certs form secret" secret="karmada-cert" karmada="karmada-system/karmada"
I1012 07:47:52.237984       1 cert.go:54] "[certs] Skip certs task, found previous certificates in secret" karmada="karmada-system/karmada"
I1012 07:47:52.237991       1 namespace.go:28] "[namespace] Running namespace task" karmada="karmada-system/karmada"
I1012 07:47:52.239915       1 upload.go:168] "[upload-certs] Running upload-certs task" karmada="karmada-system/karmada"
I1012 07:47:52.255555       1 upload.go:201] "[upload-KarmadaCert] Successfully uploaded karmada certs to secret" karmada="karmada-system/karmada"
I1012 07:47:52.262936       1 upload.go:235] "[upload-etcdCert] Successfully uploaded etcd certs to secret" karmada="karmada-system/karmada"
I1012 07:47:52.268960       1 upload.go:262] "[upload-webhookCert] Successfully uploaded webhook certs to secret" karmada="karmada-system/karmada"
I1012 07:47:52.268972       1 etcd.go:39] "[etcd] Running etcd task" karmada="karmada-system/karmada"
E1012 07:47:52.285762       1 planner.go:93] "failed to executed the workflow" err="failed to install etcd component, err: error when creating etcd client service, err: Service \"karmada-etcd\" is invalid: metadata.resourceVersion: Invalid value: \"\": must be specified for an update" workflow=init karmada="karmada-system/karmada"
I1012 07:47:52.294515       1 controller.go:51] "Finished syncing karmada" karmada="karmada-system/karmada" duration="74.429307ms"
E1012 07:47:52.294557       1 controller.go:324] "Reconciler error" err="failed to install etcd component, err: error when creating etcd client service, err: Service \"karmada-etcd\" is invalid: metadata.resourceVersion: Invalid value: \"\": must be specified for an update" controller="karmada" controllerGroup="operator.karmada.io" controllerKind="Karmada" Karmada="karmada-system/karmada" namespace="karmada-system" name="karmada" reconcileID=1e552e68-6720-4670-a911-10bfd9ee32d7
I1012 07:47:56.343634       1 reflector.go:788] sigs.k8s.io/controller-runtime/pkg/cache/internal/informers.go:233: Watch close - *v1alpha1.Karmada total 105 items received

About this issue

  • Original URL
  • State: closed
  • Created 9 months ago
  • Comments: 29 (29 by maintainers)

Most upvoted comments

I find that v1.7.0 karmada-operator now may have some bugs, we can not correctly apply v1.7.0 crds

@chaosi-zju I have a PR is work for it, https://github.com/karmada-io/karmada/pull/4130 and this is not the reason of this issue.

more info:

Just using k8s v1.23.0 or higher and the latest operator is working for you @MolisXYliu

The operator say the log of :

E1012 07:47:21.428138 1 planner.go:93] "failed to executed the workflow" err="failed to install etcd component, err: error when creating etcd client service, err: Service "karmada-etcd" is invalid: metadata.resourceVersion: Invalid value: "": must be specified for an update" workflow=init karmada="karmada-system/karmada"

and it happen on https://github.com/karmada-io/karmada/blob/f1f1a82dc73ae3828971fbdaf763c087f87f1291/operator/pkg/util/apiclient/idempotency.go#L78-L79

Have not checkout what’s the reason for this change.

i cp the crds in /var/lib/karmada/1.6.0

Try to using the crd of 1.7.0

Yes, I think the reason is the crd version is 1.6.0 caused, “try using the crd of 1.7.0” +1

the crd version is 1.7.0 the operator read crd path is /var/lib/karmada/1.6.0 so i put the 1.7.0crd in this path