velero: Backup fails with no error

What steps did you take and what happened: I have a kubernetes cluster and i’m trying to make a simple backup of the namespace csi-app example given by the velero site. My provider is azure and i enabled the csi plugin and the snapshot option.

velero backup get NAME STATUS ERRORS WARNINGS CREATED EXPIRES STORAGE LOCATION SELECTOR csi-app-test Failed 0 0 2020-10-19 15:54:03 +0200 CEST 29d default <none>

What did you expect to happen:

the status of backup is Completed

The output of the following commands will help us better understand what’s going on: (Pasting long output into a GitHub gist or other pastebin is fine.)

• `kubectl logs deployment/velero -n velero

  time=“2020-10-19T14:49:28Z” level=info msg=“Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available” controller=backup-storage-location logSource=“pkg/controller/backup_storage_location_controller.go:58” time=“2020-10-19T14:49:29Z” level=info msg=“Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available” controller=backup-storage-location logSource=“pkg/controller/backup_storage_location_controller.go:58” time=“2020-10-19T14:49:29Z” level=info msg=“No backup locations were ready to be verified” controller=backup-storage-location logSource=“pkg/controller/backup_storage_location_controller.go:120” time=“2020-10-19T14:50:29Z” level=info msg=“Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available” controller=backup-storage-location logSource=“pkg/controller/backup_storage_location_controller.go:58” time=“2020-10-19T14:50:30Z” level=info msg=“Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available” controller=backup-storage-location logSource=“pkg/controller/backup_storage_location_controller.go:58” time=“2020-10-19T14:50:30Z” level=info msg=“No backup locations were ready to be verified” controller=backup-storage-location logSource=“pkg/controller/backup_storage_location_controller.go:120” time=“2020-10-19T14:51:30Z” level=info msg=“Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available” controller=backup-storage-location logSource=“pkg/controller/backup_storage_location_controller.go:58” time=“2020-10-19T14:51:31Z” level=info msg=“Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available” controller=backup-storage-location logSource=“pkg/controller/backup_storage_location_controller.go:58” time=“2020-10-19T14:51:31Z” level=info msg=“No backup locations were ready to be verified” controller=backup-storage-location logSource=“pkg/controller/backup_storage_location_controller.go:120” `

• ` velero backup describe csi-app-test Name: csi-app-test Namespace: velero Labels: velero.io/storage-location=default Annotations: velero.io/source-cluster-k8s-gitversion=v1.18.5 velero.io/source-cluster-k8s-major-version=1 velero.io/source-cluster-k8s-minor-version=18

Phase: Failed (run velero backup logs csi-app-test for more information)

Errors: 0 Warnings: 0

Namespaces: Included: csi-app-test Excluded: <none>

Resources: Included: * Excluded: <none> Cluster-scoped: auto

Label selector: <none>

Storage Location: default

Velero-Native Snapshot PVs: auto

TTL: 720h0m0s

Hooks: <none>

Backup Format Version: 1.1.0

Started: 2020-10-19 15:54:03 +0200 CEST Completed: 2020-10-19 15:54:10 +0200 CEST

Expiration: 2020-11-18 14:54:03 +0100 CET

Total items to be backed up: 21 Items backed up: 21

Velero-Native Snapshots: <none included> `

• velero backup logs csi-app-test time="2020-10-19T13:54:03Z" level=info msg="Setting up backup temp file" backup=velero/csi-app-test logSource="pkg/controller/backup_controller.go:534" time="2020-10-19T13:54:03Z" level=info msg="Setting up plugin manager" backup=velero/csi-app-test logSource="pkg/controller/backup_controller.go:541" time="2020-10-19T13:54:03Z" level=info msg="Getting backup item actions" backup=velero/csi-app-test logSource="pkg/controller/backup_controller.go:545" time="2020-10-19T13:54:03Z" level=info msg="Setting up backup store to check for backup existence" backup=velero/csi-app-test logSource="pkg/controller/backup_controller.go:551" time="2020-10-19T13:54:04Z" level=info msg="Writing backup version file" backup=velero/csi-app-test logSource="pkg/backup/backup.go:236" time="2020-10-19T13:54:04Z" level=info msg="Including namespaces: csi-app-test" backup=velero/csi-app-test logSource="pkg/backup/backup.go:242" time="2020-10-19T13:54:04Z" level=info msg="Excluding namespaces: <none>" backup=velero/csi-app-test logSource="pkg/backup/backup.go:243" time="2020-10-19T13:54:04Z" level=info msg="Including resources: *" backup=velero/csi-app-test logSource="pkg/backup/backup.go:246" time="2020-10-19T13:54:04Z" level=info msg="Excluding resources: <none>" backup=velero/csi-app-test logSource="pkg/backup/backup.go:247" time="2020-10-19T13:54:04Z" level=info msg="Backing up all pod volumes using restic: false" backup=velero/csi-app-test logSource="pkg/backup/backup.go:248" time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:165" resource=pods time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=pods time="2020-10-19T13:54:04Z" level=info msg="Retrieved 1 items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=pods time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:165" resource=persistentvolumeclaims time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=persistentvolumeclaims time="2020-10-19T13:54:04Z" level=info msg="Retrieved 1 items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=persistentvolumeclaims time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:165" resource=persistentvolumes time="2020-10-19T13:54:04Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:192" resource=persistentvolumes time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:165" resource=namespaces time="2020-10-19T13:54:04Z" level=info msg="Getting namespace" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:239" namespace=csi-app-test resource=namespaces time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:165" resource=podtemplates time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=podtemplates time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=podtemplates time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:165" resource=services time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=services time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=services time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:165" resource=limitranges time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=limitranges time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=limitranges time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:165" resource=nodes time="2020-10-19T13:54:04Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:192" resource=nodes time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:165" resource=replicationcontrollers time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=replicationcontrollers time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=replicationcontrollers time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:165" resource=serviceaccounts time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=serviceaccounts time="2020-10-19T13:54:04Z" level=info msg="Retrieved 1 items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=serviceaccounts time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:165" resource=configmaps time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=configmaps time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=configmaps time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:165" resource=resourcequotas time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=resourcequotas time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=resourcequotas time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:165" resource=secrets time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=secrets time="2020-10-19T13:54:04Z" level=info msg="Retrieved 1 items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=secrets time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:165" resource=events time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=events time="2020-10-19T13:54:04Z" level=info msg="Retrieved 12 items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=events time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:165" resource=endpoints time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=endpoints time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=endpoints time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=apiregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=apiregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:165" resource=apiservices time="2020-10-19T13:54:04Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=apiregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:192" resource=apiservices time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=apps/v1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=apps/v1 logSource="pkg/backup/item_collector.go:165" resource=replicasets time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=apps/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=replicasets time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=apps/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=replicasets time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=apps/v1 logSource="pkg/backup/item_collector.go:165" resource=controllerrevisions time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=apps/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=controllerrevisions time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=apps/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=controllerrevisions time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=apps/v1 logSource="pkg/backup/item_collector.go:165" resource=daemonsets time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=apps/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=daemonsets time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=apps/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=daemonsets time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=apps/v1 logSource="pkg/backup/item_collector.go:165" resource=deployments time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=apps/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=deployments time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=apps/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=deployments time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=apps/v1 logSource="pkg/backup/item_collector.go:165" resource=statefulsets time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=apps/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=statefulsets time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=apps/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=statefulsets time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=events.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=events.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:165" resource=events time="2020-10-19T13:54:04Z" level=info msg="Skipping resource because it cohabitates and we've already processed it" backup=velero/csi-app-test cohabitatingResource1=events cohabitatingResource2=events.events.k8s.io group=events.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:213" resource=events time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=autoscaling/v1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=autoscaling/v1 logSource="pkg/backup/item_collector.go:165" resource=horizontalpodautoscalers time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=autoscaling/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=horizontalpodautoscalers time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=autoscaling/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=horizontalpodautoscalers time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=batch/v1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=batch/v1 logSource="pkg/backup/item_collector.go:165" resource=jobs time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=batch/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=jobs time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=batch/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=jobs time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=batch/v1beta1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=batch/v1beta1 logSource="pkg/backup/item_collector.go:165" resource=cronjobs time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=batch/v1beta1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=cronjobs time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=batch/v1beta1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=cronjobs time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=certificates.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=certificates.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:165" resource=certificatesigningrequests time="2020-10-19T13:54:04Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=certificates.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:192" resource=certificatesigningrequests time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:165" resource=networkpolicies time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=networkpolicies time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=networkpolicies time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=networking.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=networking.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:165" resource=ingresses time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=networking.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=ingresses time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=networking.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=ingresses time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=networking.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:165" resource=ingressclasses time="2020-10-19T13:54:04Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=networking.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:192" resource=ingressclasses time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=policy/v1beta1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=policy/v1beta1 logSource="pkg/backup/item_collector.go:165" resource=poddisruptionbudgets time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=policy/v1beta1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=poddisruptionbudgets time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=policy/v1beta1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=poddisruptionbudgets time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=policy/v1beta1 logSource="pkg/backup/item_collector.go:165" resource=podsecuritypolicies time="2020-10-19T13:54:04Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=policy/v1beta1 logSource="pkg/backup/item_collector.go:192" resource=podsecuritypolicies time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:165" resource=clusterrolebindings time="2020-10-19T13:54:04Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:192" resource=clusterrolebindings time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:165" resource=clusterroles time="2020-10-19T13:54:04Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:192" resource=clusterroles time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:165" resource=rolebindings time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=rolebindings time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=rolebindings time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:165" resource=roles time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=roles time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=roles time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:165" resource=storageclasses time="2020-10-19T13:54:04Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:192" resource=storageclasses time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:165" resource=csinodes time="2020-10-19T13:54:04Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:192" resource=csinodes time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:165" resource=csidrivers time="2020-10-19T13:54:04Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:192" resource=csidrivers time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:165" resource=volumeattachments time="2020-10-19T13:54:04Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:192" resource=volumeattachments time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=admissionregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=admissionregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:165" resource=mutatingwebhookconfigurations time="2020-10-19T13:54:04Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=admissionregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:192" resource=mutatingwebhookconfigurations time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=admissionregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:165" resource=validatingwebhookconfigurations time="2020-10-19T13:54:04Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=admissionregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:192" resource=validatingwebhookconfigurations time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=apiextensions.k8s.io/v1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=apiextensions.k8s.io/v1 logSource="pkg/backup/item_collector.go:165" resource=customresourcedefinitions time="2020-10-19T13:54:04Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=apiextensions.k8s.io/v1 logSource="pkg/backup/item_collector.go:192" resource=customresourcedefinitions time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=scheduling.k8s.io/v1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=scheduling.k8s.io/v1 logSource="pkg/backup/item_collector.go:165" resource=priorityclasses time="2020-10-19T13:54:04Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=scheduling.k8s.io/v1 logSource="pkg/backup/item_collector.go:192" resource=priorityclasses time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=coordination.k8s.io/v1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=coordination.k8s.io/v1 logSource="pkg/backup/item_collector.go:165" resource=leases time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=coordination.k8s.io/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=leases time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=coordination.k8s.io/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=leases time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=node.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=node.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:165" resource=runtimeclasses time="2020-10-19T13:54:04Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=node.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:192" resource=runtimeclasses time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=discovery.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=discovery.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:165" resource=endpointslices time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=discovery.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=endpointslices time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=discovery.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=endpointslices time="2020-10-19T13:54:04Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:165" resource=volumesnapshotlocations time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=volumesnapshotlocations time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=volumesnapshotlocations time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:165" resource=downloadrequests time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=downloadrequests time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=downloadrequests time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:165" resource=backupstoragelocations time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=backupstoragelocations time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=backupstoragelocations time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:165" resource=deletebackuprequests time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=deletebackuprequests time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=deletebackuprequests time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:165" resource=podvolumebackups time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=podvolumebackups time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=podvolumebackups time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:165" resource=serverstatusrequests time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=serverstatusrequests time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=serverstatusrequests time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:165" resource=schedules time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=schedules time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=schedules time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:165" resource=podvolumerestores time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=podvolumerestores time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=podvolumerestores time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:165" resource=restores time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=restores time="2020-10-19T13:54:04Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=restores time="2020-10-19T13:54:04Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:165" resource=resticrepositories time="2020-10-19T13:54:04Z" level=info msg="Listing items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=resticrepositories time="2020-10-19T13:54:05Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=resticrepositories time="2020-10-19T13:54:05Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:165" resource=backups time="2020-10-19T13:54:05Z" level=info msg="Listing items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=backups time="2020-10-19T13:54:05Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=velero.io/v1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=backups time="2020-10-19T13:54:05Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=csi.storage.k8s.io/v1alpha1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:05Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=csi.storage.k8s.io/v1alpha1 logSource="pkg/backup/item_collector.go:165" resource=csidrivers time="2020-10-19T13:54:05Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=csi.storage.k8s.io/v1alpha1 logSource="pkg/backup/item_collector.go:192" resource=csidrivers time="2020-10-19T13:54:05Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=snapshot.storage.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:05Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=snapshot.storage.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:165" resource=volumesnapshots time="2020-10-19T13:54:05Z" level=info msg="Listing items" backup=velero/csi-app-test group=snapshot.storage.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=volumesnapshots time="2020-10-19T13:54:05Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=snapshot.storage.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=volumesnapshots time="2020-10-19T13:54:05Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=snapshot.storage.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:165" resource=volumesnapshotclasses time="2020-10-19T13:54:05Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=snapshot.storage.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:192" resource=volumesnapshotclasses time="2020-10-19T13:54:05Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=snapshot.storage.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:165" resource=volumesnapshotcontents time="2020-10-19T13:54:05Z" level=info msg="Skipping resource because it's cluster-scoped and only specific namespaces are included in the backup" backup=velero/csi-app-test group=snapshot.storage.k8s.io/v1beta1 logSource="pkg/backup/item_collector.go:192" resource=volumesnapshotcontents time="2020-10-19T13:54:05Z" level=info msg="Getting items for group" backup=velero/csi-app-test group=extensions/v1beta1 logSource="pkg/backup/item_collector.go:76" time="2020-10-19T13:54:05Z" level=info msg="Getting items for resource" backup=velero/csi-app-test group=extensions/v1beta1 logSource="pkg/backup/item_collector.go:165" resource=ingresses time="2020-10-19T13:54:05Z" level=info msg="Listing items" backup=velero/csi-app-test group=extensions/v1beta1 logSource="pkg/backup/item_collector.go:291" namespace=csi-app-test resource=ingresses time="2020-10-19T13:54:05Z" level=info msg="Retrieved 0 items" backup=velero/csi-app-test group=extensions/v1beta1 logSource="pkg/backup/item_collector.go:297" namespace=csi-app-test resource=ingresses time="2020-10-19T13:54:05Z" level=info msg="Collected 17 items matching the backup spec from the Kubernetes API (actual number of items backed up may be more or less depending on velero.io/exclude-from-backup annotation, plugins returning additional related items to back up, etc.)" backup=velero/csi-app-test logSource="pkg/backup/backup.go:302" progress= time="2020-10-19T13:54:05Z" level=info msg="Processing item" backup=velero/csi-app-test logSource="pkg/backup/backup.go:378" name=csi-nginx namespace=csi-app-test progress= resource=pods time="2020-10-19T13:54:05Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=csi-nginx namespace=csi-app-test resource=pods time="2020-10-19T13:54:05Z" level=info msg="Executing custom action" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:327" name=csi-nginx namespace=csi-app-test resource=pods time="2020-10-19T13:54:05Z" level=info msg="Executing podAction" backup=velero/csi-app-test cmd=/velero logSource="pkg/backup/pod_action.go:51" pluginName=velero time="2020-10-19T13:54:05Z" level=info msg="Adding pvc pvc-csi to additionalItems" backup=velero/csi-app-test cmd=/velero logSource="pkg/backup/pod_action.go:67" pluginName=velero time="2020-10-19T13:54:05Z" level=info msg="Done executing podAction" backup=velero/csi-app-test cmd=/velero logSource="pkg/backup/pod_action.go:77" pluginName=velero time="2020-10-19T13:54:05Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=pvc-csi namespace=csi-app-test resource=persistentvolumeclaims time="2020-10-19T13:54:05Z" level=info msg="Executing custom action" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:327" name=pvc-csi namespace=csi-app-test resource=persistentvolumeclaims time="2020-10-19T13:54:05Z" level=info msg="Executing PVCAction" backup=velero/csi-app-test cmd=/velero logSource="pkg/backup/backup_pv_action.go:49" pluginName=velero time="2020-10-19T13:54:05Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=pvc-bd42f022-c5ad-4c56-877b-27228c567873 namespace= resource=persistentvolumes time="2020-10-19T13:54:05Z" level=info msg="Executing takePVSnapshot" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:405" name=pvc-bd42f022-c5ad-4c56-877b-27228c567873 namespace= resource=persistentvolumes time="2020-10-19T13:54:05Z" level=info msg="label \"topology.kubernetes.io/zone\" is not present on PersistentVolume, checking deprecated label..." backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:432" name=pvc-bd42f022-c5ad-4c56-877b-27228c567873 namespace= persistentVolume=pvc-bd42f022-c5ad-4c56-877b-27228c567873 resource=persistentvolumes time="2020-10-19T13:54:05Z" level=info msg="label \"failure-domain.beta.kubernetes.io/zone\" is not present on PersistentVolume" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:435" name=pvc-bd42f022-c5ad-4c56-877b-27228c567873 namespace= persistentVolume=pvc-bd42f022-c5ad-4c56-877b-27228c567873 resource=persistentvolumes time="2020-10-19T13:54:05Z" level=info msg="No volume ID returned by volume snapshotter for persistent volume" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:458" name=pvc-bd42f022-c5ad-4c56-877b-27228c567873 namespace= persistentVolume=pvc-bd42f022-c5ad-4c56-877b-27228c567873 resource=persistentvolumes volumeSnapshotLocation=default time="2020-10-19T13:54:05Z" level=info msg="Persistent volume is not a supported volume type for snapshots, skipping." backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:469" name=pvc-bd42f022-c5ad-4c56-877b-27228c567873 namespace= persistentVolume=pvc-bd42f022-c5ad-4c56-877b-27228c567873 resource=persistentvolumes time="2020-10-19T13:54:05Z" level=info msg="Executing custom action" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:327" name=pvc-csi namespace=csi-app-test resource=persistentvolumeclaims time="2020-10-19T13:54:05Z" level=info msg="Starting PVCBackupItemAction" backup=velero/csi-app-test cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/backup/pvc_action.go:58" pluginName=velero-plugin-for-csi time="2020-10-19T13:54:05Z" level=info msg="Fetching storage class for PV managed-csi" backup=velero/csi-app-test cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/backup/pvc_action.go:102" pluginName=velero-plugin-for-csi time="2020-10-19T13:54:05Z" level=info msg="volumesnapshot class=csi-azuredisk-vsc" backup=velero/csi-app-test cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/backup/pvc_action.go:112" pluginName=velero-plugin-for-csi time="2020-10-19T13:54:05Z" level=info msg="Created volumesnapshot csi-app-test/velero-pvc-csi-zq8hn" backup=velero/csi-app-test cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/backup/pvc_action.go:142" pluginName=velero-plugin-for-csi time="2020-10-19T13:54:05Z" level=info msg="Returning from PVCBackupItemAction with 1 additionalItems to backup" backup=velero/csi-app-test cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/backup/pvc_action.go:159" pluginName=velero-plugin-for-csi time="2020-10-19T13:54:05Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=velero-pvc-csi-zq8hn namespace=csi-app-test resource=volumesnapshots.snapshot.storage.k8s.io time="2020-10-19T13:54:05Z" level=info msg="Executing custom action" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:327" name=velero-pvc-csi-zq8hn namespace=csi-app-test resource=volumesnapshots.snapshot.storage.k8s.io time="2020-10-19T13:54:05Z" level=info msg="Executing VolumeSnapshotBackupItemAction" backup=velero/csi-app-test cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/backup/volumesnapshot_action.go:58" pluginName=velero-plugin-for-csi time="2020-10-19T13:54:05Z" level=info msg="Getting VolumesnapshotContent for Volumesnapshot csi-app-test/velero-pvc-csi-zq8hn" backup=velero/csi-app-test cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/backup/volumesnapshot_action.go:91" pluginName=velero-plugin-for-csi time="2020-10-19T13:54:05Z" level=info msg="Waiting for CSI driver to reconcile volumesnapshot csi-app-test/velero-pvc-csi-zq8hn. Retrying in 5s" backup=velero/csi-app-test cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/util/util.go:166" pluginName=velero-plugin-for-csi time="2020-10-19T13:54:10Z" level=info msg="Patching volumensnapshotcontent snapcontent-6cf3521a-48dd-491d-81a2-82790d8c64a2 with velero BackupNameLabel" backup=velero/csi-app-test cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/backup/volumesnapshot_action.go:127" pluginName=velero-plugin-for-csi time="2020-10-19T13:54:10Z" level=info msg="Returning from VolumeSnapshotBackupItemAction with 2 additionalItems to backup" backup=velero/csi-app-test cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/backup/volumesnapshot_action.go:151" pluginName=velero-plugin-for-csi time="2020-10-19T13:54:10Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=csi-azuredisk-vsc namespace= resource=volumesnapshotclasses.snapshot.storage.k8s.io time="2020-10-19T13:54:10Z" level=info msg="Executing custom action" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:327" name=csi-azuredisk-vsc namespace= resource=volumesnapshotclasses.snapshot.storage.k8s.io time="2020-10-19T13:54:10Z" level=info msg="Executing VolumeSnapshotClassBackupItemAction" backup=velero/csi-app-test cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/backup/volumesnapshotclass_action.go:49" pluginName=velero-plugin-for-csi time="2020-10-19T13:54:10Z" level=info msg="Returning from VolumeSnapshotClassBackupItemAction with 0 additionalItems to backup" backup=velero/csi-app-test cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/backup/volumesnapshotclass_action.go:65" pluginName=velero-plugin-for-csi time="2020-10-19T13:54:10Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=snapcontent-6cf3521a-48dd-491d-81a2-82790d8c64a2 namespace= resource=volumesnapshotcontents.snapshot.storage.k8s.io time="2020-10-19T13:54:10Z" level=info msg="Executing custom action" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:327" name=snapcontent-6cf3521a-48dd-491d-81a2-82790d8c64a2 namespace= resource=volumesnapshotcontents.snapshot.storage.k8s.io time="2020-10-19T13:54:10Z" level=info msg="Executing VolumeSnapshotContentBackupItemAction" backup=velero/csi-app-test cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/backup/volumesnapshotcontent_action.go:50" pluginName=velero-plugin-for-csi time="2020-10-19T13:54:10Z" level=info msg="Returning from VolumeSnapshotContentBackupItemAction with 0 additionalItems to backup" backup=velero/csi-app-test cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/backup/volumesnapshotcontent_action.go:69" pluginName=velero-plugin-for-csi time="2020-10-19T13:54:10Z" level=info msg="Backed up 6 items out of an estimated total of 22 (estimate will change throughout the backup)" backup=velero/csi-app-test logSource="pkg/backup/backup.go:418" name=csi-nginx namespace=csi-app-test progress= resource=pods time="2020-10-19T13:54:10Z" level=info msg="Processing item" backup=velero/csi-app-test logSource="pkg/backup/backup.go:378" name=pvc-csi namespace=csi-app-test progress= resource=persistentvolumeclaims time="2020-10-19T13:54:10Z" level=info msg="Skipping item because it's already been backed up." backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:115" name=pvc-csi namespace=csi-app-test resource=persistentvolumeclaims time="2020-10-19T13:54:10Z" level=info msg="Backed up 6 items out of an estimated total of 21 (estimate will change throughout the backup)" backup=velero/csi-app-test logSource="pkg/backup/backup.go:418" name=pvc-csi namespace=csi-app-test progress= resource=persistentvolumeclaims time="2020-10-19T13:54:10Z" level=info msg="Processing item" backup=velero/csi-app-test logSource="pkg/backup/backup.go:378" name=csi-app-test namespace= progress= resource=namespaces time="2020-10-19T13:54:10Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=csi-app-test namespace= resource=namespaces time="2020-10-19T13:54:10Z" level=info msg="Backed up 7 items out of an estimated total of 21 (estimate will change throughout the backup)" backup=velero/csi-app-test logSource="pkg/backup/backup.go:418" name=csi-app-test namespace= progress= resource=namespaces time="2020-10-19T13:54:10Z" level=info msg="Processing item" backup=velero/csi-app-test logSource="pkg/backup/backup.go:378" name=default namespace=csi-app-test progress= resource=serviceaccounts time="2020-10-19T13:54:10Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=default namespace=csi-app-test resource=serviceaccounts time="2020-10-19T13:54:10Z" level=info msg="Executing custom action" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:327" name=default namespace=csi-app-test resource=serviceaccounts time="2020-10-19T13:54:10Z" level=info msg="Running ServiceAccountAction" backup=velero/csi-app-test cmd=/velero logSource="pkg/backup/service_account_action.go:77" pluginName=velero time="2020-10-19T13:54:10Z" level=info msg="Done running ServiceAccountAction" backup=velero/csi-app-test cmd=/velero logSource="pkg/backup/service_account_action.go:120" pluginName=velero time="2020-10-19T13:54:10Z" level=info msg="Backed up 8 items out of an estimated total of 21 (estimate will change throughout the backup)" backup=velero/csi-app-test logSource="pkg/backup/backup.go:418" name=default namespace=csi-app-test progress= resource=serviceaccounts time="2020-10-19T13:54:10Z" level=info msg="Processing item" backup=velero/csi-app-test logSource="pkg/backup/backup.go:378" name=default-token-nhd8n namespace=csi-app-test progress= resource=secrets time="2020-10-19T13:54:10Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=default-token-nhd8n namespace=csi-app-test resource=secrets time="2020-10-19T13:54:10Z" level=info msg="Backed up 9 items out of an estimated total of 21 (estimate will change throughout the backup)" backup=velero/csi-app-test logSource="pkg/backup/backup.go:418" name=default-token-nhd8n namespace=csi-app-test progress= resource=secrets time="2020-10-19T13:54:10Z" level=info msg="Processing item" backup=velero/csi-app-test logSource="pkg/backup/backup.go:378" name=csi-nginx.163f68fa61b2b99c namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=csi-nginx.163f68fa61b2b99c namespace=csi-app-test resource=events time="2020-10-19T13:54:10Z" level=info msg="Backed up 10 items out of an estimated total of 21 (estimate will change throughout the backup)" backup=velero/csi-app-test logSource="pkg/backup/backup.go:418" name=csi-nginx.163f68fa61b2b99c namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Processing item" backup=velero/csi-app-test logSource="pkg/backup/backup.go:378" name=csi-nginx.163f68fa65a045ec namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=csi-nginx.163f68fa65a045ec namespace=csi-app-test resource=events time="2020-10-19T13:54:10Z" level=info msg="Backed up 11 items out of an estimated total of 21 (estimate will change throughout the backup)" backup=velero/csi-app-test logSource="pkg/backup/backup.go:418" name=csi-nginx.163f68fa65a045ec namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Processing item" backup=velero/csi-app-test logSource="pkg/backup/backup.go:378" name=csi-nginx.163f68fab9d37cb0 namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=csi-nginx.163f68fab9d37cb0 namespace=csi-app-test resource=events time="2020-10-19T13:54:10Z" level=info msg="Backed up 12 items out of an estimated total of 21 (estimate will change throughout the backup)" backup=velero/csi-app-test logSource="pkg/backup/backup.go:418" name=csi-nginx.163f68fab9d37cb0 namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Processing item" backup=velero/csi-app-test logSource="pkg/backup/backup.go:378" name=csi-nginx.163f68fdfc6a7238 namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=csi-nginx.163f68fdfc6a7238 namespace=csi-app-test resource=events time="2020-10-19T13:54:10Z" level=info msg="Backed up 13 items out of an estimated total of 21 (estimate will change throughout the backup)" backup=velero/csi-app-test logSource="pkg/backup/backup.go:418" name=csi-nginx.163f68fdfc6a7238 namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Processing item" backup=velero/csi-app-test logSource="pkg/backup/backup.go:378" name=csi-nginx.163f68ffcf151980 namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=csi-nginx.163f68ffcf151980 namespace=csi-app-test resource=events time="2020-10-19T13:54:10Z" level=info msg="Backed up 14 items out of an estimated total of 21 (estimate will change throughout the backup)" backup=velero/csi-app-test logSource="pkg/backup/backup.go:418" name=csi-nginx.163f68ffcf151980 namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Processing item" backup=velero/csi-app-test logSource="pkg/backup/backup.go:378" name=csi-nginx.163f6911e052cebb namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=csi-nginx.163f6911e052cebb namespace=csi-app-test resource=events time="2020-10-19T13:54:10Z" level=info msg="Backed up 15 items out of an estimated total of 21 (estimate will change throughout the backup)" backup=velero/csi-app-test logSource="pkg/backup/backup.go:418" name=csi-nginx.163f6911e052cebb namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Processing item" backup=velero/csi-app-test logSource="pkg/backup/backup.go:378" name=csi-nginx.163f69166b43e6cc namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=csi-nginx.163f69166b43e6cc namespace=csi-app-test resource=events time="2020-10-19T13:54:10Z" level=info msg="Backed up 16 items out of an estimated total of 21 (estimate will change throughout the backup)" backup=velero/csi-app-test logSource="pkg/backup/backup.go:418" name=csi-nginx.163f69166b43e6cc namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Processing item" backup=velero/csi-app-test logSource="pkg/backup/backup.go:378" name=csi-nginx.163f6917c5b2c73c namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=csi-nginx.163f6917c5b2c73c namespace=csi-app-test resource=events time="2020-10-19T13:54:10Z" level=info msg="Backed up 17 items out of an estimated total of 21 (estimate will change throughout the backup)" backup=velero/csi-app-test logSource="pkg/backup/backup.go:418" name=csi-nginx.163f6917c5b2c73c namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Processing item" backup=velero/csi-app-test logSource="pkg/backup/backup.go:378" name=csi-nginx.163f6917d38ebb03 namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=csi-nginx.163f6917d38ebb03 namespace=csi-app-test resource=events time="2020-10-19T13:54:10Z" level=info msg="Backed up 18 items out of an estimated total of 21 (estimate will change throughout the backup)" backup=velero/csi-app-test logSource="pkg/backup/backup.go:418" name=csi-nginx.163f6917d38ebb03 namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Processing item" backup=velero/csi-app-test logSource="pkg/backup/backup.go:378" name=pvc-csi.163f68fa71715a3c namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=pvc-csi.163f68fa71715a3c namespace=csi-app-test resource=events time="2020-10-19T13:54:10Z" level=info msg="Backed up 19 items out of an estimated total of 21 (estimate will change throughout the backup)" backup=velero/csi-app-test logSource="pkg/backup/backup.go:418" name=pvc-csi.163f68fa71715a3c namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Processing item" backup=velero/csi-app-test logSource="pkg/backup/backup.go:378" name=pvc-csi.163f690998d59d12 namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=pvc-csi.163f690998d59d12 namespace=csi-app-test resource=events time="2020-10-19T13:54:10Z" level=info msg="Backed up 20 items out of an estimated total of 21 (estimate will change throughout the backup)" backup=velero/csi-app-test logSource="pkg/backup/backup.go:418" name=pvc-csi.163f690998d59d12 namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Processing item" backup=velero/csi-app-test logSource="pkg/backup/backup.go:378" name=pvc-csi.163f690b08c3c3da namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Backing up item" backup=velero/csi-app-test logSource="pkg/backup/item_backupper.go:121" name=pvc-csi.163f690b08c3c3da namespace=csi-app-test resource=events time="2020-10-19T13:54:10Z" level=info msg="Backed up 21 items out of an estimated total of 21 (estimate will change throughout the backup)" backup=velero/csi-app-test logSource="pkg/backup/backup.go:418" name=pvc-csi.163f690b08c3c3da namespace=csi-app-test progress= resource=events time="2020-10-19T13:54:10Z" level=info msg="Backed up a total of 21 items" backup=velero/csi-app-test logSource="pkg/backup/backup.go:443" progress= Anything else you would like to add:

kubectl get backupstoragelocations.velero.io -A NAMESPACE NAME PHASE LAST VALIDATED AGE velero default Available <invalid> 5h12m kubectl describe backupstoragelocations.velero.io default -n velero Name: default Namespace: velero Labels: component=velero Annotations: <none> API Version: velero.io/v1 Kind: BackupStorageLocation Metadata: Creation Timestamp: 2020-10-19T09:41:08Z Generation: 1 Managed Fields: API Version: velero.io/v1 Fields Type: FieldsV1 fieldsV1: f:metadata: f:labels: .: f:component: f:spec: .: f:config: .: f:resourceGroup: f:storageAccount: f:subscriptionId: f:objectStorage: .: f:bucket: f:provider: Manager: velero Operation: Update Time: 2020-10-19T09:41:08Z API Version: velero.io/v1 Fields Type: FieldsV1 fieldsV1: f:status: .: f:lastSyncedTime: f:lastValidationTime: f:phase: Manager: velero-server Operation: Update Time: 2020-10-19T14:54:31Z Resource Version: 20003108 Self Link: /apis/velero.io/v1/namespaces/velero/backupstoragelocations/default UID: 0cc9afc5-9652-4007-a113-87590b5704ea Spec: Config: Resource Group: xxxxxxxxxxxxxxxxxxx Storage Account: xxxxxxxxxxxxxxxxxxxxx Subscription Id: xxxxxxxxxxxxxxxxxxxxxx Object Storage: Bucket: velero Provider: azure Status: Last Synced Time: 2020-10-19T14:55:35Z Last Validation Time: 2020-10-19T14:55:36Z Phase: Available Events: <none>

Environment:

• Velero version (use velero version): 1.5.1
• Velero features (use velero client config get features): features: <NOT SET>
• Kubernetes version (use kubectl version): v1.18.5
• Cloud provider or hardware configuration: azure
• OS (e.g. from /etc/os-release): RHEL 7.6

Vote on this issue!

This is an invitation to the Velero community to vote on issues, you can see the project’s top voted issues listed here.
Use the “reaction smiley face” up to the right of this comment to vote.

• 👍 for “I would like to see this bug fixed as soon as possible”
• 👎 for “There are more important bugs to focus on right now”