trident: Trident CSI not provisioning volumes correctly and producing exit code 32
Describe the bug it appears that the CSI is unable to mount the NFS volume to a PVC in azure, I am unsure as to why this is as NFS is installed by default in every node in the AKS vmss cluster
Environment Provide accurate information about the environment to help us reproduce the issue.
- Trident version: latest via
- Trident installation flags used: [e.g. -d -n trident --use-custom-yaml]
- Container runtime: [e.g. Docker 19.03.1-CE]
- Kubernetes version: [e.g. 1.23.1]
- Kubernetes orchestrator: [AKS]
- Kubernetes enabled feature gates: [?]
- OS: [Ubuntu 18.04]
- NetApp backend types: [Net app CSI Trident Operatror Azure CRD’s]
- Other:
To Reproduce Deploy WordPress bitnami helm chart as RWX with cluster autoscaling enabled along with Promeuthus and grafana This results in error 32 codes it also looks like Trident expects a minimum of 100GB to be provisioned per volume but I think this value should really be 100G or 100Gi, I’m not sure exactly how to provision 100GB of storage via kubernetes
Expected behavior NFS volume in Netapp mounted to the pod in running state
Additional context
PS C:\Users\danny> kubectl get po --kubeconfig config
NAME READY STATUS RESTARTS AGE
wordpress-7b68f9d9bc-9nz27 0/2 ContainerCreating 0 31m
wordpress-memcached-774f78cc49-48vsx 1/1 Running 0 31m
PS C:\Users\danny> kubectl describe po --kubeconfig config
Name: wordpress-7b68f9d9bc-9nz27
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal TriggeredScaleUp 31m cluster-autoscaler pod triggered scale-up: [{aks-akscluster-26960436-vmss 1->2 (max: 3)}]
Warning FailedScheduling 30m (x4 over 33m) default-scheduler 0/1 nodes are available: 1 Insufficient cpu.
Warning FailedScheduling 29m default-scheduler 0/2 nodes are available: 1 Insufficient cpu, 1 node(s) had taint {node.kubernetes.io/network-unavailable: }, that the pod didn't tolerate.
Normal Scheduled 27m default-scheduler Successfully assigned default/wordpress-7b68f9d9bc-9nz27 to aks-akscluster-26960436-vmss000001
Normal SuccessfulAttachVolume 27m attachdetach-controller AttachVolume.Attach succeeded for volume "pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d"
Warning FailedMount 16m kubelet Unable to attach or mount volumes: unmounted volumes=[wordpress-data], unattached volumes=[kube-api-access-b5scw wordpress-data custom-postinit]: timed out waiting for the condition
Warning FailedMount 3m39s (x10 over 25m) kubelet MountVolume.SetUp failed for volume "pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d" : rpc error: code = DeadlineExceeded desc = context deadline exceeded
Warning FailedMount 52s (x11 over 25m) kubelet Unable to attach or mount volumes: unmounted volumes=[wordpress-data], unattached volumes=[wordpress-data custom-postinit kube-api-access-b5scw]: timed out waiting for the condition
The wordpress-memcached-774f78cc49-48vsx is bizarre that it’s running as this is using the same storage class in the WordPress bitnami helmchart
PS C:\Users\danny> kubectl logs trident-csi-ddhgs -n netapp --kubeconfig config -c trident-main
time="2022-02-27T11:48:30Z" level=info msg="Running Trident storage orchestrator." binary=/trident_orchestrator build_time="Mon Jan 31 15:52:06 UTC 2022" version=22.01.0
time="2022-02-27T11:48:30Z" level=info msg="Initializing plain CSI helper frontend."
time="2022-02-27T11:48:30Z" level=info msg="Added frontend." name=plain_csi_helper
time="2022-02-27T11:48:30Z" level=info msg="Initializing CSI frontend." name=aks-akscluster-26960436-vmss000001 version=22.01.0
time="2022-02-27T11:48:30Z" level=info msg="Enabling node service capability." capability=STAGE_UNSTAGE_VOLUME
time="2022-02-27T11:48:30Z" level=info msg="Enabling node service capability." capability=EXPAND_VOLUME
time="2022-02-27T11:48:30Z" level=info msg="Enabling node service capability." capability=GET_VOLUME_STATS
time="2022-02-27T11:48:30Z" level=info msg="Enabling volume access mode." mode=SINGLE_NODE_WRITER
time="2022-02-27T11:48:30Z" level=info msg="Enabling volume access mode." mode=SINGLE_NODE_READER_ONLY
time="2022-02-27T11:48:30Z" level=info msg="Enabling volume access mode." mode=MULTI_NODE_READER_ONLY
time="2022-02-27T11:48:30Z" level=info msg="Enabling volume access mode." mode=MULTI_NODE_SINGLE_WRITER
time="2022-02-27T11:48:30Z" level=info msg="Enabling volume access mode." mode=MULTI_NODE_MULTI_WRITER
time="2022-02-27T11:48:30Z" level=info msg="Added frontend." name=csi
time="2022-02-27T11:48:30Z" level=info msg="Initializing HTTPS REST frontend." address=":17546"
time="2022-02-27T11:48:30Z" level=info msg="Added frontend." name="HTTPS REST"
time="2022-02-27T11:48:30Z" level=info msg="Added 0 existing volume(s)" requestID=370caff8-8090-400b-9617-c08b6605d607 requestSource=Internal
time="2022-02-27T11:48:30Z" level=info msg="Activating HTTPS REST frontend." address=":17546"
time="2022-02-27T11:48:30Z" level=info msg="Trident bootstrapped successfully."
time="2022-02-27T11:48:30Z" level=info msg="Activating plain CSI helper frontend."
time="2022-02-27T11:48:30Z" level=info msg="Activating CSI frontend." requestID=c83ef372-7c1b-4c79-acd5-84d41d21a7bd requestSource=Internal
time="2022-02-27T11:48:30Z" level=info msg="Starting periodic node access reconciliation service." requestID=d8bd8486-ec25-43ae-8ae6-cf39cd7178d5 requestSource=Periodic
time="2022-02-27T11:48:30Z" level=warning msg="Could not find iSCSI initiator name." requestID=c83ef372-7c1b-4c79-acd5-84d41d21a7bd requestSource=Internal
time="2022-02-27T11:48:30Z" level=info msg="Discovered IP addresses." IP Addresses="[10.240.0.5 10.244.1.1]" requestID=c83ef372-7c1b-4c79-acd5-84d41d21a7bd requestSource=Internal
time="2022-02-27T11:49:00Z" level=warning msg="Could not update Trident controller with node registration, will retry." error="could not log into the Trident CSI Controller: error communicating with Trident CSI Controller; Put \"https://10.0.86.71:34571/trident/v1/node/aks-akscluster-26960436-vmss000001\": context deadline exceeded (Client.Timeo
ut exceeded while awaiting headers)" increment=9.734991122s requestID=c83ef372-7c1b-4c79-acd5-84d41d21a7bd requestSource=Internal
time="2022-02-27T11:49:10Z" level=info msg="Updated Trident controller with node registration." node=aks-akscluster-26960436-vmss000001 requestID=c83ef372-7c1b-4c79-acd5-84d41d21a7bd requestSource=Internal
time="2022-02-27T11:49:10Z" level=info msg="Listening for GRPC connections." name=/plugin/csi.sock net=unix
time="2022-02-27T11:53:02Z" level=error msg="GRPC error: rpc error: code = Internal desc = error mounting NFS volume 10.0.0.68:/pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d on mountpoint /var/lib/kubelet/pods/439424b3-2be1-468c-8582-e323cb790500/volumes/kubernetes.io~csi/pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d/mount: exit status 32" requestID=92ec9
8f7-78db-4fae-9aaf-0089e7bc5247 requestSource=CSI
time="2022-02-27T11:56:02Z" level=error msg="GRPC error: rpc error: code = Internal desc = error mounting NFS volume 10.0.0.68:/pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d on mountpoint /var/lib/kubelet/pods/439424b3-2be1-468c-8582-e323cb790500/volumes/kubernetes.io~csi/pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d/mount: exit status 32" requestID=b0f9c
53a-b26e-43f9-9d84-84ad95618295 requestSource=CSI
time="2022-02-27T11:59:03Z" level=error msg="GRPC error: rpc error: code = Internal desc = error mounting NFS volume 10.0.0.68:/pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d on mountpoint /var/lib/kubelet/pods/439424b3-2be1-468c-8582-e323cb790500/volumes/kubernetes.io~csi/pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d/mount: exit status 32" requestID=07215
60b-5783-4709-a2ba-c3f13da96770 requestSource=CSI
PS C:\Users\danny> kubectl logs trident-csi-558f9448cd-hxmjt -n netapp -c trident-main --kubeconfig config
time="2022-02-27T11:32:12Z" level=info msg="Running Trident storage orchestrator." binary=/trident_orchestrator build_time="Mon Jan 31 15:52:06 UTC 2022" version=22.01.0
time="2022-02-27T11:32:12Z" level=warning msg="Could not get all server resources." error="unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
time="2022-02-27T11:32:12Z" level=info msg="Created Kubernetes clients." namespace=netapp version=v1.23.3
time="2022-02-27T11:32:12Z" level=info msg="Initializing metrics frontend." address=":8001"
time="2022-02-27T11:32:12Z" level=info msg="Added frontend." name=metrics
time="2022-02-27T11:32:12Z" level=info msg="Initializing K8S helper frontend." requestID=f544c0ee-10e2-4c88-bbcf-f672ef60a22f requestSource=Internal
time="2022-02-27T11:32:12Z" level=info msg="K8S helper determined the container orchestrator version." gitVersion=v1.23.3 requestID=f544c0ee-10e2-4c88-bbcf-f672ef60a22f requestSource=Internal version=1.23
time="2022-02-27T11:32:12Z" level=info msg="Added frontend." name=k8s_csi_helper
time="2022-02-27T11:32:12Z" level=info msg="Initializing CSI frontend." name=aks-akscluster-26960436-vmss000000 version=22.01.0
time="2022-02-27T11:32:12Z" level=info msg="Enabling controller service capability." capability=CREATE_DELETE_VOLUME
time="2022-02-27T11:32:12Z" level=info msg="Enabling controller service capability." capability=PUBLISH_UNPUBLISH_VOLUME
time="2022-02-27T11:32:12Z" level=info msg="Enabling controller service capability." capability=LIST_VOLUMES
time="2022-02-27T11:32:12Z" level=info msg="Enabling controller service capability." capability=CREATE_DELETE_SNAPSHOT
time="2022-02-27T11:32:12Z" level=info msg="Enabling controller service capability." capability=LIST_SNAPSHOTS
time="2022-02-27T11:32:12Z" level=info msg="Enabling controller service capability." capability=EXPAND_VOLUME
time="2022-02-27T11:32:12Z" level=info msg="Enabling controller service capability." capability=CLONE_VOLUME
time="2022-02-27T11:32:12Z" level=info msg="Enabling controller service capability." capability=LIST_VOLUMES_PUBLISHED_NODES
time="2022-02-27T11:32:12Z" level=info msg="Enabling volume access mode." mode=SINGLE_NODE_WRITER
time="2022-02-27T11:32:12Z" level=info msg="Enabling volume access mode." mode=SINGLE_NODE_READER_ONLY
time="2022-02-27T11:32:12Z" level=info msg="Enabling volume access mode." mode=MULTI_NODE_READER_ONLY
time="2022-02-27T11:32:12Z" level=info msg="Enabling volume access mode." mode=MULTI_NODE_SINGLE_WRITER
time="2022-02-27T11:32:12Z" level=info msg="Enabling volume access mode." mode=MULTI_NODE_MULTI_WRITER
time="2022-02-27T11:32:12Z" level=info msg="Added frontend." name=csi
time="2022-02-27T11:32:12Z" level=info msg="Initializing Trident CRD controller frontend." namespace=netapp
time="2022-02-27T11:32:12Z" level=info msg="Creating event broadcaster."
time="2022-02-27T11:32:12Z" level=info msg="Setting up CRD controller event handlers."
time="2022-02-27T11:32:12Z" level=info msg="Added frontend." name=crd
time="2022-02-27T11:32:12Z" level=info msg="Initializing HTTP REST frontend." address="127.0.0.1:8000"
time="2022-02-27T11:32:12Z" level=info msg="Added frontend." name="HTTP REST"
time="2022-02-27T11:32:12Z" level=info msg="Initializing HTTPS REST frontend." address=":8443"
time="2022-02-27T11:32:12Z" level=info msg="Added frontend." name="HTTPS REST"
time="2022-02-27T11:32:12Z" level=info msg="Activating metrics frontend." address=":8001"
time="2022-02-27T11:32:12Z" level=info msg="Activating HTTP REST frontend." address="127.0.0.1:8000"
time="2022-02-27T11:32:12Z" level=info msg="Activating HTTPS REST frontend." address=":8443"
time="2022-02-27T11:32:12Z" level=warning msg="Persistent state version not found, creating." OrchestratorAPIVersion=1 PersistentStoreVersion=crdv1 requestID=16f61a84-d01a-43be-b777-96568c4fe9d9 requestSource=Internal
time="2022-02-27T11:32:12Z" level=info msg="Added 0 existing volume(s)" requestID=16f61a84-d01a-43be-b777-96568c4fe9d9 requestSource=Internal
time="2022-02-27T11:32:13Z" level=info msg="Trident bootstrapped successfully."
time="2022-02-27T11:32:13Z" level=info msg="Activating K8S helper frontend." requestID=e80f7bf7-e1c4-4a44-8026-9cc596e3a82e requestSource=Internal
time="2022-02-27T11:32:13Z" level=info msg="Activating CRD frontend."
time="2022-02-27T11:32:13Z" level=info msg="Activating CSI frontend." requestID=e513e51b-fd5a-4572-abc4-96245b0047d2 requestSource=Internal
time="2022-02-27T11:32:13Z" level=info msg="Listening for GRPC connections." name=/plugin/csi.sock net=unix
time="2022-02-27T11:32:13Z" level=info msg="Starting Trident CRD controller."
time="2022-02-27T11:32:13Z" level=info msg="Waiting for informer caches to sync."
time="2022-02-27T11:32:13Z" level=info msg="Starting periodic node access reconciliation service." requestID=5441ec07-dec6-440a-b764-4dceab0645ec requestSource=Periodic
I0227 11:32:14.237758 1 request.go:665] Waited for 1.159699954s due to client-side throttling, not priority and fairness, request: GET:https://10.0.0.1:443/apis/trident.netapp.io/v1/namespaces/netapp/tridentvolumepublications?limit=500&resourceVersion=0
time="2022-02-27T11:32:15Z" level=info msg="Starting workers."
time="2022-02-27T11:32:15Z" level=info msg="Started workers."
time="2022-02-27T11:32:44Z" level=info msg="Determined topology labels for node: map[topology.kubernetes.io/region:uksouth topology.kubernetes.io/zone:uksouth-1]" node=aks-akscluster-26960436-vmss000000 requestID=6df33250-146b-4d48-9951-72f9cf0e77e0 requestSource=REST
time="2022-02-27T11:32:45Z" level=info msg="Added a new node." handler=AddOrUpdateNode node=aks-akscluster-26960436-vmss000000 requestID=6df33250-146b-4d48-9951-72f9cf0e77e0 requestSource=REST
time="2022-02-27T11:35:07Z" level=info msg="Discovered Azure resources." capacityPools=1 crdControllerEvent=add requestID=728c892e-b200-40ed-8bec-b5fac0c5501c requestSource=CRD resourceGroups=1 subnets=1
time="2022-02-27T11:35:07Z" level=info msg="Storage driver initialized." crdControllerEvent=add driver=azure-netapp-files requestID=728c892e-b200-40ed-8bec-b5fac0c5501c requestSource=CRD
time="2022-02-27T11:35:07Z" level=info msg="Created new storage backend." backend="&{0xc00094e3c0 netapp-netapppool true online map[netapp-netapppool_pool:0xc0003b4b40] map[] false}" crdControllerEvent=add requestID=728c892e-b200-40ed-8bec-b5fac0c5501c requestSource=CRD
time="2022-02-27T11:35:07Z" level=info msg="Newly added backend satisfies no storage classes." backend=netapp-netapppool crdControllerEvent=add requestID=728c892e-b200-40ed-8bec-b5fac0c5501c requestSource=CRD
time="2022-02-27T11:35:07Z" level=info msg="Synced 'netapp/nett-app-backend'" crdControllerEvent=add logSource=trident-crd-controller requestID=728c892e-b200-40ed-8bec-b5fac0c5501c requestSource=CRD
time="2022-02-27T11:35:07Z" level=info msg=-------------------------------------------------
time="2022-02-27T11:35:07Z" level=info msg=-------------------------------------------------
time="2022-02-27T11:42:00Z" level=info msg="Storage class satisfied by 1 storage pools." requestID=39e4a9b4-9b8e-49c8-878f-d4fcd8398028 requestSource=Kubernetes storageClass=wordpress-storage-class-netapp
time="2022-02-27T11:42:00Z" level=info msg="K8S helper added a storage class." name=wordpress-storage-class-netapp parameters="map[backendType:azure-netapp-files fsType:nfs]" provisioner=csi.trident.netapp.io requestID=39e4a9b4-9b8e-49c8-878f-d4fcd8398028 requestSource=Kubernetes
time="2022-02-27T11:42:32Z" level=info msg="Found PVC for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." UID=ce36221a-eb54-465a-b271-2a7df09067b5 name=prometheus-prometheus-kube-prometheus-prometheus-db-prometheus-prometheus-kube-prometheus-prometheus-0 namespace=monitoring requestID=58e5f2a1-6732-4322-acac-92c2c1907732 requestSourc
e=CSI size="{{100 9} {<nil>} 100G DecimalSI}" storageClass=wordpress-storage-class-netapp
time="2022-02-27T11:42:32Z" level=info msg="Found storage class for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." name=wordpress-storage-class-netapp requestID=58e5f2a1-6732-4322-acac-92c2c1907732 requestSource=CSI
time="2022-02-27T11:42:33Z" level=warning msg="Requested size is too small. Setting volume size to the minimum allowable (100 GB)." name=pvc-ce36221a-eb54-465a-b271-2a7df09067b5 requestID=58e5f2a1-6732-4322-acac-92c2c1907732 requestSource=CSI size=100000000000
time="2022-02-27T11:42:34Z" level=info msg="Volume created." API=VolumesClient.CreateOrUpdate correlationID=b95140a3-5622-4e98-b959-7355d5c91a04 creationToken=pvc-ce36221a-eb54-465a-b271-2a7df09067b5 requestID=58e5f2a1-6732-4322-acac-92c2c1907732 requestSource=CSI volume=host_rg/netapp-netappaccount/netapp-netapppool/pvc-ce36221a-eb54-465a-b271-
2a7df09067b5
time="2022-02-27T11:42:34Z" level=info msg="Waiting for volume state." desiredState=Succeeded requestID=58e5f2a1-6732-4322-acac-92c2c1907732 requestSource=CSI
time="2022-02-27T11:42:41Z" level=error msg="Volume state was not Succeeded after 10.00 seconds." requestID=58e5f2a1-6732-4322-acac-92c2c1907732 requestSource=CSI
time="2022-02-27T11:42:41Z" level=warning msg="Volume still creating on this backend." backend=netapp-netapppool backendUUID=07357a57-d3f9-45ac-a827-c03baf907fd0 error="volume state is Creating, not Succeeded" pool=netapp-netapppool_pool requestID=58e5f2a1-6732-4322-acac-92c2c1907732 requestSource=CSI volume=pvc-ce36221a-eb54-465a-b271-2a7df0906
7b5
time="2022-02-27T11:42:41Z" level=error msg="GRPC error: rpc error: code = Unknown desc = volume state is Creating, not Succeeded" requestID=58e5f2a1-6732-4322-acac-92c2c1907732 requestSource=CSI
time="2022-02-27T11:42:49Z" level=info msg="Found PVC for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." UID=ce36221a-eb54-465a-b271-2a7df09067b5 name=prometheus-prometheus-kube-prometheus-prometheus-db-prometheus-prometheus-kube-prometheus-prometheus-0 namespace=monitoring requestID=740fbbbf-fee8-47fa-ac6a-df708bcfea96 requestSourc
e=CSI size="{{100 9} {<nil>} 100G DecimalSI}" storageClass=wordpress-storage-class-netapp
time="2022-02-27T11:42:49Z" level=info msg="Found storage class for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." name=wordpress-storage-class-netapp requestID=740fbbbf-fee8-47fa-ac6a-df708bcfea96 requestSource=CSI
time="2022-02-27T11:42:50Z" level=warning msg="Volume still creating on this backend." backend=netapp-netapppool backendUUID=07357a57-d3f9-45ac-a827-c03baf907fd0 error="volume state is still Creating, not Succeeded" pool=netapp-netapppool_pool requestID=740fbbbf-fee8-47fa-ac6a-df708bcfea96 requestSource=CSI volume=pvc-ce36221a-eb54-465a-b271-2a7
df09067b5
time="2022-02-27T11:42:50Z" level=error msg="GRPC error: rpc error: code = Unknown desc = volume state is still Creating, not Succeeded" requestID=740fbbbf-fee8-47fa-ac6a-df708bcfea96 requestSource=CSI
time="2022-02-27T11:43:06Z" level=info msg="Found PVC for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." UID=ce36221a-eb54-465a-b271-2a7df09067b5 name=prometheus-prometheus-kube-prometheus-prometheus-db-prometheus-prometheus-kube-prometheus-prometheus-0 namespace=monitoring requestID=59b7a01f-c8ba-48be-84ea-18ad481646b2 requestSourc
e=CSI size="{{100 9} {<nil>} 100G DecimalSI}" storageClass=wordpress-storage-class-netapp
time="2022-02-27T11:43:06Z" level=info msg="Found storage class for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." name=wordpress-storage-class-netapp requestID=59b7a01f-c8ba-48be-84ea-18ad481646b2 requestSource=CSI
time="2022-02-27T11:43:06Z" level=warning msg="Volume still creating on this backend." backend=netapp-netapppool backendUUID=07357a57-d3f9-45ac-a827-c03baf907fd0 error="volume state is still Creating, not Succeeded" pool=netapp-netapppool_pool requestID=59b7a01f-c8ba-48be-84ea-18ad481646b2 requestSource=CSI volume=pvc-ce36221a-eb54-465a-b271-2a7
df09067b5
time="2022-02-27T11:43:06Z" level=error msg="GRPC error: rpc error: code = Unknown desc = volume state is still Creating, not Succeeded" requestID=59b7a01f-c8ba-48be-84ea-18ad481646b2 requestSource=CSI
time="2022-02-27T11:43:36Z" level=info msg="Found PVC for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." UID=ce36221a-eb54-465a-b271-2a7df09067b5 name=prometheus-prometheus-kube-prometheus-prometheus-db-prometheus-prometheus-kube-prometheus-prometheus-0 namespace=monitoring requestID=7e2033f8-c4e3-4e9f-a13c-43618da910c7 requestSourc
e=CSI size="{{100 9} {<nil>} 100G DecimalSI}" storageClass=wordpress-storage-class-netapp
time="2022-02-27T11:43:36Z" level=info msg="Found storage class for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." name=wordpress-storage-class-netapp requestID=7e2033f8-c4e3-4e9f-a13c-43618da910c7 requestSource=CSI
time="2022-02-27T11:43:36Z" level=warning msg="Volume still creating on this backend." backend=netapp-netapppool backendUUID=07357a57-d3f9-45ac-a827-c03baf907fd0 error="volume state is still Creating, not Succeeded" pool=netapp-netapppool_pool requestID=7e2033f8-c4e3-4e9f-a13c-43618da910c7 requestSource=CSI volume=pvc-ce36221a-eb54-465a-b271-2a7
df09067b5
time="2022-02-27T11:43:36Z" level=error msg="GRPC error: rpc error: code = Unknown desc = volume state is still Creating, not Succeeded" requestID=7e2033f8-c4e3-4e9f-a13c-43618da910c7 requestSource=CSI
time="2022-02-27T11:44:06Z" level=info msg="Found PVC for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." UID=ce36221a-eb54-465a-b271-2a7df09067b5 name=prometheus-prometheus-kube-prometheus-prometheus-db-prometheus-prometheus-kube-prometheus-prometheus-0 namespace=monitoring requestID=3b4febf2-5bcc-4dbb-9e77-80828d0b5e5d requestSourc
e=CSI size="{{100 9} {<nil>} 100G DecimalSI}" storageClass=wordpress-storage-class-netapp
time="2022-02-27T11:44:06Z" level=info msg="Found storage class for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." name=wordpress-storage-class-netapp requestID=3b4febf2-5bcc-4dbb-9e77-80828d0b5e5d requestSource=CSI
time="2022-02-27T11:44:06Z" level=warning msg="Volume still creating on this backend." backend=netapp-netapppool backendUUID=07357a57-d3f9-45ac-a827-c03baf907fd0 error="volume state is still Creating, not Succeeded" pool=netapp-netapppool_pool requestID=3b4febf2-5bcc-4dbb-9e77-80828d0b5e5d requestSource=CSI volume=pvc-ce36221a-eb54-465a-b271-2a7
df09067b5
time="2022-02-27T11:44:06Z" level=error msg="GRPC error: rpc error: code = Unknown desc = volume state is still Creating, not Succeeded" requestID=3b4febf2-5bcc-4dbb-9e77-80828d0b5e5d requestSource=CSI
time="2022-02-27T11:44:36Z" level=info msg="Found PVC for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." UID=ce36221a-eb54-465a-b271-2a7df09067b5 name=prometheus-prometheus-kube-prometheus-prometheus-db-prometheus-prometheus-kube-prometheus-prometheus-0 namespace=monitoring requestID=aed9619f-6b33-4274-bfb7-112b1b10530a requestSourc
e=CSI size="{{100 9} {<nil>} 100G DecimalSI}" storageClass=wordpress-storage-class-netapp
time="2022-02-27T11:44:36Z" level=info msg="Found storage class for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." name=wordpress-storage-class-netapp requestID=aed9619f-6b33-4274-bfb7-112b1b10530a requestSource=CSI
time="2022-02-27T11:44:36Z" level=warning msg="Volume still creating on this backend." backend=netapp-netapppool backendUUID=07357a57-d3f9-45ac-a827-c03baf907fd0 error="volume state is still Creating, not Succeeded" pool=netapp-netapppool_pool requestID=aed9619f-6b33-4274-bfb7-112b1b10530a requestSource=CSI volume=pvc-ce36221a-eb54-465a-b271-2a7
df09067b5
time="2022-02-27T11:44:36Z" level=error msg="GRPC error: rpc error: code = Unknown desc = volume state is still Creating, not Succeeded" requestID=aed9619f-6b33-4274-bfb7-112b1b10530a requestSource=CSI
time="2022-02-27T11:45:06Z" level=info msg="Found PVC for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." UID=ce36221a-eb54-465a-b271-2a7df09067b5 name=prometheus-prometheus-kube-prometheus-prometheus-db-prometheus-prometheus-kube-prometheus-prometheus-0 namespace=monitoring requestID=8433bfd9-c4aa-4c67-98e1-936cd3804d56 requestSourc
e=CSI size="{{100 9} {<nil>} 100G DecimalSI}" storageClass=wordpress-storage-class-netapp
time="2022-02-27T11:45:06Z" level=info msg="Found storage class for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." name=wordpress-storage-class-netapp requestID=8433bfd9-c4aa-4c67-98e1-936cd3804d56 requestSource=CSI
time="2022-02-27T11:45:06Z" level=warning msg="Volume still creating on this backend." backend=netapp-netapppool backendUUID=07357a57-d3f9-45ac-a827-c03baf907fd0 error="volume state is still Creating, not Succeeded" pool=netapp-netapppool_pool requestID=8433bfd9-c4aa-4c67-98e1-936cd3804d56 requestSource=CSI volume=pvc-ce36221a-eb54-465a-b271-2a7
df09067b5
time="2022-02-27T11:45:06Z" level=error msg="GRPC error: rpc error: code = Unknown desc = volume state is still Creating, not Succeeded" requestID=8433bfd9-c4aa-4c67-98e1-936cd3804d56 requestSource=CSI
time="2022-02-27T11:45:36Z" level=info msg="Found PVC for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." UID=ce36221a-eb54-465a-b271-2a7df09067b5 name=prometheus-prometheus-kube-prometheus-prometheus-db-prometheus-prometheus-kube-prometheus-prometheus-0 namespace=monitoring requestID=e1b10a31-3f15-47c9-94fc-ed3519abbd4b requestSourc
e=CSI size="{{100 9} {<nil>} 100G DecimalSI}" storageClass=wordpress-storage-class-netapp
time="2022-02-27T11:45:36Z" level=info msg="Found storage class for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." name=wordpress-storage-class-netapp requestID=e1b10a31-3f15-47c9-94fc-ed3519abbd4b requestSource=CSI
time="2022-02-27T11:45:36Z" level=info msg="Discovered Azure resources." capacityPools=1 requestID=e1b10a31-3f15-47c9-94fc-ed3519abbd4b requestSource=CSI resourceGroups=1 subnets=1
time="2022-02-27T11:45:37Z" level=warning msg="Volume still creating on this backend." backend=netapp-netapppool backendUUID=07357a57-d3f9-45ac-a827-c03baf907fd0 error="volume state is still Creating, not Succeeded" pool=netapp-netapppool_pool requestID=e1b10a31-3f15-47c9-94fc-ed3519abbd4b requestSource=CSI volume=pvc-ce36221a-eb54-465a-b271-2a7
df09067b5
time="2022-02-27T11:45:37Z" level=error msg="GRPC error: rpc error: code = Unknown desc = volume state is still Creating, not Succeeded" requestID=e1b10a31-3f15-47c9-94fc-ed3519abbd4b requestSource=CSI
time="2022-02-27T11:46:07Z" level=info msg="Found PVC for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." UID=ce36221a-eb54-465a-b271-2a7df09067b5 name=prometheus-prometheus-kube-prometheus-prometheus-db-prometheus-prometheus-kube-prometheus-prometheus-0 namespace=monitoring requestID=b24b6a4c-6997-40ae-a679-b825e9ea3490 requestSourc
e=CSI size="{{100 9} {<nil>} 100G DecimalSI}" storageClass=wordpress-storage-class-netapp
time="2022-02-27T11:46:07Z" level=info msg="Found storage class for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." name=wordpress-storage-class-netapp requestID=b24b6a4c-6997-40ae-a679-b825e9ea3490 requestSource=CSI
time="2022-02-27T11:46:07Z" level=warning msg="Volume still creating on this backend." backend=netapp-netapppool backendUUID=07357a57-d3f9-45ac-a827-c03baf907fd0 error="volume state is still Creating, not Succeeded" pool=netapp-netapppool_pool requestID=b24b6a4c-6997-40ae-a679-b825e9ea3490 requestSource=CSI volume=pvc-ce36221a-eb54-465a-b271-2a7
df09067b5
time="2022-02-27T11:46:07Z" level=error msg="GRPC error: rpc error: code = Unknown desc = volume state is still Creating, not Succeeded" requestID=b24b6a4c-6997-40ae-a679-b825e9ea3490 requestSource=CSI
time="2022-02-27T11:46:37Z" level=info msg="Found PVC for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." UID=ce36221a-eb54-465a-b271-2a7df09067b5 name=prometheus-prometheus-kube-prometheus-prometheus-db-prometheus-prometheus-kube-prometheus-prometheus-0 namespace=monitoring requestID=48c52c43-6815-4cd0-a9e4-28bc95e96274 requestSourc
e=CSI size="{{100 9} {<nil>} 100G DecimalSI}" storageClass=wordpress-storage-class-netapp
time="2022-02-27T11:46:37Z" level=info msg="Found storage class for requested volume pvc-ce36221a-eb54-465a-b271-2a7df09067b5." name=wordpress-storage-class-netapp requestID=48c52c43-6815-4cd0-a9e4-28bc95e96274 requestSource=CSI
time="2022-02-27T11:46:37Z" level=warning msg="Volume already exists." name=pvc-ce36221a-eb54-465a-b271-2a7df09067b5 requestID=48c52c43-6815-4cd0-a9e4-28bc95e96274 requestSource=CSI state=Succeeded
time="2022-02-27T11:46:37Z" level=warning msg="Volume already exists." backend=netapp-netapppool requestID=48c52c43-6815-4cd0-a9e4-28bc95e96274 requestSource=CSI volume=pvc-ce36221a-eb54-465a-b271-2a7df09067b5
time="2022-02-27T11:49:10Z" level=info msg="Determined topology labels for node: map[topology.kubernetes.io/region:uksouth topology.kubernetes.io/zone:uksouth-1]" node=aks-akscluster-26960436-vmss000001 requestID=c83ef372-7c1b-4c79-acd5-84d41d21a7bd requestSource=REST
time="2022-02-27T11:49:10Z" level=info msg="Added a new node." handler=AddOrUpdateNode node=aks-akscluster-26960436-vmss000001 requestID=c83ef372-7c1b-4c79-acd5-84d41d21a7bd requestSource=REST
time="2022-02-27T11:49:22Z" level=info msg="Found PVC for requested volume pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d." UID=1d9eeaac-e0fe-498c-8376-9ee39c30fb2d name=wordpress namespace=default requestID=28799fe2-2796-467e-b1a0-548f0d353013 requestSource=CSI size="{{100 9} {<nil>} 100G DecimalSI}" storageClass=wordpress-storage-class-netapp
time="2022-02-27T11:49:22Z" level=info msg="Found storage class for requested volume pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d." name=wordpress-storage-class-netapp requestID=28799fe2-2796-467e-b1a0-548f0d353013 requestSource=CSI
time="2022-02-27T11:49:22Z" level=warning msg="Requested size is too small. Setting volume size to the minimum allowable (100 GB)." name=pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d requestID=28799fe2-2796-467e-b1a0-548f0d353013 requestSource=CSI size=100000000000
time="2022-02-27T11:49:23Z" level=info msg="Volume created." API=VolumesClient.CreateOrUpdate correlationID=1a8c7729-4d30-4219-a475-7d210d7ab4ae creationToken=pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d requestID=28799fe2-2796-467e-b1a0-548f0d353013 requestSource=CSI volume=host_rg/netapp-netappaccount/netapp-netapppool/pvc-1d9eeaac-e0fe-498c-8376-
9ee39c30fb2d
time="2022-02-27T11:49:23Z" level=info msg="Waiting for volume state." desiredState=Succeeded requestID=28799fe2-2796-467e-b1a0-548f0d353013 requestSource=CSI
time="2022-02-27T11:49:30Z" level=error msg="Volume state was not Succeeded after 10.00 seconds." requestID=28799fe2-2796-467e-b1a0-548f0d353013 requestSource=CSI
time="2022-02-27T11:49:30Z" level=warning msg="Volume still creating on this backend." backend=netapp-netapppool backendUUID=07357a57-d3f9-45ac-a827-c03baf907fd0 error="volume state is Creating, not Succeeded" pool=netapp-netapppool_pool requestID=28799fe2-2796-467e-b1a0-548f0d353013 requestSource=CSI volume=pvc-1d9eeaac-e0fe-498c-8376-9ee39c30f
b2d
time="2022-02-27T11:49:30Z" level=error msg="GRPC error: rpc error: code = Unknown desc = volume state is Creating, not Succeeded" requestID=28799fe2-2796-467e-b1a0-548f0d353013 requestSource=CSI
time="2022-02-27T11:49:38Z" level=info msg="Found PVC for requested volume pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d." UID=1d9eeaac-e0fe-498c-8376-9ee39c30fb2d name=wordpress namespace=default requestID=c28ef4ae-3b46-4b12-9f43-c1fed3eb4748 requestSource=CSI size="{{100 9} {<nil>} 100G DecimalSI}" storageClass=wordpress-storage-class-netapp
time="2022-02-27T11:49:38Z" level=info msg="Found storage class for requested volume pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d." name=wordpress-storage-class-netapp requestID=c28ef4ae-3b46-4b12-9f43-c1fed3eb4748 requestSource=CSI
time="2022-02-27T11:49:38Z" level=warning msg="Volume still creating on this backend." backend=netapp-netapppool backendUUID=07357a57-d3f9-45ac-a827-c03baf907fd0 error="volume state is still Creating, not Succeeded" pool=netapp-netapppool_pool requestID=c28ef4ae-3b46-4b12-9f43-c1fed3eb4748 requestSource=CSI volume=pvc-1d9eeaac-e0fe-498c-8376-9ee
39c30fb2d
time="2022-02-27T11:49:38Z" level=error msg="GRPC error: rpc error: code = Unknown desc = volume state is still Creating, not Succeeded" requestID=c28ef4ae-3b46-4b12-9f43-c1fed3eb4748 requestSource=CSI
time="2022-02-27T11:49:54Z" level=info msg="Found PVC for requested volume pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d." UID=1d9eeaac-e0fe-498c-8376-9ee39c30fb2d name=wordpress namespace=default requestID=dcdc9522-09d4-4f3a-9778-fd84b5009db9 requestSource=CSI size="{{100 9} {<nil>} 100G DecimalSI}" storageClass=wordpress-storage-class-netapp
time="2022-02-27T11:49:54Z" level=info msg="Found storage class for requested volume pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d." name=wordpress-storage-class-netapp requestID=dcdc9522-09d4-4f3a-9778-fd84b5009db9 requestSource=CSI
time="2022-02-27T11:49:54Z" level=warning msg="Volume already exists." name=pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d requestID=dcdc9522-09d4-4f3a-9778-fd84b5009db9 requestSource=CSI state=Succeeded
time="2022-02-27T11:49:54Z" level=warning msg="Volume already exists." backend=netapp-netapppool requestID=dcdc9522-09d4-4f3a-9778-fd84b5009db9 requestSource=CSI volume=pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d
PS C:\Users\danny> kubectl get pv,pvc --kubeconfig config
NAME CAPACITY ACCESS MODES RECLAIM POLICY STATUS CLAIM STORAGECLASS REASON AGE
persistentvolume/pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d 100Gi RWX Delete Bound default/wordpress wordpress-storage-class-netapp 14m
persistentvolume/pvc-7d7688c3-abc4-4628-abc7-1ae206b0b23a 10Gi RWO Delete Bound monitoring/grafana-pvc default 19m
persistentvolume/pvc-ce36221a-eb54-465a-b271-2a7df09067b5 100Gi RWO Delete Bound monitoring/prometheus-prometheus-kube-prometheus-prometheus-db-prometheus-prometheus-kube-prometheus-prometheus-0 wordpress-storage-class-netapp 17m
kubectl describe TridentBackendConfig -n netapp --kubeconfig config
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Success 47m trident-crd-controller Backend 'netapp-netapppool' created
S C:\Users\danny> kubectl get all -n netapp --kubeconfig config
NAME READY STATUS RESTARTS AGE
pod/trident-csi-558f9448cd-hxmjt 6/6 Running 0 51m
pod/trident-csi-ddhgs 2/2 Running 0 35m
pod/trident-csi-hlzs8 2/2 Running 0 51m
pod/trident-operator-5b796496d5-qnpps 1/1 Running 0 51m
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
service/trident-csi ClusterIP 10.0.86.71 <none> 34571/TCP,9220/TCP 51m
NAME DESIRED CURRENT READY UP-TO-DATE AVAILABLE NODE SELECTOR AGE
daemonset.apps/trident-csi 2 2 2 2 2 kubernetes.io/arch=amd64,kubernetes.io/os=linux 51m
NAME READY UP-TO-DATE AVAILABLE AGE
deployment.apps/trident-csi 1/1 1 1 51m
deployment.apps/trident-operator 1/1 1 1 51m
NAME DESIRED CURRENT READY AGE
replicaset.apps/trident-csi-558f9448cd 1 1 1 51m
replicaset.apps/trident-operator-5b796496d5 1 1 1 51m
additional terraform provisioning
data "template_file" "netapp_backend_config"{
depends_on = [kubernetes_secret_v1.netapp]
template = file("${path.module}/BackendCRD/backend-anf.yaml")
vars = {
# "clientID" = data.azurerm_client_config.current.client_id
# "clientSecret" = var.netappclientsecret
"metadataname" = "nett-app-backend"
"namespace" = kubernetes_namespace.netapp.metadata[0].name
"storagedrivername" = "azure-netapp-files"
"subscriptionid" = data.azurerm_client_config.current.subscription_id
"tenantid" = data.azurerm_client_config.current.tenant_id
"location" = var.location
"servicelevel" = var.servicelevel
"secretcredentails" = kubernetes_secret_v1.netapp.metadata[0].name
"subnet" = var.subnet
"virtualNetwork" = var.virtualNetwork
"nfsMountOptions" = "nfsvers=4"
"backendName" = azurerm_netapp_pool.netapp.name
}
}
resource "kubernetes_storage_class_v1" "example" {
depends_on = [
helm_release.netapphelm,
kubernetes_secret_v1.netapp,
time_sleep.wait_600_seconds
]
metadata {
name = var.storageclass
}
storage_provisioner = "csi.trident.netapp.io"
reclaim_policy = "Delete"
volume_binding_mode = "WaitForFirstConsumer"
allow_volume_expansion = var.allow_volume_exspansion
parameters = {
backendType = "azure-netapp-files"
fsType: "nfs"
}
# mount_options = ["file_mode=0644", "dir_mode=0755", "uid=1001", "gid=1001"]
}
PS C:\Users\danny> kubectl get events --kubeconfig config
LAST SEEN TYPE REASON OBJECT MESSAGE
2m7s Warning KubeletRPCDeadlineExceeded node/aks-akscluster-26960436-vmss000000 (combined from similar events): E0227 13:23:36.051152 3267 nestedpendingoperations.go:335] Operation for "{volumeName:kubernetes.io/csi/csi.trident.netapp.io^pvc-ce36221a-eb54-465a-b271-2a7df09067b5 podName: nodeName:}" failed. No retries permitted un
til 2022-02-27 13:25:38.051125775 +0000 UTC m=+6922.364702786 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "pvc-ce36221a-eb54-465a-b271-2a7df09067b5" (UniqueName: "kubernetes.io/csi/csi.trident.netapp.io^pvc-ce36221a-eb54-465a-b271-2a7df09067b5") pod "prometheus-prometheus-kube-prometheus-prometheus-0" (UID: "f670f4db-f
13b-4e8a-8156-65e15f78b6e6") : rpc error: code = DeadlineExceeded desc = context deadline exceeded
2m58s Warning KubeletRPCDeadlineExceeded node/aks-akscluster-26960436-vmss000001 (combined from similar events): E0227 13:22:45.564570 3163 nestedpendingoperations.go:335] Operation for "{volumeName:kubernetes.io/csi/csi.trident.netapp.io^pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d podName: nodeName:}" failed. No retries permitted un
til 2022-02-27 13:24:47.564534125 +0000 UTC m=+5801.165314210 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d" (UniqueName: "kubernetes.io/csi/csi.trident.netapp.io^pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d") pod "wordpress-7b68f9d9bc-9nz27" (UID: "439424b3-2be1-468c-8582-e323cb7905
00") : rpc error: code = DeadlineExceeded desc = context deadline exceeded
4m2s Normal Scheduled pod/wordpress-7b68f9d9bc-28lvx Successfully assigned default/wordpress-7b68f9d9bc-28lvx to aks-akscluster-26960436-vmss000001
119s Warning FailedMount pod/wordpress-7b68f9d9bc-28lvx Unable to attach or mount volumes: unmounted volumes=[wordpress-data], unattached volumes=[custom-postinit kube-api-access-5g8pq wordpress-data]: timed out waiting for the condition
12m Warning FailedMount pod/wordpress-7b68f9d9bc-9nz27 Unable to attach or mount volumes: unmounted volumes=[wordpress-data], unattached volumes=[wordpress-data custom-postinit kube-api-access-b5scw]: timed out waiting for the condition
43m Warning FailedMount pod/wordpress-7b68f9d9bc-9nz27 MountVolume.SetUp failed for volume "pvc-1d9eeaac-e0fe-498c-8376-9ee39c30fb2d" : rpc error: code = DeadlineExceeded desc = context deadline exceeded
23m Warning FailedMount pod/wordpress-7b68f9d9bc-9nz27 Unable to attach or mount volumes: unmounted volumes=[wordpress-data], unattached volumes=[kube-api-access-b5scw wordpress-data custom-postinit]: timed out waiting for the condition
3m7s Warning FailedMount pod/wordpress-7b68f9d9bc-9nz27 Unable to attach or mount volumes: unmounted volumes=[wordpress-data], unattached volumes=[custom-postinit kube-api-access-b5scw wordpress-data]: timed out waiting for the condition
4m2s Normal SuccessfulCreate replicaset/wordpress-7b68f9d9bc Created pod: wordpress-7b68f9d9bc-28lvx
55s Warning FailedGetResourceMetric horizontalpodautoscaler/wordpress failed to get memory utilization: unable to get metrics for resource memory: no metrics returned from resource metrics API
PS C:\Users\danny> kubectl describe torc trident --kubeconfig config
Name: trident
Namespace:
Labels: app.kubernetes.io/managed-by=Helm
Annotations: meta.helm.sh/release-name: netapp-trident-operator
meta.helm.sh/release-namespace: netapp
API Version: trident.netapp.io/v1
Kind: TridentOrchestrator
Metadata:
Creation Timestamp: 2022-02-27T11:31:53Z
Generation: 1
Managed Fields:
API Version: trident.netapp.io/v1
Fields Type: FieldsV1
fieldsV1:
f:metadata:
f:annotations:
.:
f:meta.helm.sh/release-name:
f:meta.helm.sh/release-namespace:
f:labels:
.:
f:app.kubernetes.io/managed-by:
f:spec:
.:
f:IPv6:
f:autosupportImage:
f:autosupportProxy:
f:debug:
f:enableNodePrep:
f:httpRequestTimeout:
f:k8sTimeout:
f:kubeletDir:
f:logFormat:
f:namespace:
f:probePort:
f:silenceAutosupport:
f:tridentImage:
Manager: terraform-provider-helm_v2.4.1_x5.exe
Operation: Update
Time: 2022-02-27T11:31:53Z
API Version: trident.netapp.io/v1
Fields Type: FieldsV1
fieldsV1:
f:status:
.:
f:currentInstallationParams:
.:
f:IPv6:
f:autosupportHostname:
f:autosupportImage:
f:autosupportProxy:
f:autosupportSerialNumber:
f:debug:
f:enableNodePrep:
f:httpRequestTimeout:
f:imagePullSecrets:
f:imageRegistry:
f:k8sTimeout:
f:kubeletDir:
f:logFormat:
f:probePort:
f:silenceAutosupport:
f:tridentImage:
f:message:
f:namespace:
f:status:
f:version:
Manager: trident-operator
Operation: Update
Subresource: status
Time: 2022-02-27T11:31:57Z
Resource Version: 1797
UID: eb6afa5b-c928-4c28-bd45-a73dd814bc7f
Spec:
IPv6: false
Autosupport Image: netapp/trident-autosupport:22.01
Autosupport Proxy: <nil>
Debug: false
Enable Node Prep: false
Http Request Timeout: 90s
k8sTimeout: 0
Kubelet Dir: <nil>
Log Format: text
Namespace: netapp
Probe Port: 17546
Silence Autosupport: false
Trident Image: netapp/trident:22.01.0
Status:
Current Installation Params:
IPv6: false
Autosupport Hostname:
Autosupport Image: netapp/trident-autosupport:22.01
Autosupport Proxy:
Autosupport Serial Number:
Debug: false
Enable Node Prep: false
Http Request Timeout: 90s
Image Pull Secrets:
Image Registry:
k8sTimeout: 30
Kubelet Dir: /var/lib/kubelet
Log Format: text
Probe Port: 17546
Silence Autosupport: false
Trident Image: netapp/trident:22.01.0
Message: Trident installed
Namespace: netapp
Status: Installed
Version: v22.01.0
Events: <none>
PS C:\Users\danny> kubectl logs trident-csi-75s28 -n netapp -c driver-registrar --kubeconfig config
I0227 18:28:10.991464 7550 main.go:166] Version: v2.4.0
I0227 18:28:10.991495 7550 main.go:167] Running node-driver-registrar in mode=registration
I0227 18:28:10.991837 7550 main.go:191] Attempting to open a gRPC connection with: "/plugin/csi.sock"
W0227 18:28:20.992127 7550 connection.go:173] Still connecting to unix:///plugin/csi.sock
W0227 18:28:30.992186 7550 connection.go:173] Still connecting to unix:///plugin/csi.sock
I0227 18:28:38.703115 7550 main.go:198] Calling CSI driver to discover driver name
I0227 18:28:38.704532 7550 main.go:208] CSI driver name: "csi.trident.netapp.io"
I0227 18:28:38.704560 7550 node_register.go:53] Starting Registration Server at: /registration/csi.trident.netapp.io-reg.sock
I0227 18:28:38.704764 7550 node_register.go:62] Registration Server started at: /registration/csi.trident.netapp.io-reg.sock
I0227 18:28:38.704924 7550 node_register.go:92] Skipping HTTP server because endpoint is set to: ""
I0227 18:28:38.723563 7550 main.go:102] Received GetInfo call: &InfoRequest{}
I0227 18:28:38.723833 7550 main.go:109] "Kubelet registration probe created" path="/var/lib/kubelet/plugins/csi.trident.netapp.io/registration"
I0227 18:28:38.772815 7550 main.go:120] Received NotifyRegistrationStatus call: &RegistrationStatus{PluginRegistered:true,Error:,}
PS C:\Users\danny> kubectl describe sc wordpress-storage-class-netapp -A --kubeconfig config
Name: wordpress-storage-class-netapp
IsDefaultClass: No
Annotations: <none>
Provisioner: csi.trident.netapp.io
Parameters: backendType=azure-netapp-files,fsType=nfs
AllowVolumeExpansion: True
MountOptions: <none>
ReclaimPolicy: Delete
VolumeBindingMode: WaitForFirstConsumer
Events: <none>
kubectl get events --kubeconfig config
36m Normal Installing tridentorchestrator/trident Installing Trident
36m Normal Installed tridentorchestrator/trident Trident installed
21m Warning FailedScheduling pod/wordpress-686b57c696-qzxb6 0/1 nodes are available: 1 Insufficient cpu.
22m Normal TriggeredScaleUp pod/wordpress-686b57c696-qzxb6 pod triggered scale-up: [{aks-akscluster-25291065-vmss 1->2 (max: 3)}]
20m Warning FailedScheduling pod/wordpress-686b57c696-qzxb6 0/2 nodes are available: 1 Insufficient cpu, 1 node(s) had taint {node.kubernetes.io/network-unavailable: }, that the pod didn't tolerate.
19m Normal Scheduled pod/wordpress-686b57c696-qzxb6 Successfully assigned default/wordpress-686b57c696-qzxb6 to aks-akscluster-25291065-vmss000001
19m Normal SuccessfulAttachVolume pod/wordpress-686b57c696-qzxb6 AttachVolume.Attach succeeded for volume "pvc-e7e87fa5-5396-43ed-b53c-e67dfd2a9f57"
3m44s Warning FailedMount pod/wordpress-686b57c696-qzxb6 Unable to attach or mount volumes: unmounted volumes=[wordpress-data], unattached volumes=[wordpress-data custom-postinit kube-api-access-wgh54]: timed out waiting for the condition
2m9s Warning FailedMount pod/wordpress-686b57c696-qzxb6 MountVolume.SetUp failed for volume "pvc-e7e87fa5-5396-43ed-b53c-e67dfd2a9f57" : rpc error: code = DeadlineExceeded desc = context deadline exceeded
89s Warning FailedMount pod/wordpress-686b57c696-qzxb6 Unable to attach or mount volumes: unmounted volumes=[wordpress-data], unattached volumes=[custom-postinit kube-api-access-wgh54 wordpress-data]: timed out waiting for the condition
19m Normal WaitForPodScheduled persistentvolumeclaim/wordpress waiting for pod wordpress-686b57c696-qzxb6 to be scheduled
4m12s Warning FailedGetResourceMetric horizontalpodautoscaler/wordpress failed to get memory utilization: unable to get metrics for resource memory: no metrics returned from resource metrics API
22m Warning FailedGetResourceMetric horizontalpodautoscaler/wordpress failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
22m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/wordpress invalid metrics (2 invalid out of 2), first error is: failed to get memory utilization: unable to get metrics for resource memory: no metrics returned from resource metrics API
19m Normal Provisioning persistentvolumeclaim/wordpress External provisioner is provisioning volume for claim "default/wordpress"
19m Normal ExternalProvisioning persistentvolumeclaim/wordpress waiting for a volume to be created, either by external provisioner "csi.trident.netapp.io" or manually created by system administrator
19m Normal ProvisioningFailed persistentvolumeclaim/wordpress volume state is Creating, not Succeeded
19m Warning ProvisioningFailed persistentvolumeclaim/wordpress failed to provision volume with StorageClass "wordpress-storage-class-netapp": rpc error: code = Unknown desc = volume state is Creating, not Succeeded
19m Normal ProvisioningSuccess persistentvolumeclaim/wordpress provisioned a volume
19m Normal ProvisioningSucceeded persistentvolumeclaim/wordpress Successfully provisioned volume pvc-e7e87fa5-5396-43ed-b53c-e67dfd2a9f57
25m Warning listen tcp4 :31579: bind: address already in use node/aks-akscluster-25291065-vmss000000 can't open port "nodePort for ingress/nginx-ingress-controller:http" (:31579/tcp4), skipping it
25m Warning listen tcp4 :32165: bind: address already in use node/aks-akscluster-25291065-vmss000000 can't open port "nodePort for ingress/nginx-ingress-controller:https" (:32165/tcp4), skipping it
14m Warning KubeletRPCDeadlineExceeded node/aks-akscluster-25291065-vmss000000 E0227 18:44:34.536956 3224 nestedpendingoperations.go:335] Operation for "{volumeName:kubernetes.io/csi/csi.trident.netapp.io^pvc-176a73f0-2eab-4c39-9950-1b0258bcd174 podName: nodeName:}" failed. No retrie
s permitted until 2022-02-27 18:44:35.036929055 +0000 UTC m=+1113.070873727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "pvc-176a73f0-2eab-4c39-9950-1b0258bcd174" (UniqueName: "kubernetes.io/csi/csi.trident.netapp.io^pvc-176a73f0-2eab-4c39-9950-1b0258bcd174") pod "prometheus-prometheus-kube-prometheus-prometheus-0" (U
ID: "e9f3b6c1-aa79-4263-982f-977eab160de4") : rpc error: code = DeadlineExceeded desc = context deadline exceeded
14m Warning KubeletRPCDeadlineExceeded node/aks-akscluster-25291065-vmss000000 E0227 18:46:35.058544 3224 nestedpendingoperations.go:335] Operation for "{volumeName:kubernetes.io/csi/csi.trident.netapp.io^pvc-176a73f0-2eab-4c39-9950-1b0258bcd174 podName: nodeName:}" failed. No retrie
s permitted until 2022-02-27 18:46:36.058516754 +0000 UTC m=+1234.092461426 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "pvc-176a73f0-2eab-4c39-9950-1b0258bcd174" (UniqueName: "kubernetes.io/csi/csi.trident.netapp.io^pvc-176a73f0-2eab-4c39-9950-1b0258bcd174") pod "prometheus-prometheus-kube-prometheus-prometheus-0" (UID:
"e9f3b6c1-aa79-4263-982f-977eab160de4") : rpc error: code = DeadlineExceeded desc = context deadline exceeded
14m Warning KubeletRPCDeadlineExceeded node/aks-akscluster-25291065-vmss000000 E0227 18:48:36.088129 3224 nestedpendingoperations.go:335] Operation for "{volumeName:kubernetes.io/csi/csi.trident.netapp.io^pvc-176a73f0-2eab-4c39-9950-1b0258bcd174 podName: nodeName:}" failed. No retrie
s permitted until 2022-02-27 18:48:38.088070727 +0000 UTC m=+1356.122015499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "pvc-176a73f0-2eab-4c39-9950-1b0258bcd174" (UniqueName: "kubernetes.io/csi/csi.trident.netapp.io^pvc-176a73f0-2eab-4c39-9950-1b0258bcd174") pod "prometheus-prometheus-kube-prometheus-prometheus-0" (UID:
"e9f3b6c1-aa79-4263-982f-977eab160de4") : rpc error: code = DeadlineExceeded desc = context deadline exceeded
14m Warning KubeletRPCDeadlineExceeded node/aks-akscluster-25291065-vmss000000 E0227 18:50:38.121172 3224 nestedpendingoperations.go:335] Operation for "{volumeName:kubernetes.io/csi/csi.trident.netapp.io^pvc-176a73f0-2eab-4c39-9950-1b0258bcd174 podName: nodeName:}" failed. No retrie
s permitted until 2022-02-27 18:50:42.121143914 +0000 UTC m=+1480.155088586 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "pvc-176a73f0-2eab-4c39-9950-1b0258bcd174" (UniqueName: "kubernetes.io/csi/csi.trident.netapp.io^pvc-176a73f0-2eab-4c39-9950-1b0258bcd174") pod "prometheus-prometheus-kube-prometheus-prometheus-0" (UID:
"e9f3b6c1-aa79-4263-982f-977eab160de4") : rpc error: code = DeadlineExceeded desc = context deadline exceeded
13m Normal NoPreemptScheduled node/aks-akscluster-25291065-vmss000000 Node condition PreemptScheduled is now: Unknown, reason: NoPreemptScheduled
13m Normal NoPreemptScheduled node/aks-akscluster-25291065-vmss000000 Node condition PreemptScheduled is now: False, reason: NoPreemptScheduled
12m Warning KubeletRPCDeadlineExceeded node/aks-akscluster-25291065-vmss000000 E0227 18:52:42.220959 3224 nestedpendingoperations.go:335] Operation for "{volumeName:kubernetes.io/csi/csi.trident.netapp.io^pvc-176a73f0-2eab-4c39-9950-1b0258bcd174 podName: nodeName:}" failed. No retrie
s permitted until 2022-02-27 18:52:50.220936435 +0000 UTC m=+1608.254881107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "pvc-176a73f0-2eab-4c39-9950-1b0258bcd174" (UniqueName: "kubernetes.io/csi/csi.trident.netapp.io^pvc-176a73f0-2eab-4c39-9950-1b0258bcd174") pod "prometheus-prometheus-kube-prometheus-prometheus-0" (UID:
"e9f3b6c1-aa79-4263-982f-977eab160de4") : rpc error: code = DeadlineExceeded desc = context deadline exceeded
10m Warning KubeletRPCDeadlineExceeded node/aks-akscluster-25291065-vmss000000 E0227 18:54:50.317495 3224 nestedpendingoperations.go:335] Operation for "{volumeName:kubernetes.io/csi/csi.trident.netapp.io^pvc-176a73f0-2eab-4c39-9950-1b0258bcd174 podName: nodeName:}" failed. No retrie
s permitted until 2022-02-27 18:55:06.317469036 +0000 UTC m=+1744.351413708 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "pvc-176a73f0-2eab-4c39-9950-1b0258bcd174" (UniqueName: "kubernetes.io/csi/csi.trident.netapp.io^pvc-176a73f0-2eab-4c39-9950-1b0258bcd174") pod "prometheus-prometheus-kube-prometheus-prometheus-0" (UID
: "e9f3b6c1-aa79-4263-982f-977eab160de4") : rpc error: code = DeadlineExceeded desc = context deadline exceeded
7m46s Warning KubeletRPCDeadlineExceeded node/aks-akscluster-25291065-vmss000000 E0227 18:57:06.376010 3224 nestedpendingoperations.go:335] Operation for "{volumeName:kubernetes.io/csi/csi.trident.netapp.io^pvc-176a73f0-2eab-4c39-9950-1b0258bcd174 podName: nodeName:}" failed. No retrie
s permitted until 2022-02-27 18:57:38.375981391 +0000 UTC m=+1896.409926163 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "pvc-176a73f0-2eab-4c39-9950-1b0258bcd174" (UniqueName: "kubernetes.io/csi/csi.trident.netapp.io^pvc-176a73f0-2eab-4c39-9950-1b0258bcd174") pod "prometheus-prometheus-kube-prometheus-prometheus-0" (UID
: "e9f3b6c1-aa79-4263-982f-977eab160de4") : rpc error: code = DeadlineExceeded desc = context deadline exceeded
5m14s Warning KubeletRPCDeadlineExceeded node/aks-akscluster-25291065-vmss000000 E0227 18:59:38.387380 3224 nestedpendingoperations.go:335] Operation for "{volumeName:kubernetes.io/csi/csi.trident.netapp.io^pvc-176a73f0-2eab-4c39-9950-1b0258bcd174 podName: nodeName:}" failed. No retrie
s permitted until 2022-02-27 19:00:42.387345942 +0000 UTC m=+2080.421290614 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "pvc-176a73f0-2eab-4c39-9950-1b0258bcd174" (UniqueName: "kubernetes.io/csi/csi.trident.netapp.io^pvc-176a73f0-2eab-4c39-9950-1b0258bcd174") pod "prometheus-prometheus-kube-prometheus-prometheus-0" (UI
D: "e9f3b6c1-aa79-4263-982f-977eab160de4") : rpc error: code = DeadlineExceeded desc = context deadline exceeded
2m10s Warning KubeletRPCDeadlineExceeded node/aks-akscluster-25291065-vmss000000 E0227 19:02:42.401601 3224 nestedpendingoperations.go:335] Operation for "{volumeName:kubernetes.io/csi/csi.trident.netapp.io^pvc-176a73f0-2eab-4c39-9950-1b0258bcd174 podName: nodeName:}" failed. No retrie
s permitted until 2022-02-27 19:04:44.40157143 +0000 UTC m=+2322.435516102 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "pvc-176a73f0-2eab-4c39-9950-1b0258bcd174" (UniqueName: "kubernetes.io/csi/csi.trident.netapp.io^pvc-176a73f0-2eab-4c39-9950-1b0258bcd174") pod "prometheus-prometheus-kube-prometheus-prometheus-0" (UID
: "e9f3b6c1-aa79-4263-982f-977eab160de4") : rpc error: code = DeadlineExceeded desc = context deadline exceeded
20m Normal Starting node/aks-akscluster-25291065-vmss000001 Starting kubelet.
20m Warning InvalidDiskCapacity node/aks-akscluster-25291065-vmss000001 invalid capacity 0 on image filesystem
20m Normal NodeHasSufficientMemory node/aks-akscluster-25291065-vmss000001 Node aks-akscluster-25291065-vmss000001 status is now: NodeHasSufficientMemory
20m Normal NodeHasNoDiskPressure node/aks-akscluster-25291065-vmss000001 Node aks-akscluster-25291065-vmss000001 status is now: NodeHasNoDiskPressure
20m Normal NodeHasSufficientPID node/aks-akscluster-25291065-vmss000001 Node aks-akscluster-25291065-vmss000001 status is now: NodeHasSufficientPID
20m Normal NodeAllocatableEnforced node/aks-akscluster-25291065-vmss000001 Updated Node Allocatable limit across pods
20m Normal RegisteredNode node/aks-akscluster-25291065-vmss000001 Node aks-akscluster-25291065-vmss000001 event: Registered Node aks-akscluster-25291065-vmss000001 in Controller
20m Normal NodeReady node/aks-akscluster-25291065-vmss000001 Node aks-akscluster-25291065-vmss000001 status is now: NodeReady
20m Normal Starting node/aks-akscluster-25291065-vmss000001
20m Warning listen tcp4 :31579: bind: address already in use node/aks-akscluster-25291065-vmss000001 can't open port "nodePort for ingress/nginx-ingress-controller:http" (:31579/tcp4), skipping it
20m Warning listen tcp4 :32165: bind: address already in use node/aks-akscluster-25291065-vmss000001 can't open port "nodePort for ingress/nginx-ingress-controller:https" (:32165/tcp4), skipping it
14m Warning KubeletRPCDeadlineExceeded node/aks-akscluster-25291065-vmss000001 E0227 18:47:39.806067 3278 nestedpendingoperations.go:335] Operation for "{volumeName:kubernetes.io/csi/csi.trident.netapp.io^pvc-e7e87fa5-5396-43ed-b53c-e67dfd2a9f57 podName: nodeName:}" failed. No retrie
s permitted until 2022-02-27 18:47:40.306043537 +0000 UTC m=+213.349132244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "pvc-e7e87fa5-5396-43ed-b53c-e67dfd2a9f57" (UniqueName: "kubernetes.io/csi/csi.trident.netapp.io^pvc-e7e87fa5-5396-43ed-b53c-e67dfd2a9f57") pod "wordpress-686b57c696-qzxb6" (UID: "d98109c3-55d0-4130-b
55c-65cf87621345") : rpc error: code = DeadlineExceeded desc = context deadline exceeded
14m Warning KubeletRPCDeadlineExceeded node/aks-akscluster-25291065-vmss000001 E0227 18:49:40.348043 3278 nestedpendingoperations.go:335] Operation for "{volumeName:kubernetes.io/csi/csi.trident.ne
PS C:\Users\danny> kubectl logs trident-operator-5b796496d5-mk62p -n netapp --kubeconfig config
time="2022-02-27T21:24:55Z" level=info msg="Running Trident operator." binary=/trident-operator build_time="Mon Jan 31 15:52:05 UTC 2022" version=22.01.0
time="2022-02-27T21:24:55Z" level=warning msg="Could not get all server resources." error="unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
time="2022-02-27T21:24:55Z" level=info msg="Created Kubernetes clients." namespace=netapp version=v1.23.3
time="2022-02-27T21:24:55Z" level=info msg="Initializing controller." Controller="Trident Orchestrator"
time="2022-02-27T21:24:55Z" level=info msg="Activating controller." Controller="Trident Orchestrator"
time="2022-02-27T21:24:55Z" level=warning msg="Could not get all server resources." error="unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
time="2022-02-27T21:24:55Z" level=info msg="CRD present." CRD=tridentorchestrators.trident.netapp.io
time="2022-02-27T21:24:55Z" level=info msg="Starting workers"
time="2022-02-27T21:24:55Z" level=info msg="Started workers"
time="2022-02-27T21:24:55Z" level=info msg="CR added." CR=trident CRD=TridentOrchestrator
time="2022-02-27T21:24:55Z" level=info msg="Trident deployment not found."
time="2022-02-27T21:24:55Z" level=info msg="CRD not found." CRD=tridentprovisioners.trident.netapp.io
time="2022-02-27T21:24:55Z" level=info msg="Reconciler found no operator-based Trident installation."
time="2022-02-27T21:24:55Z" level=info msg="CR updated." CR=trident CRD=TridentOrchestrator
time="2022-02-27T21:24:55Z" level=warning msg="Could not get all server resources." error="unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
time="2022-02-27T21:24:55Z" level=info msg="Current installed Trident version is not same as the new Trident image version; need to update the Trident installation." currentVersion= newVersion=v22.01.0
time="2022-02-27T21:24:55Z" level=info msg="Starting Trident installation." namespace=netapp
time="2022-02-27T21:24:55Z" level=info msg="Trident service account not found."
time="2022-02-27T21:24:55Z" level=info msg="Created service account."
time="2022-02-27T21:24:55Z" level=info msg="Trident cluster role not found."
time="2022-02-27T21:24:55Z" level=info msg="Created cluster role."
time="2022-02-27T21:24:55Z" level=info msg="Trident cluster role binding not found."
time="2022-02-27T21:24:55Z" level=info msg="Created cluster role binding."
time="2022-02-27T21:24:55Z" level=info msg="Installer will create a fresh CRD." CRD=tridentversions.trident.netapp.io
time="2022-02-27T21:24:55Z" level=info msg="Created CRD." CRD=tridentversions.trident.netapp.io
time="2022-02-27T21:24:56Z" level=info msg="Installer will create a fresh CRD." CRD=tridentbackends.trident.netapp.io
time="2022-02-27T21:24:56Z" level=info msg="Created CRD." CRD=tridentbackends.trident.netapp.io
time="2022-02-27T21:24:56Z" level=info msg="Installer will create a fresh CRD." CRD=tridentmirrorrelationships.trident.netapp.io
time="2022-02-27T21:24:56Z" level=info msg="Created CRD." CRD=tridentmirrorrelationships.trident.netapp.io
time="2022-02-27T21:24:57Z" level=info msg="Installer will create a fresh CRD." CRD=tridentsnapshotinfos.trident.netapp.io
time="2022-02-27T21:24:57Z" level=info msg="Created CRD." CRD=tridentsnapshotinfos.trident.netapp.io
time="2022-02-27T21:24:57Z" level=info msg="Installer will create a fresh CRD." CRD=tridentbackendconfigs.trident.netapp.io
time="2022-02-27T21:24:57Z" level=info msg="Created CRD." CRD=tridentbackendconfigs.trident.netapp.io
time="2022-02-27T21:24:58Z" level=info msg="Installer will create a fresh CRD." CRD=tridentstorageclasses.trident.netapp.io
time="2022-02-27T21:24:58Z" level=info msg="Created CRD." CRD=tridentstorageclasses.trident.netapp.io
time="2022-02-27T21:24:59Z" level=info msg="Installer will create a fresh CRD." CRD=tridentvolumes.trident.netapp.io
time="2022-02-27T21:24:59Z" level=info msg="Created CRD." CRD=tridentvolumes.trident.netapp.io
time="2022-02-27T21:24:59Z" level=info msg="Installer will create a fresh CRD." CRD=tridentvolumepublications.trident.netapp.io
time="2022-02-27T21:24:59Z" level=info msg="Created CRD." CRD=tridentvolumepublications.trident.netapp.io
time="2022-02-27T21:25:00Z" level=info msg="Installer will create a fresh CRD." CRD=tridentnodes.trident.netapp.io
time="2022-02-27T21:25:00Z" level=info msg="Created CRD." CRD=tridentnodes.trident.netapp.io
time="2022-02-27T21:25:00Z" level=info msg="Installer will create a fresh CRD." CRD=tridenttransactions.trident.netapp.io
time="2022-02-27T21:25:00Z" level=info msg="Created CRD." CRD=tridenttransactions.trident.netapp.io
time="2022-02-27T21:25:01Z" level=info msg="Installer will create a fresh CRD." CRD=tridentsnapshots.trident.netapp.io
time="2022-02-27T21:25:01Z" level=info msg="Created CRD." CRD=tridentsnapshots.trident.netapp.io
W0227 21:25:04.379136 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:25:04Z" level=info msg="Trident pod security policy not found."
W0227 21:25:04.391139 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
W0227 21:25:04.403872 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:25:04Z" level=info msg="Created Trident Pod security policy."
time="2022-02-27T21:25:04Z" level=info msg="CSI driver custom resource not found."
time="2022-02-27T21:25:04Z" level=info msg="Created CSI driver custom resource."
time="2022-02-27T21:25:04Z" level=info msg="Trident service not found."
time="2022-02-27T21:25:04Z" level=info msg="Created Trident service."
time="2022-02-27T21:25:04Z" level=info msg="Trident secret not found."
time="2022-02-27T21:25:04Z" level=info msg="No Trident deployments found by label." label="app=controller.csi.trident.netapp.io" namespace=netapp
time="2022-02-27T21:25:04Z" level=info msg="Trident deployment added or deleted." name=trident-csi namespace=netapp
time="2022-02-27T21:25:04Z" level=info msg="Created Trident deployment."
time="2022-02-27T21:25:04Z" level=info msg="No Trident daemonsets found by label." label="app=node.csi.trident.netapp.io" namespace=netapp
time="2022-02-27T21:25:04Z" level=info msg="Created Trident daemonset."
time="2022-02-27T21:25:04Z" level=info msg="Trident daemonset added or deleted." name=trident-csi namespace=netapp
time="2022-02-27T21:25:04Z" level=info msg="Trident deployment changed." name=trident-csi namespace=netapp
time="2022-02-27T21:25:04Z" level=info msg="Trident daemonset changed." name=trident-csi namespace=netapp
time="2022-02-27T21:25:04Z" level=info msg="Trident deployment changed." name=trident-csi namespace=netapp
time="2022-02-27T21:25:04Z" level=info msg="Trident deployment changed." name=trident-csi namespace=netapp
time="2022-02-27T21:25:11Z" level=info msg="Waiting for Trident pod to start."
time="2022-02-27T21:25:26Z" level=info msg="Trident deployment changed." name=trident-csi namespace=netapp
time="2022-02-27T21:25:31Z" level=info msg="Trident pod started." namespace=netapp pod=trident-csi-558f9448cd-9hb4s
time="2022-02-27T21:25:31Z" level=info msg="Waiting for Trident REST interface."
time="2022-02-27T21:25:31Z" level=info msg="Trident REST interface is up." version=22.01.0
time="2022-02-27T21:25:31Z" level=info msg="Trident is installed." namespace=netapp version=v22.01.0
time="2022-02-27T21:25:31Z" level=info msg="CR updated." CR=trident CRD=TridentOrchestrator
time="2022-02-27T21:25:31Z" level=info msg="Synced Trident Orchestrator CR 'trident'"
time="2022-02-27T21:25:31Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:25:31Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:25:31Z" level=info msg="An operator based Trident CSI deployment was found." deploymentName=trident-csi deploymentNamespace=netapp
time="2022-02-27T21:25:31Z" level=info msg="CRD not found." CRD=tridentprovisioners.trident.netapp.io
time="2022-02-27T21:25:31Z" level=info msg="Reconciler found Trident installation." callingCRName=trident-csi callingResourceType=resourceDeployment controllingCRBasedOnStatus=trident isCSI=true namespace=netapp operatorBasedCSIDeployments="[trident-csi]"
time="2022-02-27T21:25:31Z" level=info msg="Found CR that controls current Trident deployment." name=trident
time="2022-02-27T21:25:31Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:25:31Z" level=info msg="Starting Trident installation." namespace=netapp
time="2022-02-27T21:25:31Z" level=info msg="A Trident Service account found by label." namespace=netapp serviceAccount=trident-csi
time="2022-02-27T21:25:31Z" level=info msg="A Trident cluster role found by label." clusterRole=trident-csi
time="2022-02-27T21:25:31Z" level=info msg="A Trident Cluster role binding was found by label." clusterRoleBinding=trident-csi
time="2022-02-27T21:25:31Z" level=info msg="CRD present." CRD=tridentversions.trident.netapp.io
time="2022-02-27T21:25:31Z" level=info msg="CRD present." CRD=tridentbackends.trident.netapp.io
time="2022-02-27T21:25:31Z" level=info msg="CRD present." CRD=tridentmirrorrelationships.trident.netapp.io
time="2022-02-27T21:25:31Z" level=info msg="CRD present." CRD=tridentsnapshotinfos.trident.netapp.io
time="2022-02-27T21:25:31Z" level=info msg="CRD present." CRD=tridentbackendconfigs.trident.netapp.io
time="2022-02-27T21:25:31Z" level=info msg="CRD present." CRD=tridentstorageclasses.trident.netapp.io
time="2022-02-27T21:25:31Z" level=info msg="CRD present." CRD=tridentvolumes.trident.netapp.io
time="2022-02-27T21:25:31Z" level=info msg="CRD present." CRD=tridentvolumepublications.trident.netapp.io
time="2022-02-27T21:25:31Z" level=info msg="CRD present." CRD=tridentnodes.trident.netapp.io
time="2022-02-27T21:25:31Z" level=info msg="CRD present." CRD=tridenttransactions.trident.netapp.io
time="2022-02-27T21:25:31Z" level=info msg="CRD present." CRD=tridentsnapshots.trident.netapp.io
W0227 21:25:31.999224 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:25:31Z" level=info msg="A Trident Pod security policy was found by label." podSecurityPolicy=tridentpods
W0227 21:25:32.006875 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
W0227 21:25:32.014119 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:25:32Z" level=info msg="A Trident CSI driver found by label." TridentCSIDriver=csi.trident.netapp.io
time="2022-02-27T21:25:32Z" level=info msg="A Trident service was found by label." namespace=netapp service=trident-csi
time="2022-02-27T21:25:32Z" level=info msg="A Trident secret was found by label." namespace=netapp secret=trident-csi
time="2022-02-27T21:25:32Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:25:32Z" level=info msg="A Trident daemonSet was found by label." daemonSet=trident-csi namespace=netapp
time="2022-02-27T21:25:39Z" level=info msg="Waiting for Trident pod to start."
time="2022-02-27T21:25:39Z" level=info msg="Trident pod started." namespace=netapp pod=trident-csi-558f9448cd-9hb4s
time="2022-02-27T21:25:39Z" level=info msg="Waiting for Trident REST interface."
time="2022-02-27T21:25:39Z" level=info msg="Trident REST interface is up." version=22.01.0
time="2022-02-27T21:25:39Z" level=info msg="Trident is installed." namespace=netapp version=v22.01.0
time="2022-02-27T21:25:39Z" level=info msg="New status is same as the old status, no update needed." tridentOrchestratorCR=trident
time="2022-02-27T21:25:39Z" level=info msg="Synced deployment 'netapp/trident-csi'"
time="2022-02-27T21:25:39Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:25:39Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:25:39Z" level=info msg="An operator based Trident CSI deployment was found." deploymentName=trident-csi deploymentNamespace=netapp
time="2022-02-27T21:25:39Z" level=info msg="CRD not found." CRD=tridentprovisioners.trident.netapp.io
time="2022-02-27T21:25:39Z" level=info msg="Reconciler found Trident installation." callingCRName=trident-csi callingResourceType=resourceDaemonset controllingCRBasedOnStatus=trident isCSI=true namespace=netapp operatorBasedCSIDeployments="[trident-csi]"
time="2022-02-27T21:25:39Z" level=info msg="Found CR that controls current Trident deployment." name=trident
time="2022-02-27T21:25:39Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:25:39Z" level=info msg="Starting Trident installation." namespace=netapp
time="2022-02-27T21:25:39Z" level=info msg="A Trident Service account found by label." namespace=netapp serviceAccount=trident-csi
time="2022-02-27T21:25:39Z" level=info msg="A Trident cluster role found by label." clusterRole=trident-csi
time="2022-02-27T21:25:39Z" level=info msg="A Trident Cluster role binding was found by label." clusterRoleBinding=trident-csi
time="2022-02-27T21:25:39Z" level=info msg="CRD present." CRD=tridentversions.trident.netapp.io
time="2022-02-27T21:25:39Z" level=info msg="CRD present." CRD=tridentbackends.trident.netapp.io
time="2022-02-27T21:25:39Z" level=info msg="CRD present." CRD=tridentmirrorrelationships.trident.netapp.io
time="2022-02-27T21:25:39Z" level=info msg="CRD present." CRD=tridentsnapshotinfos.trident.netapp.io
time="2022-02-27T21:25:39Z" level=info msg="CRD present." CRD=tridentbackendconfigs.trident.netapp.io
time="2022-02-27T21:25:39Z" level=info msg="CRD present." CRD=tridentstorageclasses.trident.netapp.io
time="2022-02-27T21:25:39Z" level=info msg="CRD present." CRD=tridentvolumes.trident.netapp.io
time="2022-02-27T21:25:39Z" level=info msg="CRD present." CRD=tridentvolumepublications.trident.netapp.io
time="2022-02-27T21:25:39Z" level=info msg="CRD present." CRD=tridentnodes.trident.netapp.io
time="2022-02-27T21:25:39Z" level=info msg="CRD present." CRD=tridenttransactions.trident.netapp.io
time="2022-02-27T21:25:39Z" level=info msg="CRD present." CRD=tridentsnapshots.trident.netapp.io
W0227 21:25:39.998696 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:25:39Z" level=info msg="A Trident Pod security policy was found by label." podSecurityPolicy=tridentpods
W0227 21:25:40.004833 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
W0227 21:25:40.013701 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:25:40Z" level=info msg="A Trident CSI driver found by label." TridentCSIDriver=csi.trident.netapp.io
time="2022-02-27T21:25:40Z" level=info msg="A Trident service was found by label." namespace=netapp service=trident-csi
time="2022-02-27T21:25:40Z" level=info msg="A Trident secret was found by label." namespace=netapp secret=trident-csi
time="2022-02-27T21:25:40Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:25:40Z" level=info msg="A Trident daemonSet was found by label." daemonSet=trident-csi namespace=netapp
time="2022-02-27T21:25:44Z" level=info msg="Trident daemonset changed." name=trident-csi namespace=netapp
time="2022-02-27T21:25:47Z" level=info msg="Waiting for Trident pod to start."
time="2022-02-27T21:25:47Z" level=info msg="Trident pod started." namespace=netapp pod=trident-csi-558f9448cd-9hb4s
time="2022-02-27T21:25:47Z" level=info msg="Waiting for Trident REST interface."
time="2022-02-27T21:25:47Z" level=info msg="Trident REST interface is up." version=22.01.0
time="2022-02-27T21:25:47Z" level=info msg="Trident is installed." namespace=netapp version=v22.01.0
time="2022-02-27T21:25:47Z" level=info msg="New status is same as the old status, no update needed." tridentOrchestratorCR=trident
time="2022-02-27T21:25:47Z" level=info msg="Synced daemonset 'netapp/trident-csi'"
time="2022-02-27T21:25:47Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:25:47Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:25:47Z" level=info msg="An operator based Trident CSI deployment was found." deploymentName=trident-csi deploymentNamespace=netapp
time="2022-02-27T21:25:47Z" level=info msg="CRD not found." CRD=tridentprovisioners.trident.netapp.io
time="2022-02-27T21:25:47Z" level=info msg="Reconciler found Trident installation." callingCRName=trident callingResourceType=resourceTridentOrchestratorCR controllingCRBasedOnStatus=trident isCSI=true namespace=netapp operatorBasedCSIDeployments="[trident-csi]"
time="2022-02-27T21:25:47Z" level=info msg="Found CR that controls current Trident deployment." name=trident
time="2022-02-27T21:25:47Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:25:47Z" level=info msg="Starting Trident installation." namespace=netapp
time="2022-02-27T21:25:47Z" level=info msg="A Trident Service account found by label." namespace=netapp serviceAccount=trident-csi
time="2022-02-27T21:25:47Z" level=info msg="A Trident cluster role found by label." clusterRole=trident-csi
time="2022-02-27T21:25:47Z" level=info msg="A Trident Cluster role binding was found by label." clusterRoleBinding=trident-csi
time="2022-02-27T21:25:47Z" level=info msg="CRD present." CRD=tridentversions.trident.netapp.io
time="2022-02-27T21:25:47Z" level=info msg="CRD present." CRD=tridentbackends.trident.netapp.io
time="2022-02-27T21:25:47Z" level=info msg="CRD present." CRD=tridentmirrorrelationships.trident.netapp.io
time="2022-02-27T21:25:47Z" level=info msg="CRD present." CRD=tridentsnapshotinfos.trident.netapp.io
time="2022-02-27T21:25:47Z" level=info msg="CRD present." CRD=tridentbackendconfigs.trident.netapp.io
time="2022-02-27T21:25:47Z" level=info msg="CRD present." CRD=tridentstorageclasses.trident.netapp.io
time="2022-02-27T21:25:47Z" level=info msg="CRD present." CRD=tridentvolumes.trident.netapp.io
time="2022-02-27T21:25:47Z" level=info msg="CRD present." CRD=tridentvolumepublications.trident.netapp.io
time="2022-02-27T21:25:47Z" level=info msg="CRD present." CRD=tridentnodes.trident.netapp.io
time="2022-02-27T21:25:47Z" level=info msg="CRD present." CRD=tridenttransactions.trident.netapp.io
time="2022-02-27T21:25:47Z" level=info msg="CRD present." CRD=tridentsnapshots.trident.netapp.io
W0227 21:25:48.006867 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:25:48Z" level=info msg="A Trident Pod security policy was found by label." podSecurityPolicy=tridentpods
W0227 21:25:48.018701 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
W0227 21:25:48.025810 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:25:48Z" level=info msg="A Trident CSI driver found by label." TridentCSIDriver=csi.trident.netapp.io
time="2022-02-27T21:25:48Z" level=info msg="A Trident service was found by label." namespace=netapp service=trident-csi
time="2022-02-27T21:25:48Z" level=info msg="A Trident secret was found by label." namespace=netapp secret=trident-csi
time="2022-02-27T21:25:48Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:25:48Z" level=info msg="A Trident daemonSet was found by label." daemonSet=trident-csi namespace=netapp
time="2022-02-27T21:25:55Z" level=info msg="Waiting for Trident pod to start."
time="2022-02-27T21:25:55Z" level=info msg="Trident pod started." namespace=netapp pod=trident-csi-558f9448cd-9hb4s
time="2022-02-27T21:25:55Z" level=info msg="Waiting for Trident REST interface."
time="2022-02-27T21:25:55Z" level=info msg="Trident REST interface is up." version=22.01.0
time="2022-02-27T21:25:55Z" level=info msg="Trident is installed." namespace=netapp version=v22.01.0
time="2022-02-27T21:25:55Z" level=info msg="New status is same as the old status, no update needed." tridentOrchestratorCR=trident
time="2022-02-27T21:25:55Z" level=info msg="Synced Trident Orchestrator CR 'trident'"
time="2022-02-27T21:25:55Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:25:55Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:25:55Z" level=info msg="An operator based Trident CSI deployment was found." deploymentName=trident-csi deploymentNamespace=netapp
time="2022-02-27T21:25:55Z" level=info msg="CRD not found." CRD=tridentprovisioners.trident.netapp.io
time="2022-02-27T21:25:55Z" level=info msg="Reconciler found Trident installation." callingCRName=trident-csi callingResourceType=resourceDaemonset controllingCRBasedOnStatus=trident isCSI=true namespace=netapp operatorBasedCSIDeployments="[trident-csi]"
time="2022-02-27T21:25:55Z" level=info msg="Found CR that controls current Trident deployment." name=trident
time="2022-02-27T21:25:55Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:25:55Z" level=info msg="Starting Trident installation." namespace=netapp
time="2022-02-27T21:25:55Z" level=info msg="A Trident Service account found by label." namespace=netapp serviceAccount=trident-csi
time="2022-02-27T21:25:55Z" level=info msg="A Trident cluster role found by label." clusterRole=trident-csi
time="2022-02-27T21:25:55Z" level=info msg="A Trident Cluster role binding was found by label." clusterRoleBinding=trident-csi
time="2022-02-27T21:25:55Z" level=info msg="CRD present." CRD=tridentversions.trident.netapp.io
time="2022-02-27T21:25:55Z" level=info msg="CRD present." CRD=tridentbackends.trident.netapp.io
time="2022-02-27T21:25:55Z" level=info msg="CRD present." CRD=tridentmirrorrelationships.trident.netapp.io
time="2022-02-27T21:25:55Z" level=info msg="CRD present." CRD=tridentsnapshotinfos.trident.netapp.io
time="2022-02-27T21:25:55Z" level=info msg="CRD present." CRD=tridentbackendconfigs.trident.netapp.io
time="2022-02-27T21:25:55Z" level=info msg="CRD present." CRD=tridentstorageclasses.trident.netapp.io
time="2022-02-27T21:25:55Z" level=info msg="CRD present." CRD=tridentvolumes.trident.netapp.io
time="2022-02-27T21:25:55Z" level=info msg="CRD present." CRD=tridentvolumepublications.trident.netapp.io
time="2022-02-27T21:25:55Z" level=info msg="CRD present." CRD=tridentnodes.trident.netapp.io
time="2022-02-27T21:25:55Z" level=info msg="CRD present." CRD=tridenttransactions.trident.netapp.io
time="2022-02-27T21:25:55Z" level=info msg="CRD present." CRD=tridentsnapshots.trident.netapp.io
W0227 21:25:55.967104 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:25:55Z" level=info msg="A Trident Pod security policy was found by label." podSecurityPolicy=tridentpods
W0227 21:25:55.973411 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
W0227 21:25:55.981887 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:25:55Z" level=info msg="A Trident CSI driver found by label." TridentCSIDriver=csi.trident.netapp.io
time="2022-02-27T21:25:56Z" level=info msg="A Trident service was found by label." namespace=netapp service=trident-csi
time="2022-02-27T21:25:56Z" level=info msg="A Trident secret was found by label." namespace=netapp secret=trident-csi
time="2022-02-27T21:25:56Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:25:56Z" level=info msg="A Trident daemonSet was found by label." daemonSet=trident-csi namespace=netapp
time="2022-02-27T21:26:03Z" level=info msg="Waiting for Trident pod to start."
time="2022-02-27T21:26:03Z" level=info msg="Trident pod started." namespace=netapp pod=trident-csi-558f9448cd-9hb4s
time="2022-02-27T21:26:03Z" level=info msg="Waiting for Trident REST interface."
time="2022-02-27T21:26:03Z" level=info msg="Trident REST interface is up." version=22.01.0
time="2022-02-27T21:26:03Z" level=info msg="Trident is installed." namespace=netapp version=v22.01.0
time="2022-02-27T21:26:03Z" level=info msg="New status is same as the old status, no update needed." tridentOrchestratorCR=trident
time="2022-02-27T21:26:03Z" level=info msg="Synced daemonset 'netapp/trident-csi'"
time="2022-02-27T21:26:03Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:26:03Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:29:55Z" level=info msg="CR updated." CR=trident CRD=TridentOrchestrator
time="2022-02-27T21:29:55Z" level=info msg="An operator based Trident CSI deployment was found." deploymentName=trident-csi deploymentNamespace=netapp
time="2022-02-27T21:29:55Z" level=info msg="CRD not found." CRD=tridentprovisioners.trident.netapp.io
time="2022-02-27T21:29:55Z" level=info msg="Reconciler found Trident installation." callingCRName=trident callingResourceType=resourceTridentOrchestratorCR controllingCRBasedOnStatus=trident isCSI=true namespace=netapp operatorBasedCSIDeployments="[trident-csi]"
time="2022-02-27T21:29:55Z" level=info msg="Found CR that controls current Trident deployment." name=trident
time="2022-02-27T21:29:55Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:29:55Z" level=info msg="Starting Trident installation." namespace=netapp
time="2022-02-27T21:29:55Z" level=info msg="A Trident Service account found by label." namespace=netapp serviceAccount=trident-csi
time="2022-02-27T21:29:55Z" level=info msg="A Trident cluster role found by label." clusterRole=trident-csi
time="2022-02-27T21:29:55Z" level=info msg="A Trident Cluster role binding was found by label." clusterRoleBinding=trident-csi
time="2022-02-27T21:29:55Z" level=info msg="CRD present." CRD=tridentversions.trident.netapp.io
time="2022-02-27T21:29:55Z" level=info msg="CRD present." CRD=tridentbackends.trident.netapp.io
time="2022-02-27T21:29:55Z" level=info msg="CRD present." CRD=tridentmirrorrelationships.trident.netapp.io
time="2022-02-27T21:29:55Z" level=info msg="CRD present." CRD=tridentsnapshotinfos.trident.netapp.io
time="2022-02-27T21:29:55Z" level=info msg="CRD present." CRD=tridentbackendconfigs.trident.netapp.io
time="2022-02-27T21:29:55Z" level=info msg="CRD present." CRD=tridentstorageclasses.trident.netapp.io
time="2022-02-27T21:29:55Z" level=info msg="CRD present." CRD=tridentvolumes.trident.netapp.io
time="2022-02-27T21:29:55Z" level=info msg="CRD present." CRD=tridentvolumepublications.trident.netapp.io
time="2022-02-27T21:29:55Z" level=info msg="CRD present." CRD=tridentnodes.trident.netapp.io
time="2022-02-27T21:29:55Z" level=info msg="CRD present." CRD=tridenttransactions.trident.netapp.io
time="2022-02-27T21:29:55Z" level=info msg="CRD present." CRD=tridentsnapshots.trident.netapp.io
W0227 21:29:56.030552 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:29:56Z" level=info msg="A Trident Pod security policy was found by label." podSecurityPolicy=tridentpods
W0227 21:29:56.037413 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
W0227 21:29:56.044346 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:29:56Z" level=info msg="A Trident CSI driver found by label." TridentCSIDriver=csi.trident.netapp.io
time="2022-02-27T21:29:56Z" level=info msg="A Trident service was found by label." namespace=netapp service=trident-csi
time="2022-02-27T21:29:56Z" level=info msg="A Trident secret was found by label." namespace=netapp secret=trident-csi
time="2022-02-27T21:29:56Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:29:56Z" level=info msg="A Trident daemonSet was found by label." daemonSet=trident-csi namespace=netapp
time="2022-02-27T21:30:03Z" level=info msg="Waiting for Trident pod to start."
time="2022-02-27T21:30:03Z" level=info msg="Trident pod started." namespace=netapp pod=trident-csi-558f9448cd-9hb4s
time="2022-02-27T21:30:03Z" level=info msg="Waiting for Trident REST interface."
time="2022-02-27T21:30:03Z" level=info msg="Trident REST interface is up." version=22.01.0
time="2022-02-27T21:30:03Z" level=info msg="Trident is installed." namespace=netapp version=v22.01.0
time="2022-02-27T21:30:03Z" level=info msg="New status is same as the old status, no update needed." tridentOrchestratorCR=trident
time="2022-02-27T21:30:03Z" level=info msg="Synced Trident Orchestrator CR 'trident'"
time="2022-02-27T21:30:03Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:30:03Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:31:11Z" level=info msg="CR updated." CR=trident CRD=TridentOrchestrator
time="2022-02-27T21:31:11Z" level=info msg="An operator based Trident CSI deployment was found." deploymentName=trident-csi deploymentNamespace=netapp
time="2022-02-27T21:31:11Z" level=info msg="CRD not found." CRD=tridentprovisioners.trident.netapp.io
time="2022-02-27T21:31:11Z" level=info msg="Reconciler found Trident installation." callingCRName=trident callingResourceType=resourceTridentOrchestratorCR controllingCRBasedOnStatus=trident isCSI=true namespace=netapp operatorBasedCSIDeployments="[trident-csi]"
time="2022-02-27T21:31:11Z" level=info msg="Found CR that controls current Trident deployment." name=trident
time="2022-02-27T21:31:11Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:31:12Z" level=info msg="Starting Trident installation." namespace=netapp
time="2022-02-27T21:31:12Z" level=info msg="A Trident Service account found by label." namespace=netapp serviceAccount=trident-csi
time="2022-02-27T21:31:12Z" level=info msg="A Trident cluster role found by label." clusterRole=trident-csi
time="2022-02-27T21:31:12Z" level=info msg="A Trident Cluster role binding was found by label." clusterRoleBinding=trident-csi
time="2022-02-27T21:31:12Z" level=info msg="CRD present." CRD=tridentversions.trident.netapp.io
time="2022-02-27T21:31:12Z" level=info msg="CRD present." CRD=tridentbackends.trident.netapp.io
time="2022-02-27T21:31:12Z" level=info msg="CRD present." CRD=tridentmirrorrelationships.trident.netapp.io
time="2022-02-27T21:31:12Z" level=info msg="CRD present." CRD=tridentsnapshotinfos.trident.netapp.io
time="2022-02-27T21:31:12Z" level=info msg="CRD present." CRD=tridentbackendconfigs.trident.netapp.io
time="2022-02-27T21:31:12Z" level=info msg="CRD present." CRD=tridentstorageclasses.trident.netapp.io
time="2022-02-27T21:31:12Z" level=info msg="CRD present." CRD=tridentvolumes.trident.netapp.io
time="2022-02-27T21:31:12Z" level=info msg="CRD present." CRD=tridentvolumepublications.trident.netapp.io
time="2022-02-27T21:31:12Z" level=info msg="CRD present." CRD=tridentnodes.trident.netapp.io
time="2022-02-27T21:31:12Z" level=info msg="CRD present." CRD=tridenttransactions.trident.netapp.io
time="2022-02-27T21:31:12Z" level=info msg="CRD present." CRD=tridentsnapshots.trident.netapp.io
W0227 21:31:12.561125 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:31:12Z" level=info msg="A Trident Pod security policy was found by label." podSecurityPolicy=tridentpods
W0227 21:31:12.568759 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
W0227 21:31:12.576692 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:31:12Z" level=info msg="A Trident CSI driver found by label." TridentCSIDriver=csi.trident.netapp.io
time="2022-02-27T21:31:12Z" level=info msg="A Trident service was found by label." namespace=netapp service=trident-csi
time="2022-02-27T21:31:12Z" level=info msg="A Trident secret was found by label." namespace=netapp secret=trident-csi
time="2022-02-27T21:31:12Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:31:12Z" level=info msg="A Trident daemonSet was found by label." daemonSet=trident-csi namespace=netapp
time="2022-02-27T21:31:19Z" level=info msg="Waiting for Trident pod to start."
time="2022-02-27T21:31:19Z" level=info msg="Trident pod started." namespace=netapp pod=trident-csi-558f9448cd-9hb4s
time="2022-02-27T21:31:19Z" level=info msg="Waiting for Trident REST interface."
time="2022-02-27T21:31:19Z" level=info msg="Trident REST interface is up." version=22.01.0
time="2022-02-27T21:31:19Z" level=info msg="Trident is installed." namespace=netapp version=v22.01.0
time="2022-02-27T21:31:19Z" level=info msg="New status is same as the old status, no update needed." tridentOrchestratorCR=trident
time="2022-02-27T21:31:19Z" level=info msg="Synced Trident Orchestrator CR 'trident'"
time="2022-02-27T21:31:19Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:31:19Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:31:28Z" level=info msg="Trident daemonset changed." name=trident-csi namespace=netapp
time="2022-02-27T21:31:28Z" level=info msg="An operator based Trident CSI deployment was found." deploymentName=trident-csi deploymentNamespace=netapp
time="2022-02-27T21:31:28Z" level=info msg="CRD not found." CRD=tridentprovisioners.trident.netapp.io
time="2022-02-27T21:31:28Z" level=info msg="Reconciler found Trident installation." callingCRName=trident-csi callingResourceType=resourceDaemonset controllingCRBasedOnStatus=trident isCSI=true namespace=netapp operatorBasedCSIDeployments="[trident-csi]"
time="2022-02-27T21:31:28Z" level=info msg="Found CR that controls current Trident deployment." name=trident
time="2022-02-27T21:31:28Z" level=warning msg="Could not get all server resources." error="unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
time="2022-02-27T21:31:28Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:31:29Z" level=warning msg="Could not get all server resources." error="unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
time="2022-02-27T21:31:29Z" level=info msg="Starting Trident installation." namespace=netapp
time="2022-02-27T21:31:29Z" level=info msg="A Trident Service account found by label." namespace=netapp serviceAccount=trident-csi
time="2022-02-27T21:31:29Z" level=info msg="A Trident cluster role found by label." clusterRole=trident-csi
time="2022-02-27T21:31:29Z" level=info msg="A Trident Cluster role binding was found by label." clusterRoleBinding=trident-csi
time="2022-02-27T21:31:29Z" level=info msg="CRD present." CRD=tridentversions.trident.netapp.io
time="2022-02-27T21:31:29Z" level=info msg="CRD present." CRD=tridentbackends.trident.netapp.io
time="2022-02-27T21:31:29Z" level=info msg="CRD present." CRD=tridentmirrorrelationships.trident.netapp.io
time="2022-02-27T21:31:29Z" level=info msg="CRD present." CRD=tridentsnapshotinfos.trident.netapp.io
time="2022-02-27T21:31:29Z" level=info msg="CRD present." CRD=tridentbackendconfigs.trident.netapp.io
time="2022-02-27T21:31:29Z" level=info msg="CRD present." CRD=tridentstorageclasses.trident.netapp.io
time="2022-02-27T21:31:29Z" level=info msg="CRD present." CRD=tridentvolumes.trident.netapp.io
time="2022-02-27T21:31:29Z" level=info msg="CRD present." CRD=tridentvolumepublications.trident.netapp.io
time="2022-02-27T21:31:29Z" level=info msg="CRD present." CRD=tridentnodes.trident.netapp.io
time="2022-02-27T21:31:29Z" level=info msg="CRD present." CRD=tridenttransactions.trident.netapp.io
time="2022-02-27T21:31:29Z" level=info msg="CRD present." CRD=tridentsnapshots.trident.netapp.io
W0227 21:31:29.542908 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:31:29Z" level=info msg="A Trident Pod security policy was found by label." podSecurityPolicy=tridentpods
W0227 21:31:29.550602 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
W0227 21:31:29.560878 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:31:29Z" level=info msg="A Trident CSI driver found by label." TridentCSIDriver=csi.trident.netapp.io
time="2022-02-27T21:31:29Z" level=info msg="A Trident service was found by label." namespace=netapp service=trident-csi
time="2022-02-27T21:31:29Z" level=info msg="A Trident secret was found by label." namespace=netapp secret=trident-csi
time="2022-02-27T21:31:29Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:31:29Z" level=info msg="A Trident daemonSet was found by label." daemonSet=trident-csi namespace=netapp
time="2022-02-27T21:31:31Z" level=info msg="CR updated." CR=trident CRD=TridentOrchestrator
time="2022-02-27T21:31:36Z" level=info msg="Waiting for Trident pod to start."
time="2022-02-27T21:31:36Z" level=info msg="Trident pod started." namespace=netapp pod=trident-csi-558f9448cd-9hb4s
time="2022-02-27T21:31:36Z" level=info msg="Waiting for Trident REST interface."
time="2022-02-27T21:31:36Z" level=info msg="Trident REST interface is up." version=22.01.0
time="2022-02-27T21:31:36Z" level=info msg="Trident is installed." namespace=netapp version=v22.01.0
time="2022-02-27T21:31:36Z" level=info msg="New status is same as the old status, no update needed." tridentOrchestratorCR=trident
time="2022-02-27T21:31:36Z" level=info msg="Synced daemonset 'netapp/trident-csi'"
time="2022-02-27T21:31:36Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:31:36Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:31:36Z" level=info msg="An operator based Trident CSI deployment was found." deploymentName=trident-csi deploymentNamespace=netapp
time="2022-02-27T21:31:36Z" level=info msg="CRD not found." CRD=tridentprovisioners.trident.netapp.io
time="2022-02-27T21:31:36Z" level=info msg="Reconciler found Trident installation." callingCRName=trident callingResourceType=resourceTridentOrchestratorCR controllingCRBasedOnStatus=trident isCSI=true namespace=netapp operatorBasedCSIDeployments="[trident-csi]"
time="2022-02-27T21:31:36Z" level=info msg="Found CR that controls current Trident deployment." name=trident
time="2022-02-27T21:31:37Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:31:37Z" level=info msg="Starting Trident installation." namespace=netapp
time="2022-02-27T21:31:37Z" level=info msg="A Trident Service account found by label." namespace=netapp serviceAccount=trident-csi
time="2022-02-27T21:31:37Z" level=info msg="A Trident cluster role found by label." clusterRole=trident-csi
time="2022-02-27T21:31:37Z" level=info msg="A Trident Cluster role binding was found by label." clusterRoleBinding=trident-csi
time="2022-02-27T21:31:37Z" level=info msg="CRD present." CRD=tridentversions.trident.netapp.io
time="2022-02-27T21:31:37Z" level=info msg="CRD present." CRD=tridentbackends.trident.netapp.io
time="2022-02-27T21:31:37Z" level=info msg="CRD present." CRD=tridentmirrorrelationships.trident.netapp.io
time="2022-02-27T21:31:37Z" level=info msg="CRD present." CRD=tridentsnapshotinfos.trident.netapp.io
time="2022-02-27T21:31:37Z" level=info msg="CRD present." CRD=tridentbackendconfigs.trident.netapp.io
time="2022-02-27T21:31:37Z" level=info msg="CRD present." CRD=tridentstorageclasses.trident.netapp.io
time="2022-02-27T21:31:37Z" level=info msg="CRD present." CRD=tridentvolumes.trident.netapp.io
time="2022-02-27T21:31:37Z" level=info msg="CRD present." CRD=tridentvolumepublications.trident.netapp.io
time="2022-02-27T21:31:37Z" level=info msg="CRD present." CRD=tridentnodes.trident.netapp.io
time="2022-02-27T21:31:37Z" level=info msg="CRD present." CRD=tridenttransactions.trident.netapp.io
time="2022-02-27T21:31:37Z" level=info msg="CRD present." CRD=tridentsnapshots.trident.netapp.io
W0227 21:31:37.589143 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:31:37Z" level=info msg="A Trident Pod security policy was found by label." podSecurityPolicy=tridentpods
W0227 21:31:37.596234 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
W0227 21:31:37.604762 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:31:37Z" level=info msg="A Trident CSI driver found by label." TridentCSIDriver=csi.trident.netapp.io
time="2022-02-27T21:31:37Z" level=info msg="A Trident service was found by label." namespace=netapp service=trident-csi
time="2022-02-27T21:31:37Z" level=info msg="A Trident secret was found by label." namespace=netapp secret=trident-csi
time="2022-02-27T21:31:37Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:31:37Z" level=info msg="A Trident daemonSet was found by label." daemonSet=trident-csi namespace=netapp
time="2022-02-27T21:31:44Z" level=info msg="Waiting for Trident pod to start."
time="2022-02-27T21:31:44Z" level=info msg="Trident pod started." namespace=netapp pod=trident-csi-558f9448cd-9hb4s
time="2022-02-27T21:31:44Z" level=info msg="Waiting for Trident REST interface."
time="2022-02-27T21:31:44Z" level=info msg="Trident REST interface is up." version=22.01.0
time="2022-02-27T21:31:44Z" level=info msg="Trident is installed." namespace=netapp version=v22.01.0
time="2022-02-27T21:31:44Z" level=info msg="New status is same as the old status, no update needed." tridentOrchestratorCR=trident
time="2022-02-27T21:31:44Z" level=info msg="Synced Trident Orchestrator CR 'trident'"
time="2022-02-27T21:31:44Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:31:44Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:36:31Z" level=info msg="CR updated." CR=trident CRD=TridentOrchestrator
time="2022-02-27T21:36:31Z" level=info msg="An operator based Trident CSI deployment was found." deploymentName=trident-csi deploymentNamespace=netapp
time="2022-02-27T21:36:31Z" level=info msg="CRD not found." CRD=tridentprovisioners.trident.netapp.io
time="2022-02-27T21:36:31Z" level=info msg="Reconciler found Trident installation." callingCRName=trident callingResourceType=resourceTridentOrchestratorCR controllingCRBasedOnStatus=trident isCSI=true namespace=netapp operatorBasedCSIDeployments="[trident-csi]"
time="2022-02-27T21:36:31Z" level=info msg="Found CR that controls current Trident deployment." name=trident
time="2022-02-27T21:36:31Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:36:31Z" level=info msg="Starting Trident installation." namespace=netapp
time="2022-02-27T21:36:31Z" level=info msg="A Trident Service account found by label." namespace=netapp serviceAccount=trident-csi
time="2022-02-27T21:36:31Z" level=info msg="A Trident cluster role found by label." clusterRole=trident-csi
time="2022-02-27T21:36:31Z" level=info msg="A Trident Cluster role binding was found by label." clusterRoleBinding=trident-csi
time="2022-02-27T21:36:31Z" level=info msg="CRD present." CRD=tridentversions.trident.netapp.io
time="2022-02-27T21:36:31Z" level=info msg="CRD present." CRD=tridentbackends.trident.netapp.io
time="2022-02-27T21:36:31Z" level=info msg="CRD present." CRD=tridentmirrorrelationships.trident.netapp.io
time="2022-02-27T21:36:31Z" level=info msg="CRD present." CRD=tridentsnapshotinfos.trident.netapp.io
time="2022-02-27T21:36:31Z" level=info msg="CRD present." CRD=tridentbackendconfigs.trident.netapp.io
time="2022-02-27T21:36:31Z" level=info msg="CRD present." CRD=tridentstorageclasses.trident.netapp.io
time="2022-02-27T21:36:31Z" level=info msg="CRD present." CRD=tridentvolumes.trident.netapp.io
time="2022-02-27T21:36:31Z" level=info msg="CRD present." CRD=tridentvolumepublications.trident.netapp.io
time="2022-02-27T21:36:31Z" level=info msg="CRD present." CRD=tridentnodes.trident.netapp.io
time="2022-02-27T21:36:31Z" level=info msg="CRD present." CRD=tridenttransactions.trident.netapp.io
time="2022-02-27T21:36:31Z" level=info msg="CRD present." CRD=tridentsnapshots.trident.netapp.io
W0227 21:36:31.766153 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:36:31Z" level=info msg="A Trident Pod security policy was found by label." podSecurityPolicy=tridentpods
W0227 21:36:31.781734 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
W0227 21:36:31.791523 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:36:31Z" level=info msg="A Trident CSI driver found by label." TridentCSIDriver=csi.trident.netapp.io
time="2022-02-27T21:36:31Z" level=info msg="A Trident service was found by label." namespace=netapp service=trident-csi
time="2022-02-27T21:36:31Z" level=info msg="A Trident secret was found by label." namespace=netapp secret=trident-csi
time="2022-02-27T21:36:31Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:36:31Z" level=info msg="A Trident daemonSet was found by label." daemonSet=trident-csi namespace=netapp
time="2022-02-27T21:36:38Z" level=info msg="Waiting for Trident pod to start."
time="2022-02-27T21:36:38Z" level=info msg="Trident pod started." namespace=netapp pod=trident-csi-558f9448cd-9hb4s
time="2022-02-27T21:36:38Z" level=info msg="Waiting for Trident REST interface."
time="2022-02-27T21:36:39Z" level=info msg="Trident REST interface is up." version=22.01.0
time="2022-02-27T21:36:39Z" level=info msg="Trident is installed." namespace=netapp version=v22.01.0
time="2022-02-27T21:36:39Z" level=info msg="New status is same as the old status, no update needed." tridentOrchestratorCR=trident
time="2022-02-27T21:36:39Z" level=info msg="Synced Trident Orchestrator CR 'trident'"
time="2022-02-27T21:36:39Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:36:39Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:41:31Z" level=info msg="CR updated." CR=trident CRD=TridentOrchestrator
time="2022-02-27T21:41:31Z" level=info msg="An operator based Trident CSI deployment was found." deploymentName=trident-csi deploymentNamespace=netapp
time="2022-02-27T21:41:31Z" level=info msg="CRD not found." CRD=tridentprovisioners.trident.netapp.io
time="2022-02-27T21:41:31Z" level=info msg="Reconciler found Trident installation." callingCRName=trident callingResourceType=resourceTridentOrchestratorCR controllingCRBasedOnStatus=trident isCSI=true namespace=netapp operatorBasedCSIDeployments="[trident-csi]"
time="2022-02-27T21:41:31Z" level=info msg="Found CR that controls current Trident deployment." name=trident
time="2022-02-27T21:41:31Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:41:31Z" level=info msg="Starting Trident installation." namespace=netapp
time="2022-02-27T21:41:31Z" level=info msg="A Trident Service account found by label." namespace=netapp serviceAccount=trident-csi
time="2022-02-27T21:41:31Z" level=info msg="A Trident cluster role found by label." clusterRole=trident-csi
time="2022-02-27T21:41:31Z" level=info msg="A Trident Cluster role binding was found by label." clusterRoleBinding=trident-csi
time="2022-02-27T21:41:31Z" level=info msg="CRD present." CRD=tridentversions.trident.netapp.io
time="2022-02-27T21:41:31Z" level=info msg="CRD present." CRD=tridentbackends.trident.netapp.io
time="2022-02-27T21:41:31Z" level=info msg="CRD present." CRD=tridentmirrorrelationships.trident.netapp.io
time="2022-02-27T21:41:31Z" level=info msg="CRD present." CRD=tridentsnapshotinfos.trident.netapp.io
time="2022-02-27T21:41:31Z" level=info msg="CRD present." CRD=tridentbackendconfigs.trident.netapp.io
time="2022-02-27T21:41:31Z" level=info msg="CRD present." CRD=tridentstorageclasses.trident.netapp.io
time="2022-02-27T21:41:31Z" level=info msg="CRD present." CRD=tridentvolumes.trident.netapp.io
time="2022-02-27T21:41:31Z" level=info msg="CRD present." CRD=tridentvolumepublications.trident.netapp.io
time="2022-02-27T21:41:31Z" level=info msg="CRD present." CRD=tridentnodes.trident.netapp.io
time="2022-02-27T21:41:31Z" level=info msg="CRD present." CRD=tridenttransactions.trident.netapp.io
time="2022-02-27T21:41:31Z" level=info msg="CRD present." CRD=tridentsnapshots.trident.netapp.io
W0227 21:41:31.786720 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:41:31Z" level=info msg="A Trident Pod security policy was found by label." podSecurityPolicy=tridentpods
W0227 21:41:31.794659 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
W0227 21:41:31.803532 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:41:31Z" level=info msg="A Trident CSI driver found by label." TridentCSIDriver=csi.trident.netapp.io
time="2022-02-27T21:41:31Z" level=info msg="A Trident service was found by label." namespace=netapp service=trident-csi
time="2022-02-27T21:41:31Z" level=info msg="A Trident secret was found by label." namespace=netapp secret=trident-csi
time="2022-02-27T21:41:31Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:41:31Z" level=info msg="A Trident daemonSet was found by label." daemonSet=trident-csi namespace=netapp
time="2022-02-27T21:41:38Z" level=info msg="Waiting for Trident pod to start."
time="2022-02-27T21:41:38Z" level=info msg="Trident pod started." namespace=netapp pod=trident-csi-558f9448cd-9hb4s
time="2022-02-27T21:41:38Z" level=info msg="Waiting for Trident REST interface."
time="2022-02-27T21:41:39Z" level=info msg="Trident REST interface is up." version=22.01.0
time="2022-02-27T21:41:39Z" level=info msg="Trident is installed." namespace=netapp version=v22.01.0
time="2022-02-27T21:41:39Z" level=info msg="New status is same as the old status, no update needed." tridentOrchestratorCR=trident
time="2022-02-27T21:41:39Z" level=info msg="Synced Trident Orchestrator CR 'trident'"
time="2022-02-27T21:41:39Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:41:39Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:46:31Z" level=info msg="CR updated." CR=trident CRD=TridentOrchestrator
time="2022-02-27T21:46:31Z" level=info msg="An operator based Trident CSI deployment was found." deploymentName=trident-csi deploymentNamespace=netapp
time="2022-02-27T21:46:31Z" level=info msg="CRD not found." CRD=tridentprovisioners.trident.netapp.io
time="2022-02-27T21:46:31Z" level=info msg="Reconciler found Trident installation." callingCRName=trident callingResourceType=resourceTridentOrchestratorCR controllingCRBasedOnStatus=trident isCSI=true namespace=netapp operatorBasedCSIDeployments="[trident-csi]"
time="2022-02-27T21:46:31Z" level=info msg="Found CR that controls current Trident deployment." name=trident
time="2022-02-27T21:46:31Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:46:31Z" level=info msg="Starting Trident installation." namespace=netapp
time="2022-02-27T21:46:31Z" level=info msg="A Trident Service account found by label." namespace=netapp serviceAccount=trident-csi
time="2022-02-27T21:46:31Z" level=info msg="A Trident cluster role found by label." clusterRole=trident-csi
time="2022-02-27T21:46:31Z" level=info msg="A Trident Cluster role binding was found by label." clusterRoleBinding=trident-csi
time="2022-02-27T21:46:31Z" level=info msg="CRD present." CRD=tridentversions.trident.netapp.io
time="2022-02-27T21:46:31Z" level=info msg="CRD present." CRD=tridentbackends.trident.netapp.io
time="2022-02-27T21:46:31Z" level=info msg="CRD present." CRD=tridentmirrorrelationships.trident.netapp.io
time="2022-02-27T21:46:31Z" level=info msg="CRD present." CRD=tridentsnapshotinfos.trident.netapp.io
time="2022-02-27T21:46:31Z" level=info msg="CRD present." CRD=tridentbackendconfigs.trident.netapp.io
time="2022-02-27T21:46:31Z" level=info msg="CRD present." CRD=tridentstorageclasses.trident.netapp.io
time="2022-02-27T21:46:31Z" level=info msg="CRD present." CRD=tridentvolumes.trident.netapp.io
time="2022-02-27T21:46:31Z" level=info msg="CRD present." CRD=tridentvolumepublications.trident.netapp.io
time="2022-02-27T21:46:31Z" level=info msg="CRD present." CRD=tridentnodes.trident.netapp.io
time="2022-02-27T21:46:31Z" level=info msg="CRD present." CRD=tridenttransactions.trident.netapp.io
time="2022-02-27T21:46:31Z" level=info msg="CRD present." CRD=tridentsnapshots.trident.netapp.io
W0227 21:46:31.785108 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:46:31Z" level=info msg="A Trident Pod security policy was found by label." podSecurityPolicy=tridentpods
W0227 21:46:31.794644 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
W0227 21:46:31.803616 1 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-02-27T21:46:31Z" level=info msg="A Trident CSI driver found by label." TridentCSIDriver=csi.trident.netapp.io
time="2022-02-27T21:46:31Z" level=info msg="A Trident service was found by label." namespace=netapp service=trident-csi
time="2022-02-27T21:46:31Z" level=info msg="A Trident secret was found by label." namespace=netapp secret=trident-csi
time="2022-02-27T21:46:31Z" level=info msg="A Trident deployment was found by label" deployment=trident-csi namespace=netapp
time="2022-02-27T21:46:31Z" level=info msg="A Trident daemonSet was found by label." daemonSet=trident-csi namespace=netapp
time="2022-02-27T21:46:38Z" level=info msg="Waiting for Trident pod to start."
time="2022-02-27T21:46:38Z" level=info msg="Trident pod started." namespace=netapp pod=trident-csi-558f9448cd-9hb4s
time="2022-02-27T21:46:38Z" level=info msg="Waiting for Trident REST interface."
time="2022-02-27T21:46:39Z" level=info msg="Trident REST interface is up." version=22.01.0
time="2022-02-27T21:46:39Z" level=info msg="Trident is installed." namespace=netapp version=v22.01.0
time="2022-02-27T21:46:39Z" level=info msg="New status is same as the old status, no update needed." tridentOrchestratorCR=trident
time="2022-02-27T21:46:39Z" level=info msg="Synced Trident Orchestrator CR 'trident'"
time="2022-02-27T21:46:39Z" level=info msg=-------------------------------------------------
time="2022-02-27T21:46:39Z" level=info msg=-------------------------------------------------
Was wondering does the CSI helm chat use the ports 31579 and 32165 in any way and can these ports be changed to something else via the helm chart?
About this issue
- Original URL
- State: closed
- Created 2 years ago
- Comments: 15 (4 by maintainers)
interestingly I have tried via this kubectl manifest and can form that this made the file called test
I then revised the configuration to
whilst modifying the test file to contain
when reading back the file from the pod it displayed the correct message when bypassing storageclass as the volume had been provisioned by the netapp backend previously (anj)
This suggests a a problem with the storage class when communicating with the Netapp backend @balaramesh is there any additional documentation on how to configure the storage class to work alongside the Netapp backend?