rook: Rook ceph OSD pods in Init:CrashLoopBackOff

Is this a bug report or feature request?

  • Bug Report

Deviation from expected behavior: Rook ceph osd pods are in Init:CrashLoopBackOff, after provisioning one pvc.

Expected behavior: Pods should not be in Init:CrashLoopBackOff

How to reproduce it (minimal and precise): Create a rook cluster on pvc. Create a pvc using rook storage class, osd pods enter in Init:CrashLoopBackOff state. expand-bluefs container is continuously crashing with below logs.

2021-05-19T06:36:05.166+0000 7f420d02f240 -1 bluestore(/var/lib/ceph/osd/ceph-1) _lock_fsid failed to lock /var/lib/ceph/osd/ceph-1/fsid (is another ceph-osd still running?)(11) Resource temporarily unavailable
/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.11/rpm/el8/BUILD/ceph-15.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::expand_devices(std::ostream&)' thread 7f420d02f240 time 2021-05-19T06:36:05.167168+0000
/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.11/rpm/el8/BUILD/ceph-15.2.11/src/os/bluestore/BlueStore.cc: 7165: FAILED ceph_assert(r == 0)
 ceph version 15.2.11 (e3523634d9c2227df9af89a4eac33d16738c49cb) octopus (stable)
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f420313696a]
 2: (()+0x27ab84) [0x7f4203136b84]
 3: (BlueStore::expand_devices(std::ostream&)+0xa71) [0x563b90ebd3e1]
 4: (main()+0x2c81) [0x563b90db4001]
 5: (__libc_start_main()+0xf3) [0x7f42009617b3]
 6: (_start()+0x2e) [0x563b90dd4cfe]
*** Caught signal (Aborted) **
 in thread 7f420d02f240 thread_name:ceph-bluestore-
2021-05-19T06:36:05.167+0000 7f420d02f240 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.11/rpm/el8/BUILD/ceph-15.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::expand_devices(std::ostream&)' thread 7f420d02f240 time 2021-05-19T06:36:05.167168+0000
/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.11/rpm/el8/BUILD/ceph-15.2.11/src/os/bluestore/BlueStore.cc: 7165: FAILED ceph_assert(r == 0)

 ceph version 15.2.11 (e3523634d9c2227df9af89a4eac33d16738c49cb) octopus (stable)
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f420313696a]
 2: (()+0x27ab84) [0x7f4203136b84]
 3: (BlueStore::expand_devices(std::ostream&)+0xa71) [0x563b90ebd3e1]
 4: (main()+0x2c81) [0x563b90db4001]
 5: (__libc_start_main()+0xf3) [0x7f42009617b3]
 6: (_start()+0x2e) [0x563b90dd4cfe]

 ceph version 15.2.11 (e3523634d9c2227df9af89a4eac33d16738c49cb) octopus (stable)
 1: (()+0x12b20) [0x7f4202330b20]
 2: (gsignal()+0x10f) [0x7f42009757ff]
 3: (abort()+0x127) [0x7f420095fc35]
 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f42031369bb]
 5: (()+0x27ab84) [0x7f4203136b84]
 6: (BlueStore::expand_devices(std::ostream&)+0xa71) [0x563b90ebd3e1]
 7: (main()+0x2c81) [0x563b90db4001]
 8: (__libc_start_main()+0xf3) [0x7f42009617b3]
 9: (_start()+0x2e) [0x563b90dd4cfe]
2021-05-19T06:36:05.169+0000 7f420d02f240 -1 *** Caught signal (Aborted) **
 in thread 7f420d02f240 thread_name:ceph-bluestore-

 ceph version 15.2.11 (e3523634d9c2227df9af89a4eac33d16738c49cb) octopus (stable)
 1: (()+0x12b20) [0x7f4202330b20]
 2: (gsignal()+0x10f) [0x7f42009757ff]
 3: (abort()+0x127) [0x7f420095fc35]
 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f42031369bb]
 5: (()+0x27ab84) [0x7f4203136b84]
 6: (BlueStore::expand_devices(std::ostream&)+0xa71) [0x563b90ebd3e1]
 7: (main()+0x2c81) [0x563b90db4001]
 8: (__libc_start_main()+0xf3) [0x7f42009617b3]
 9: (_start()+0x2e) [0x563b90dd4cfe]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

File(s) to submit:

cluster.yaml

kind: CephCluster
metadata:
  name: rook-ceph
  namespace: rook-ceph
spec:
  cephVersion:
    image: ceph/ceph:v15.2.11
  cleanupPolicy:
    sanitizeDisks: {}
  crashCollector: {}
  dashboard:
    enabled: true
    ssl: true
  dataDirHostPath: /var/lib/rook
  disruptionManagement:
    machineDisruptionBudgetNamespace: openshift-machine-api
    managePodBudgets: true
    osdMaintenanceTimeout: 30
  external: {}
  healthCheck:
    daemonHealth:
      mon: {}
      osd: {}
      status: {}
  logCollector: {}
  mgr:
    count: 1
    modules:
    - enabled: true
      name: pg_autoscaler
  mon:
    count: 3
  monitoring: {}
  network:
    ipFamily: IPv4
  placement:
    all:
      nodeAffinity:
        requiredDuringSchedulingIgnoredDuringExecution:
          nodeSelectorTerms:
          - matchExpressions:
            - key: role
              operator: In
              values:
              - storage-node
      tolerations:
      - effect: NoSchedule
        operator: Exists
  security:
    kms: {}
  storage:
    storageClassDeviceSets:
    - count: 3
      name: set0
      placement: {}
      resources: {}
      volumeClaimTemplates:
      - metadata:
          name: data
        spec:
          accessModes:
          - ReadWriteOnce
          resources:
            requests:
              storage: 100Gi
          storageClassName: rook-local-storage
          volumeMode: Block
        status: {}

Environment:

  • OS (e.g. from /etc/os-release):
VERSION="7 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="https://www.centos.org/"
BUG_REPORT_URL="https://bugs.centos.org/"

CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"

  • Kernel (e.g. uname -a): Linux devops013-mst-01 3.10.0-1160.25.1.el7.x86_64 #1 SMP Wed Apr 28 21:49:45 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

  • Cloud provider or hardware configuration:

  • Rook version (use rook version inside of a Rook Pod): 1.6.2

  • Storage backend version (e.g. for ceph do ceph -v): 15.2.11

  • Kubernetes version (use kubectl version): v1.20.4

  • Kubernetes cluster type (e.g. Tectonic, GKE, OpenShift): kubeadm

  • Storage backend status (e.g. for Ceph use ceph health in the Rook Ceph toolbox):

  cluster:
    id:     83eb664c-8089-43fe-89ad-ac3a0f31af69
    health: HEALTH_WARN
            mons are allowing insecure global_id reclaim
            clock skew detected on mon.b, mon.c

  services:
    mon: 3 daemons, quorum a,b,c (age 45m)
    mgr: a(active, since 44m)
    osd: 3 osds: 3 up (since 45m), 3 in (since 45m)

  data:
    pools:   2 pools, 33 pgs
    objects: 124 objects, 380 MiB
    usage:   4.1 GiB used, 380 GiB / 384 GiB avail
    pgs:     33 active+clean

  io:
    client:   53 KiB/s wr, 0 op/s rd, 0 op/s wr

[root@rook-ceph-tools-78cdfd976c-hlcrj /]# ceph health
HEALTH_WARN mons are allowing insecure global_id reclaim; clock skew detected on mon.b, mon.c
[root@rook-ceph-tools-78cdfd976c-hlcrj /]#

About this issue

  • Original URL
  • State: closed
  • Created 3 years ago
  • Comments: 15 (6 by maintainers)

Most upvoted comments

I have three servers having same disk /dev/vdd , there is one PV per host.

+1
ankur-gupta-guavus on May 20, 2021

@satoru-takeuchi No probs , here you go

$ kubectl get pv -o yaml
apiVersion: v1
items:
- apiVersion: v1
  kind: PersistentVolume
  metadata:
    annotations:
      pv.kubernetes.io/provisioned-by: rook-ceph.rbd.csi.ceph.com
    creationTimestamp: "2021-05-19T12:03:07Z"
    finalizers:
    - kubernetes.io/pv-protection
    managedFields:
    - apiVersion: v1
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:annotations:
            .: {}
            f:pv.kubernetes.io/provisioned-by: {}
        f:spec:
          f:accessModes: {}
          f:capacity:
            .: {}
            f:storage: {}
          f:claimRef:
            .: {}
            f:apiVersion: {}
            f:kind: {}
            f:name: {}
            f:namespace: {}
            f:resourceVersion: {}
            f:uid: {}
          f:csi:
            .: {}
            f:controllerExpandSecretRef:
              .: {}
              f:name: {}
              f:namespace: {}
            f:driver: {}
            f:fsType: {}
            f:nodeStageSecretRef:
              .: {}
              f:name: {}
              f:namespace: {}
            f:volumeAttributes:
              .: {}
              f:clusterID: {}
              f:csi.storage.k8s.io/pv/name: {}
              f:csi.storage.k8s.io/pvc/name: {}
              f:csi.storage.k8s.io/pvc/namespace: {}
              f:imageFeatures: {}
              f:imageFormat: {}
              f:imageName: {}
              f:journalPool: {}
              f:pool: {}
              f:storage.kubernetes.io/csiProvisionerIdentity: {}
            f:volumeHandle: {}
          f:persistentVolumeReclaimPolicy: {}
          f:storageClassName: {}
          f:volumeMode: {}
      manager: csi-provisioner
      operation: Update
      time: "2021-05-19T12:03:07Z"
    - apiVersion: v1
      fieldsType: FieldsV1
      fieldsV1:
        f:status:
          f:phase: {}
      manager: kube-controller-manager
      operation: Update
      time: "2021-05-19T12:03:07Z"
    name: pvc-488cb4ca-cfb7-4edb-82dd-4a47c8aa00f8
    resourceVersion: "311266"
    uid: 993d2851-2048-44d9-a946-a72c3490eba1
  spec:
    accessModes:
    - ReadWriteOnce
    capacity:
      storage: 10Gi
    claimRef:
      apiVersion: v1
      kind: PersistentVolumeClaim
      name: data-postgresql
      namespace: postgresql
      resourceVersion: "311245"
      uid: 488cb4ca-cfb7-4edb-82dd-4a47c8aa00f8
    csi:
      controllerExpandSecretRef:
        name: rook-csi-rbd-provisioner
        namespace: rook-ceph
      driver: rook-ceph.rbd.csi.ceph.com
      fsType: ext4
      nodeStageSecretRef:
        name: rook-csi-rbd-node
        namespace: rook-ceph
      volumeAttributes:
        clusterID: rook-ceph
        csi.storage.k8s.io/pv/name: pvc-488cb4ca-cfb7-4edb-82dd-4a47c8aa00f8
        csi.storage.k8s.io/pvc/name: data-postgresql
        csi.storage.k8s.io/pvc/namespace: postgresql
        imageFeatures: layering
        imageFormat: "2"
        imageName: csi-vol-2b39c885-b89a-11eb-baf5-629f34a70734
        journalPool: replicapool
        pool: replicapool
        storage.kubernetes.io/csiProvisionerIdentity: 1621404118326-8081-rook-ceph.rbd.csi.ceph.com
      volumeHandle: 0001-0009-rook-ceph-0000000000000002-2b39c885-b89a-11eb-baf5-629f34a70734
    persistentVolumeReclaimPolicy: Delete
    storageClassName: rook
    volumeMode: Filesystem
  status:
    phase: Bound
- apiVersion: v1
  kind: PersistentVolume
  metadata:
    annotations:
      pv.kubernetes.io/provisioned-by: rook-ceph.rbd.csi.ceph.com
    creationTimestamp: "2021-05-19T06:23:04Z"
    finalizers:
    - kubernetes.io/pv-protection
    managedFields:
    - apiVersion: v1
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:annotations:
            .: {}
            f:pv.kubernetes.io/provisioned-by: {}
        f:spec:
          f:accessModes: {}
          f:capacity:
            .: {}
            f:storage: {}
          f:claimRef:
            .: {}
            f:apiVersion: {}
            f:kind: {}
            f:name: {}
            f:namespace: {}
            f:resourceVersion: {}
            f:uid: {}
          f:csi:
            .: {}
            f:controllerExpandSecretRef:
              .: {}
              f:name: {}
              f:namespace: {}
            f:driver: {}
            f:fsType: {}
            f:nodeStageSecretRef:
              .: {}
              f:name: {}
              f:namespace: {}
            f:volumeAttributes:
              .: {}
              f:clusterID: {}
              f:csi.storage.k8s.io/pv/name: {}
              f:csi.storage.k8s.io/pvc/name: {}
              f:csi.storage.k8s.io/pvc/namespace: {}
              f:imageFeatures: {}
              f:imageFormat: {}
              f:imageName: {}
              f:journalPool: {}
              f:pool: {}
              f:storage.kubernetes.io/csiProvisionerIdentity: {}
            f:volumeHandle: {}
          f:persistentVolumeReclaimPolicy: {}
          f:storageClassName: {}
          f:volumeMode: {}
      manager: csi-provisioner
      operation: Update
      time: "2021-05-19T06:23:04Z"
    - apiVersion: v1
      fieldsType: FieldsV1
      fieldsV1:
        f:status:
          f:phase: {}
      manager: kube-controller-manager
      operation: Update
      time: "2021-05-19T06:23:04Z"
    name: pvc-4f378a83-9f70-4e86-8d39-248376ed9c7d
    resourceVersion: "226371"
    uid: 222c5853-dee4-479f-b51c-20e3a98a38ee
  spec:
    accessModes:
    - ReadWriteOnce
    capacity:
      storage: 20Gi
    claimRef:
      apiVersion: v1
      kind: PersistentVolumeClaim
      name: prometheus-server
      namespace: prometheus
      resourceVersion: "226317"
      uid: 4f378a83-9f70-4e86-8d39-248376ed9c7d
    csi:
      controllerExpandSecretRef:
        name: rook-csi-rbd-provisioner
        namespace: rook-ceph
      driver: rook-ceph.rbd.csi.ceph.com
      fsType: ext4
      nodeStageSecretRef:
        name: rook-csi-rbd-node
        namespace: rook-ceph
      volumeAttributes:
        clusterID: rook-ceph
        csi.storage.k8s.io/pv/name: pvc-4f378a83-9f70-4e86-8d39-248376ed9c7d
        csi.storage.k8s.io/pvc/name: prometheus-server
        csi.storage.k8s.io/pvc/namespace: prometheus
        imageFeatures: layering
        imageFormat: "2"
        imageName: csi-vol-a93e2381-b86a-11eb-baf5-629f34a70734
        journalPool: replicapool
        pool: replicapool
        storage.kubernetes.io/csiProvisionerIdentity: 1621404118326-8081-rook-ceph.rbd.csi.ceph.com
      volumeHandle: 0001-0009-rook-ceph-0000000000000002-a93e2381-b86a-11eb-baf5-629f34a70734
    persistentVolumeReclaimPolicy: Delete
    storageClassName: rook
    volumeMode: Filesystem
  status:
    phase: Bound
- apiVersion: v1
  kind: PersistentVolume
  metadata:
    annotations:
      kubectl.kubernetes.io/last-applied-configuration: '{"apiVersion":"v1","kind":"PersistentVolume","metadata":{"labels":{"drive":"rook-0-pvc-devops013-infra-01"},"name":"rook-0-pvc-devops013-infra-01"},"spec":{"accessModes":["ReadWriteOnce"],"capacity":{"storage":"100Gi"},"local":{"path":"/dev/vdd"},"nodeAffinity":{"required":{"nodeSelectorTerms":[{"matchExpressions":[{"key":"kubernetes.io/hostname","operator":"In","values":["devops013-infra-01"]}]}]}},"persistentVolumeReclaimPolicy":"Retain","storageClassName":"rook-local-storage","volumeMode":"Block"}}'
      pv.kubernetes.io/bound-by-controller: "yes"
    creationTimestamp: "2021-05-19T06:00:33Z"
    finalizers:
    - kubernetes.io/pv-protection
    labels:
      drive: rook-0-pvc-devops013-infra-01
    managedFields:
    - apiVersion: v1
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:annotations:
            .: {}
            f:kubectl.kubernetes.io/last-applied-configuration: {}
          f:labels:
            .: {}
            f:drive: {}
        f:spec:
          f:accessModes: {}
          f:capacity:
            .: {}
            f:storage: {}
          f:local:
            .: {}
            f:path: {}
          f:nodeAffinity:
            .: {}
            f:required:
              .: {}
              f:nodeSelectorTerms: {}
          f:persistentVolumeReclaimPolicy: {}
          f:storageClassName: {}
          f:volumeMode: {}
      manager: OpenAPI-Generator
      operation: Update
      time: "2021-05-19T06:00:33Z"
    - apiVersion: v1
      fieldsType: FieldsV1
      fieldsV1:
        f:status:
          f:phase: {}
      manager: kube-controller-manager
      operation: Update
      time: "2021-05-19T06:00:34Z"
    - apiVersion: v1
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:annotations:
            f:pv.kubernetes.io/bound-by-controller: {}
        f:spec:
          f:claimRef:
            .: {}
            f:apiVersion: {}
            f:kind: {}
            f:name: {}
            f:namespace: {}
            f:resourceVersion: {}
            f:uid: {}
      manager: kube-scheduler
      operation: Update
      time: "2021-05-19T06:03:12Z"
    name: rook-0-pvc-devops013-infra-01
    resourceVersion: "221128"
    uid: 64ffeeb9-89e4-48f2-979c-cd838cc7da79
  spec:
    accessModes:
    - ReadWriteOnce
    capacity:
      storage: 100Gi
    claimRef:
      apiVersion: v1
      kind: PersistentVolumeClaim
      name: set0-data-0zswc8
      namespace: rook-ceph
      resourceVersion: "221106"
      uid: 9f183e0b-8a88-439f-b9a0-02e357db856c
    local:
      path: /dev/vdd
    nodeAffinity:
      required:
        nodeSelectorTerms:
        - matchExpressions:
          - key: kubernetes.io/hostname
            operator: In
            values:
            - devops013-infra-01
    persistentVolumeReclaimPolicy: Retain
    storageClassName: rook-local-storage
    volumeMode: Block
  status:
    phase: Bound
- apiVersion: v1
  kind: PersistentVolume
  metadata:
    annotations:
      kubectl.kubernetes.io/last-applied-configuration: '{"apiVersion":"v1","kind":"PersistentVolume","metadata":{"labels":{"drive":"rook-0-pvc-devops013-infra-02"},"name":"rook-0-pvc-devops013-infra-02"},"spec":{"accessModes":["ReadWriteOnce"],"capacity":{"storage":"100Gi"},"local":{"path":"/dev/vdd"},"nodeAffinity":{"required":{"nodeSelectorTerms":[{"matchExpressions":[{"key":"kubernetes.io/hostname","operator":"In","values":["devops013-infra-02"]}]}]}},"persistentVolumeReclaimPolicy":"Retain","storageClassName":"rook-local-storage","volumeMode":"Block"}}'
      pv.kubernetes.io/bound-by-controller: "yes"
    creationTimestamp: "2021-05-19T06:00:34Z"
    finalizers:
    - kubernetes.io/pv-protection
    labels:
      drive: rook-0-pvc-devops013-infra-02
    managedFields:
    - apiVersion: v1
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:annotations:
            .: {}
            f:kubectl.kubernetes.io/last-applied-configuration: {}
          f:labels:
            .: {}
            f:drive: {}
        f:spec:
          f:accessModes: {}
          f:capacity:
            .: {}
            f:storage: {}
          f:local:
            .: {}
            f:path: {}
          f:nodeAffinity:
            .: {}
            f:required:
              .: {}
              f:nodeSelectorTerms: {}
          f:persistentVolumeReclaimPolicy: {}
          f:storageClassName: {}
          f:volumeMode: {}
      manager: OpenAPI-Generator
      operation: Update
      time: "2021-05-19T06:00:34Z"
    - apiVersion: v1
      fieldsType: FieldsV1
      fieldsV1:
        f:status:
          f:phase: {}
      manager: kube-controller-manager
      operation: Update
      time: "2021-05-19T06:00:34Z"
    - apiVersion: v1
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:annotations:
            f:pv.kubernetes.io/bound-by-controller: {}
        f:spec:
          f:claimRef:
            .: {}
            f:apiVersion: {}
            f:kind: {}
            f:name: {}
            f:namespace: {}
            f:resourceVersion: {}
            f:uid: {}
      manager: kube-scheduler
      operation: Update
      time: "2021-05-19T06:03:12Z"
    name: rook-0-pvc-devops013-infra-02
    resourceVersion: "221141"
    uid: 97eaea66-f670-4f1d-b610-f4d7665726b3
  spec:
    accessModes:
    - ReadWriteOnce
    capacity:
      storage: 100Gi
    claimRef:
      apiVersion: v1
      kind: PersistentVolumeClaim
      name: set0-data-26555b
      namespace: rook-ceph
      resourceVersion: "221109"
      uid: 8f739921-0c4c-4987-9d21-5ed348d17268
    local:
      path: /dev/vdd
    nodeAffinity:
      required:
        nodeSelectorTerms:
        - matchExpressions:
          - key: kubernetes.io/hostname
            operator: In
            values:
            - devops013-infra-02
    persistentVolumeReclaimPolicy: Retain
    storageClassName: rook-local-storage
    volumeMode: Block
  status:
    phase: Bound
- apiVersion: v1
  kind: PersistentVolume
  metadata:
    annotations:
      kubectl.kubernetes.io/last-applied-configuration: '{"apiVersion":"v1","kind":"PersistentVolume","metadata":{"labels":{"drive":"rook-0-pvc-devops013-infra-03"},"name":"rook-0-pvc-devops013-infra-03"},"spec":{"accessModes":["ReadWriteOnce"],"capacity":{"storage":"100Gi"},"local":{"path":"/dev/vdd"},"nodeAffinity":{"required":{"nodeSelectorTerms":[{"matchExpressions":[{"key":"kubernetes.io/hostname","operator":"In","values":["devops013-infra-03"]}]}]}},"persistentVolumeReclaimPolicy":"Retain","storageClassName":"rook-local-storage","volumeMode":"Block"}}'
      pv.kubernetes.io/bound-by-controller: "yes"
    creationTimestamp: "2021-05-19T06:00:34Z"
    finalizers:
    - kubernetes.io/pv-protection
    labels:
      drive: rook-0-pvc-devops013-infra-03
    managedFields:
    - apiVersion: v1
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:annotations:
            .: {}
            f:kubectl.kubernetes.io/last-applied-configuration: {}
          f:labels:
            .: {}
            f:drive: {}
        f:spec:
          f:accessModes: {}
          f:capacity:
            .: {}
            f:storage: {}
          f:local:
            .: {}
            f:path: {}
          f:nodeAffinity:
            .: {}
            f:required:
              .: {}
              f:nodeSelectorTerms: {}
          f:persistentVolumeReclaimPolicy: {}
          f:storageClassName: {}
          f:volumeMode: {}
      manager: OpenAPI-Generator
      operation: Update
      time: "2021-05-19T06:00:34Z"
    - apiVersion: v1
      fieldsType: FieldsV1
      fieldsV1:
        f:status:
          f:phase: {}
      manager: kube-controller-manager
      operation: Update
      time: "2021-05-19T06:00:34Z"
    - apiVersion: v1
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:annotations:
            f:pv.kubernetes.io/bound-by-controller: {}
        f:spec:
          f:claimRef:
            .: {}
            f:apiVersion: {}
            f:kind: {}
            f:name: {}
            f:namespace: {}
            f:resourceVersion: {}
            f:uid: {}
      manager: kube-scheduler
      operation: Update
      time: "2021-05-19T06:03:12Z"
    name: rook-0-pvc-devops013-infra-03
    resourceVersion: "221136"
    uid: 8af355fc-4dc2-446d-9110-ead8c0ccacad
  spec:
    accessModes:
    - ReadWriteOnce
    capacity:
      storage: 100Gi
    claimRef:
      apiVersion: v1
      kind: PersistentVolumeClaim
      name: set0-data-1frtrv
      namespace: rook-ceph
      resourceVersion: "221107"
      uid: 295919d8-5792-4fb7-b21a-4a650bf20cea
    local:
      path: /dev/vdd
    nodeAffinity:
      required:
        nodeSelectorTerms:
        - matchExpressions:
          - key: kubernetes.io/hostname
            operator: In
            values:
            - devops013-infra-03
    persistentVolumeReclaimPolicy: Retain
    storageClassName: rook-local-storage
    volumeMode: Block
  status:
    phase: Bound
kind: List
metadata:
  resourceVersion: ""
  selfLink: ""
+1
ankur-gupta-guavus on May 20, 2021
Read more comments on GitHub
← rook: rook-ceph-osd pods in CrashLoopBackOff
rook: rook-ceph-osd-prepare fails with bluestore(/var/lib/ceph/osd/ceph-1/) _read_fsid unparsable uuid →