rook: Ceph multisite objecstore createSystemUser doesn't always run

Is this a bug report or feature request?

  • Bug Report

Deviation from expected behavior: When creating a multisite objectstore in accordance with the docs, rgw user <realm-name>-system-user is not always created. Interestingly, the k8s secret <realm-name>-keys seems to always be created regardless of whether the rgw user is created. I do see the access key and secret key set on the zone itself, but no corresponding user in the output of radosgw-admin user list

The result of this is the secondary site cannot pull the realm even when the <realm-name-keys> secret is copied over properly to a second k8s cluster.

This does not always happen, I suspect it’s a problem with reconcile re-entrance. Unfortunately it’s not trivial for me to enable debug logging and reproduce.

Expected behavior: This user should always get created when using multisite settings.

How to reproduce it (minimal and precise): Follow docs to create a multisite objecstore (create a realm, zg, zone, and objectstore which references zone). Connect to toolbox, run radosgw-admin user list and inspect for proper user creation.

File(s) to submit: Code path in question: https://github.com/rook/rook/blob/3005a6fc6846992ff14a14a910e1f4b5066a52ad/pkg/operator/ceph/object/objectstore.go#L484

Environment:

  • OS (e.g. from /etc/os-release): RHEL 8.2 EUS
  • Kernel (e.g. uname -a): Linux server0 4.18.0-193.75.1.el8_2.x86_64
  • Cloud provider or hardware configuration: Azure
  • Rook version (use rook version inside of a Rook Pod): v1.8.9
  • Storage backend version (e.g. for ceph do ceph -v): 16.2.7
  • Kubernetes version (use kubectl version): Server Version: version.Info{Major:“1”, Minor:“21”, GitVersion:“v1.21.4+rke2r2”
  • Kubernetes cluster type (e.g. Tectonic, GKE, OpenShift): RKE2
  • Storage backend status (e.g. for Ceph use ceph health in the Rook Ceph toolbox): HEALTH_OK

About this issue

  • Original URL
  • State: closed
  • Created 4 years ago
  • Comments: 18 (5 by maintainers)

Most upvoted comments

Command for creating the system user you mean? radosgw-admin user create --rgw-realm=STH --uid=STH --display-name="STH" --system --access-key="STH" --secret-key="STH" --rgw-zone=STH