rook: Ceph multisite objecstore createSystemUser doesn't always run
Is this a bug report or feature request?
- Bug Report
Deviation from expected behavior:
When creating a multisite objectstore in accordance with the docs, rgw user <realm-name>-system-user is not always created. Interestingly, the k8s secret <realm-name>-keys seems to always be created regardless of whether the rgw user is created. I do see the access key and secret key set on the zone itself, but no corresponding user in the output of radosgw-admin user list
The result of this is the secondary site cannot pull the realm even when the <realm-name-keys> secret is copied over properly to a second k8s cluster.
This does not always happen, I suspect it’s a problem with reconcile re-entrance. Unfortunately it’s not trivial for me to enable debug logging and reproduce.
Expected behavior: This user should always get created when using multisite settings.
How to reproduce it (minimal and precise):
Follow docs to create a multisite objecstore (create a realm, zg, zone, and objectstore which references zone).
Connect to toolbox, run radosgw-admin user list and inspect for proper user creation.
File(s) to submit: Code path in question: https://github.com/rook/rook/blob/3005a6fc6846992ff14a14a910e1f4b5066a52ad/pkg/operator/ceph/object/objectstore.go#L484
Environment:
- OS (e.g. from /etc/os-release): RHEL 8.2 EUS
- Kernel (e.g.
uname -a): Linux server0 4.18.0-193.75.1.el8_2.x86_64 - Cloud provider or hardware configuration: Azure
- Rook version (use
rook versioninside of a Rook Pod): v1.8.9 - Storage backend version (e.g. for ceph do
ceph -v): 16.2.7 - Kubernetes version (use
kubectl version): Server Version: version.Info{Major:“1”, Minor:“21”, GitVersion:“v1.21.4+rke2r2” - Kubernetes cluster type (e.g. Tectonic, GKE, OpenShift): RKE2
- Storage backend status (e.g. for Ceph use
ceph healthin the Rook Ceph toolbox): HEALTH_OK
About this issue
- Original URL
- State: closed
- Created 4 years ago
- Comments: 18 (5 by maintainers)
Command for creating the system user you mean?
radosgw-admin user create --rgw-realm=STH --uid=STH --display-name="STH" --system --access-key="STH" --secret-key="STH" --rgw-zone=STH