cockroach-operator: Version checker runs but operator does not create cluster

This is a flake I have seen in OpenShift a couple of times using my new e2e test.

This is all of the logs unfortunately

{"level":"info","ts":1623430339.9542468,"logger":"setup","msg":"starting manager"}
{"level":"info","ts":1623430339.954956,"logger":"controller-runtime.manager","msg":"starting metrics server","path":"/metrics"}
{"level":"info","ts":1623430339.9550157,"logger":"controller-runtime.manager.controller.crdbcluster","msg":"Starting EventSource","reconciler group":"crdb.cockroachlabs.com","reconciler kind":"CrdbCluster","source":"kind source: /, Kind="}
{"level":"info","ts":1623430340.056454,"logger":"controller-runtime.manager.controller.crdbcluster","msg":"Starting EventSource","reconciler group":"crdb.cockroachlabs.com","reconciler kind":"CrdbCluster","source":"kind source: /, Kind="}
{"level":"info","ts":1623430340.1573,"logger":"controller-runtime.manager.controller.crdbcluster","msg":"Starting EventSource","reconciler group":"crdb.cockroachlabs.com","reconciler kind":"CrdbCluster","source":"kind source: /, Kind="}
{"level":"info","ts":1623430340.2584233,"logger":"controller-runtime.manager.controller.crdbcluster","msg":"Starting EventSource","reconciler group":"crdb.cockroachlabs.com","reconciler kind":"CrdbCluster","source":"kind source: /, Kind="}
{"level":"info","ts":1623430340.3597455,"logger":"controller-runtime.manager.controller.crdbcluster","msg":"Starting Controller","reconciler group":"crdb.cockroachlabs.com","reconciler kind":"CrdbCluster"}
{"level":"info","ts":1623430340.3598483,"logger":"controller-runtime.manager.controller.crdbcluster","msg":"Starting workers","reconciler group":"crdb.cockroachlabs.com","reconciler kind":"CrdbCluster","worker count":1}
{"level":"info","ts":1623430340.3600054,"logger":"controller.CrdbCluster","msg":"reconciling CockroachDB cluster","CrdbCluster":"test/cockroachdb"}
{"level":"info","ts":1623430340.3601382,"logger":"controller.CrdbCluster","msg":"Running action with index: 1 and  name: VersionCheckerAction","CrdbCluster":"test/cockroachdb"}
{"level":"warn","ts":1623430340.3601544,"logger":"action","msg":"starting to check the crdb version of the container provided","action":"Crdb Version Validator","CrdbCluster":"test/cockroachdb"}
{"level":"warn","ts":1623430340.360184,"logger":"action","msg":"User set image.name, using that field instead of cockroachDBVersion","action":"Crdb Version Validator","CrdbCluster":"test/cockroachdb"}
{"level":"warn","ts":1623430340.5441709,"logger":"action","msg":"created/updated job, stopping request processing","action":"Crdb Version Validator","CrdbCluster":"test/cockroachdb"}
{"level":"info","ts":1623430340.544376,"logger":"controller.CrdbCluster","msg":"request was interrupted","CrdbCluster":"test/cockroachdb"}

About this issue

  • Original URL
  • State: closed
  • Created 3 years ago
  • Comments: 17 (14 by maintainers)

Most upvoted comments

Both CRDB resources are in a failed state with Initialized being false and the current status being: failed to reconcile statefulset: Operation cannot be fulfilled on statefulsets.apps “xyzdb”: the object has been modified; please apply your changes to the latest version and try again. The operator is constantly trying to reconcile the sts and is spamming logs using up memory etc.

That probably was caused by you initializing the DB manually. Have not done that before 😃

@taroface can we document to not initialize the DB and that the operator does it for you.