koperator: unable to delete a user

Describe the bug Cannot remove a user.

Steps to reproduce the issue: Created a user with write permission. Added read permission later to that user. Deleted the user.

Expected behavior User gets deleted.

Screenshots Operator logs

{"level":"info","ts":"2022-01-05T08:56:16.434Z","logger":"controllers.KafkaUser","msg":"Reconciling KafkaUser","kafkauser":"kafka-dev/myuser","Request.Name":"myuser"}
{"level":"info","ts":"2022-01-05T08:56:16.446Z","logger":"controllers.KafkaUser","msg":"Kafka user is marked for deletion, revoking certificates","kafkauser":"kafka-dev/myuser","Request.Name":"myuser"}
{"level":"info","ts":"2022-01-05T08:56:16.446Z","logger":"controllers.KafkaUser","msg":"Deleting user ACLs from kafka","kafkauser":"kafka-dev/myuser","Request.Name":"myuser"}
{"level":"info","ts":"2022-01-05T08:56:17.344Z","logger":"kafka_util","msg":"Kafka client closed cleanly"}
{"level":"info","ts":"2022-01-05T08:56:17.344Z","logger":"controllers.KafkaUser","msg":"failed to finalize kafkauser","kafkauser":"kafka-dev/myuser","Request.Name":"myuser"}
{"level":"error","ts":"2022-01-05T08:56:17.345Z","logger":"controller.KafkaUser","msg":"Reconciler error","reconciler group":"kafka.banzaicloud.io","reconciler kind":"KafkaUser","name":"myuser","namespace":"kafka-dev","error":"EOF","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.10.3/pkg/internal/controller/controller.go:227"}

$ kubectl -n kafka-dev get kafkauser myuser -o yaml
apiVersion: kafka.banzaicloud.io/v1alpha1
kind: KafkaUser
metadata:
  annotations:
    kubectl.kubernetes.io/last-applied-configuration: |
      {"apiVersion":"kafka.banzaicloud.io/v1alpha1","kind":"KafkaUser","metadata":{"annotations":{},"name":"myuser","namespace":"kafka-dev"},"spec":{"clusterRef":{"name":"kafka"},"secretName":"myuser-cert","topicGrants":[{"accessType":"write","topicName":"my-topic"},{"accessType":"read","topicName":"my-topic"}]}}
  creationTimestamp: "2022-01-05T00:07:11Z"
  deletionGracePeriodSeconds: 0
  deletionTimestamp: "2022-01-05T00:13:47Z"
  finalizers:
  - finalizer.kafkausers.kafka.banzaicloud.io
  generation: 3
  labels:
    kafkaCluster: kafka.kafka-dev
  name: myuser
  namespace: kafka-dev
  resourceVersion: "347089176"
  uid: 8d705a82-c814-4406-92a3-d74f37bb841c
spec:
  clusterRef:
    name: kafka
  secretName: myuser-cert
  topicGrants:
  - accessType: write
    topicName: my-topic
  - accessType: read
    topicName: my-topic
status:
  acls:
  - User:CN=myuser,Topic,LITERAL,my-topic,Describe,Allow,*
  - User:CN=myuser,Topic,LITERAL,my-topic,Create,Allow,*
  - User:CN=myuser,Topic,LITERAL,my-topic,Write,Allow,*
  - User:CN=myuser,Topic,LITERAL,my-topic,Read,Allow,*
  - User:CN=myuser,Group,LITERAL,*,Read,Allow,*
  state: created

Additional context v0.20.1