Description

The Confluent Kafka Go client was added to a service to consume messages. Occasionally on startup, after the consumer is created and starts consuming messages the service crashes and logs *** rdkafka_request.c:219:rd_kafka_buf_read_topic_partitions: assert: rkbuf->rkbuf_rkb ***. That’s the only statement logged even with the debug level set to all. After a few crashes it eventually starts running without issue.

Consumer configuration:

config := kafka.ConfigMap{      
    "go.application.rebalance.enable":    false,
    "bootstrap.servers":                           <broker list>,
    "group.id":                                          <consumer group>,
    "auto.offset.reset":                             "earliest",
    "partition.assignment.strategy":        "roundrobin",
    "debug":                                              "all",
   "ssl.certificate.location":                     <cert path>,
   "ssl.key.location":                                <key path>,
}

How to reproduce

Unable to reproduce as I’m not sure what’s causing the issue, and it only happens occasionally.

Checklist

Please provide the following information:

• confluent-kafka-go and librdkafka version (LibraryVersion()): 1.7.0 and the librdkafka version included with the module
• Apache Kafka broker version: 2.2.1
• Client configuration: ConfigMap{...} See above
• Operating system: Debian Buster
• Provide client logs (with "debug": ".." as necessary)
• Provide broker log excerpts
• Critical issue