sarama: why example consumergroup can not work correctly ? only one client can consume message, other client can not work
Versions
Please specify real version numbers or git SHAs, not just “Latest” since that changes fairly regularly.
Sarama | Kafka | Go |
---|---|---|
Configuration
What configuration values are you using for Sarama and Kafka?
Logs
When filing an issue please provide logs from Sarama and Kafka if at all
possible. You can set sarama.Logger
to a log.Logger
to capture Sarama debug
output.
logs: CLICK ME
Problem Description
About this issue
- Original URL
- State: closed
- Created 5 years ago
- Comments: 16 (7 by maintainers)
Same issue. @d1egoaz @meiyang1990
Ah I see. That makes sense. Thank for your feedback on this! Now you mention that it’s obvious 🤦♂️
The above is a symptom of not looping on
Consume()
.Consume()
will exit without error when a rebalancing occurs and it is up to the user to call it again when this occurs.Under the hood it seems like when a re-balance occurs all sessions are torn down completely (briefly no members exist and therefore no partitions are handled by anyone) and when you re-call
Consume()
a new session is brought up which should get its share of the partitions.