-
Notifications
You must be signed in to change notification settings - Fork 0
Kafka errors
The library handles Kafka connectivity and network errors when consuming messages or committing offsets. The latter may result in duplicate message processing.
It is possible to get an error when consuming messages from Kafka (i.e. during message accumulation). This doesn't affect message processing because at this stage your controller is not invoked yet.
In most cases, these errors are retried by the Confluent Kafka client and the message accumulation continues. In other cases, the consumer restarts and accumulates messages again. Anyways it doesn't affect you.
It is possible to get an error when committing offsets to Kafka. This happens after message processing, so it might affect you.
In most cases, these errors are retried by the Confluent Kafka client and the offsets are still committed.
In other cases, the library has to reconnect to Kafka. The SAME messages will be consumed again and sent to your controller which will result in duplicate message processing. Read more in the Duplicate message processing article.