Non-Blocking Retry based on BackOff

[sups149]

Is it possible to implement different BackOff based on the type of exception with retry topic?
Ex: ExceptionA: BackOff (1sec, 2 retry), ExceptionB: BackOff(2sec, 4 retry)

• With @RetryableTopic or RetryTopicConfiguration I am able to configure BackOff which is applied for all the exceptions for a particular topic.

[sobychacko]

You could try creating a custom DeadLetterPublishingRecoverer. For example, as below.

@Bean
public DeadLetterPublishingRecoverer recoverer(KafkaTemplate<String, Object> template) {
	return new DeadLetterPublishingRecoverer(template,
			(record, ex) -> {
				if (ex.getCause() instanceof ExceptionA) {
					return new org.apache.kafka.common.TopicPartition("topic-exceptionA-retry", 0);
				}
				else if (ex.getCause() instanceof ExceptionB) {
					return new org.apache.kafka.common.TopicPartition("topic-exceptionB-retry", 1);
				}
				// Default DLT
				return new org.apache.kafka.common.TopicPartition("error-topic", 1);
			});
}

Then you define two separate RetryTopicConfiguration beans. Here is an idea.

@Bean
public RetryTopicConfiguration retryConfigForExceptionA(KafkaTemplate<String, Object> template) {
	return RetryTopicConfigurationBuilder
			.newInstance()
			.fixedBackOff(1000)
			.maxAttempts(2)
			.includeTopic("topic-exceptionA-retry")
			.create(template);
}

@Bean
public RetryTopicConfiguration retryConfigForExceptionABKafkaTemplate<String, Object> template) {
	return RetryTopicConfigurationBuilder
			.newInstance()
			.fixedBackOff(2000)
			.maxAttempts(4)
			.includeTopic("topic-exceptionB-retry")
			.create(template);
}

See if that works for your scenario.