Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SQS Queue: maxRetries when error handling inside worker, or customize Message retention period #159

Open
politoedo opened this issue Jan 27, 2022 · 0 comments
Labels
enhancement New feature or request

Comments

@politoedo
Copy link

politoedo commented Jan 27, 2022

Start from the Use-case

I am using a FIFO SQS that triggers a Lambda function.
The lambda just copy and paste between buckets. The sequential order of message processing is vital.
Inside my lambda there are couple of exception handling that send back the message to the queue, enforce not processing subsequent messages having same group id, and send an error.

Since the error handling is performed inside worker (as it should be? honest question), the maxRetries policy does not apply. So I am stuck with a message that tries to get consumed every timeout*6 for 4 days, whereas a much simpler (((timeout*6)+1)*N) would be enough (in my use case). In general, it would be nice to have either (i) maxRetries being applied on error handling inside worker; or (ii) being free to set a Message retention period from our configuration.

Example Config

No response

Implementation Idea

Either implement maxRetries when error handling is done inside worker, or allow customization of Message retention period

@politoedo politoedo added the enhancement New feature or request label Jan 27, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant