Skip to content

Conversation

@vincbeck
Copy link
Contributor

Fix example_emr_serverless system test. EMR does not allow cross region calls. The region was hardcoded for a S3 file to us-east-1. Any execution of this system test outside of us-east-1 results in a failure.

return_code = int(e.response['Error']['Code'])
if return_code == 404:
self.log.error('Bucket "%s" does not exist', bucket_name)
self.log.info('Bucket "%s" does not exist', bucket_name)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why do we change log level only for 404?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well. If it's 403 the bucket exists but the user does not have permissions so I think it makes sense to log an error for that use case

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

On the other side, 404 is a very valid use case. If the bucket exists (and user has permissions), we should not log an error for that

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@eladkal WDYT?

@eladkal eladkal merged commit 1bbd8fe into apache:main Oct 28, 2022
@vincbeck vincbeck deleted the vincbeck/system-tests/emr_serverless branch November 17, 2022 20:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants