[Bug] Inline DataPolicy exceeding 10240 bytes limit #1845
Description
Describe the bug
When any dataset is onboarded, an owner team and a steward teams is associated with it. These teams have an associated IAM role. In order to give access to the underlying items ( S3bucket, Glue, etc ) the data policy is generated.
Currently the data policy is an inline policy which has 10240 bytes limit per role. i.e. the sum of all the inline policies should not exceed 10240 bytes.
We have a lot of datasets onboarded and with a single team as the owner. This is causing the inline policy to go out of bounds and due to which out environment stack is not righfully getting updates.
This is causing issues with shares created with the newly onboarded datasets
How to Reproduce
Import about 100 buckets and check the environment stack
Expected behavior
No response
Your project
No response
Screenshots
No response
OS
Mac
Python version
3.9
AWS data.all version
2.7.0
Additional context
No response