Skip to content

AWS: feat Turning AAL default On #13527

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

stubz151
Copy link
Contributor

What Am I doing

We are turning on AAL to be the default stream for S3FileIo. You can read more about our optimizations in our readme

How Am I doing this

Have added some behaviour to conform with Iceberg stream specifics.
This builds on the various PR's mentioned below and will need them merged first before this is merged

Testing

  • Integration Tests
  • Unit Tests
  • TPCDS like benchmarking you can read more in our readme here

Documentation

Related PR's

Missing Feature List

@sullis
Copy link
Contributor

sullis commented Jul 11, 2025

fyi: I mentioned S3 Analytics Accelerator in my NYC Iceberg Meetup talk on July 10th

https://docs.google.com/presentation/d/1GgBWJwxP_rZLMt4Kixv697CCBO_7vm1VM9YENs2MwdA/edit

@stubz151
Copy link
Contributor Author

stubz151 commented Jul 14, 2025

fyi: I mentioned S3 Analytics Accelerator in my NYC Iceberg Meetup talk on July 10th

https://docs.google.com/presentation/d/1GgBWJwxP_rZLMt4Kixv697CCBO_7vm1VM9YENs2MwdA/edit

that is super interesting thanks for letting us know! Is there a recording?

@sullis
Copy link
Contributor

sullis commented Jul 15, 2025

fyi: I mentioned S3 Analytics Accelerator in my NYC Iceberg Meetup talk on July 10th
https://docs.google.com/presentation/d/1GgBWJwxP_rZLMt4Kixv697CCBO_7vm1VM9YENs2MwdA/edit

that is super interesting thanks for letting us know! Is there a recording?

Yes, there is a recording. Not sure if I can post the link here. I'll ping you on LinkedIn.

@sullis
Copy link
Contributor

sullis commented Jul 15, 2025

fyi: I mentioned S3 Analytics Accelerator in my NYC Iceberg Meetup talk on July 10th
https://docs.google.com/presentation/d/1GgBWJwxP_rZLMt4Kixv697CCBO_7vm1VM9YENs2MwdA/edit

NYC Iceberg meetup, July 10 2025

image

Copy link

This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@iceberg.apache.org list. Thank you for your contributions.

@github-actions github-actions bot added the stale label Aug 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants