Repository navigation
Use the Avro readers from Iceberg-Rust in PyIceberg #1280
Description
Is your feature request related to a problem or challenge?
In PyIceberg, we had challenges with the performance of the Avro readers in the past, therefore, we cythonized quite a bit of the code. Instead, I'm working on using Iceberg-rust instead.
I have a working version for reading the manifests, which is relatively straightforward. For the manifest-list, we dynamically need to load the partition transform, so that will be a bit more challenging, but it is going pretty smooth.
I'll create a draft PR as soon as I get something in a reasonable working state, so I can get feedback from the Rust community. Looking forward seeing my Rust code being butchered 😃
Describe the solution you'd like
No response
Willingness to contribute
None
Activity
github-actions commentedon Oct 29, 2025
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
github-actions commentedon Nov 13, 2025
This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'