Skip to content

fix(s3): implement pagination and fix prefix filtering in listObjects#729

Open
DemoMacro wants to merge 1 commit intounjs:mainfrom
DemoMacro:main
Open

fix(s3): implement pagination and fix prefix filtering in listObjects#729
DemoMacro wants to merge 1 commit intounjs:mainfrom
DemoMacro:main

Conversation

@DemoMacro
Copy link

Summary

Fix S3 driver to return correct results from getKeys():

  • Prefix parameter was ignored (returns all objects instead of filtered)
  • Only first 1000 objects returned when bucket has more (data loss)

Changes

  • Implement S3 ListObjectsV2 pagination to handle buckets with 1000+ objects
  • Fix prefix parameter to actually filter results

Testing

Verified with buckets containing 1000+ objects: keys now returned with correct prefix filtering.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant