Skip to content

Conversation

guicamest
Copy link
Contributor

Description of changes:

This PR brings changes to S3FileSystemProvider:

  • extract methods to improve readability
  • remove nested try / try statements
  • reuse transfermanager to copy files
  • extract new S3DirectoryStream
  • a couple of changes with the Flowable transformation
  • small rewrite of unit tests
  • integration test for should throw NoSuchFileException when bucket not found

Coverage:
image

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

…in `pathIteratorForPublisher`, avoid intermediate collect.toList
…plyAsync` for a fixed value in `newDirectoryStream`
…Pagination` to `newDirectoryStreamFiltersSelf`
public void close() {}

/**
* Get an iterator for a {@code ListObjectsV2Publisher}. This method is protected level access only for testing
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can change the java doc to remove the comment about protected level access for testing.

Copy link
Contributor

@markjschreiber markjschreiber left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice. One minor fixup for the comments on a now private method.

@markjschreiber markjschreiber merged commit c443d4b into awslabs:main Nov 14, 2023
@guicamest guicamest deleted the fileSystemProvider branch November 14, 2023 07:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants