Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for path-style access to s3 buckets #1558

Open
marcnc27 opened this issue Jun 2, 2021 · 1 comment
Open

Support for path-style access to s3 buckets #1558

marcnc27 opened this issue Jun 2, 2021 · 1 comment

Comments

@marcnc27
Copy link

marcnc27 commented Jun 2, 2021

Blazing supports AWS s3 and MinIO by overriding the endpoint. Thus, with non virtual host style bucket access it seems blazing context can not load a table from s3.

Possible solutions

  1. Support s3 client overriding (e.g. using s3fs as a filesystem params like in pandas)
  2. Support extra parameters to specify path-style access or virtual host style access
  3. Allow building blazing tables using a file descriptor's like object (emancipating from s3 adherence)

----For BlazingSQL Developers----
The feature could be implemented directly in table creation methods as a parameter or set of parameters

@marcnc27 marcnc27 added the ? - Needs Triage needs team to review and classify label Jun 2, 2021
@wmalpica
Copy link
Contributor

wmalpica commented Jun 4, 2021

We will be embarking on a filesystem plugin system refactoring project in the near future. We will keep in mind this issue when we do so. Thank you for bringing this issue to our attention

@wmalpica wmalpica removed the ? - Needs Triage needs team to review and classify label Jun 4, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants