Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Subtask] Add Fileset support for fileset catalog #1527

Closed
Tracked by #1241
jerryshao opened this issue Jan 16, 2024 · 4 comments · Fixed by #1647
Closed
Tracked by #1241

[Subtask] Add Fileset support for fileset catalog #1527

jerryshao opened this issue Jan 16, 2024 · 4 comments · Fixed by #1647
Assignees
@jerryshao
Milestone
Gravitino 0.4.0

Comments

@jerryshao
Copy link
Contributor

Describe the subtask

This issue tracks the work of implementing FilesetCatalog.

Parent issue

#1241
@jerryshao jerryshao added this to the Gravitino 0.4.0 milestone Jan 16, 2024
@jerryshao jerryshao self-assigned this Jan 16, 2024
@jerryshao jerryshao mentioned this issue Jan 16, 2024
Closed
18 tasks
@coolderli
Copy link
Collaborator

#1526 had been merged. I want to try contributing to this issue, could you assign it to me?

@jerryshao
Copy link
Contributor Author

Hi @coolderli sorry I'm already working on this to meet 0.4.0 milestone.

We still have several undone issues in #1241 that I haven't created an issue, I think you can work on that if you'd like to, like:

  1. Add server-side REST API support for fileset
  2. Add Java client support for fileset
  3. Add E2E integration test for fileset
  4. Add Python Arrow FileSystem implementation for fileset.

@coolderli
Copy link
Collaborator

@jerryshao Apology for my abruptness. I'd like to take a look at these issues. By the way, when will 0.4.0 be released? I found there are still a lot of issues on the 0.4.0 milestone.

@jerryshao jerryshao mentioned this issue Jan 23, 2024
Merged
@jerryshao
Copy link
Contributor Author

Hi @coolderli the 0.4.0 version will be shipped out before Spring festival, but we can only merge parts of the functionality of this fileset catalog support, others will be shipped in 0.5.0.

jerryshao added a commit that referenced this issue Jan 25, 2024
@jerryshao
[#1527] feat(hadoop-catalog): Add fileset support for hadoop catalog (#…
5888328 
…1647)

### What changes were proposed in this pull request?

This PR proposes to add the fileset operation support for hadoop
catalog.

### Why are the changes needed?

This is a part of work to support fileset management in Gravitino

Fix: #1527 

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Add UTs to cover the codes.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jerryshao jerryshao

Labels
None yet
Projects
None yet
Milestone
Gravitino 0.4.0
Development

Successfully merging a pull request may close this issue.

[#1527] feat(hadoop-catalog): Add fileset support for hadoop catalog jerryshao/gravitino
2 participants
@jerryshao @coolderli