Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Subtask] [spark-connector] query simple hive data from spark-connector #1529

Closed
Tracked by #1227
FANNG1 opened this issue Jan 16, 2024 · 0 comments · Fixed by #2133
Closed
Tracked by #1227

[Subtask] [spark-connector] query simple hive data from spark-connector #1529

FANNG1 opened this issue Jan 16, 2024 · 0 comments · Fixed by #2133
Assignees
@FANNG1
Milestone
Gravitino 0.5.0

Comments

@FANNG1
Copy link
Contributor

FANNG1 commented Jan 16, 2024

Describe the subtask

query simple hive data from spark-connector

Parent issue

#1227
@FANNG1 FANNG1 self-assigned this Jan 16, 2024
This was referenced Jan 17, 2024
Open
Closed
@FANNG1 FANNG1 changed the title [Subtask] query simple hive data from spark-connector [Subtask] [spark-connector] query simple hive data from spark-connector Jan 17, 2024
@FANNG1 FANNG1 added this to the Gravitino 0.4.0 milestone Jan 19, 2024
@jerryshao jerryshao removed this from the Gravitino 0.4.0 milestone Jan 26, 2024
@jerryshao jerryshao added this to the Gravitino 0.5.0 milestone Feb 4, 2024
@FANNG1 FANNG1 mentioned this issue Mar 1, 2024
Merged
jerryshao pushed a commit that referenced this issue Mar 6, 2024
@FANNG1
[#1529] feat(spark-connector): support table operation (#2133)
bb8946f 
### What changes were proposed in this pull request?
1. support basic table DDL and DML operation. (alter table are not
supported)
2. add basic table operation to GravitinoCatalog
3. add GravitinoBaseTable class which get schema from Gravitino and do
IO with internal spark catalog table.

### Why are the changes needed?

Fix: #1529 

### Does this PR introduce _any_ user-facing change?
no

### How was this patch tested?
add spark SQL IT
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@FANNG1 FANNG1

Labels
None yet
Projects
None yet
Milestone
Gravitino 0.5.0
Development

Successfully merging a pull request may close this issue.

[#1529] feat(spark-connector): support table operation FANNG1/gravitino
2 participants
@jerryshao @FANNG1