Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TBLPROPERTIES on new table are saved partially #368

Closed
osopardo1 opened this issue Jul 26, 2024 · 0 comments · Fixed by #369
Closed

TBLPROPERTIES on new table are saved partially #368

osopardo1 opened this issue Jul 26, 2024 · 0 comments · Fixed by #369
Assignees
@osopardo1
Labels
type: bug Something isn't working

Comments

@osopardo1
Copy link
Member

When executing:

spark.sql("CREATE TABLE t(id INT) USING qbeast TBLPROPERTIES('columnsToIndex'='id', 'k'='v')

Only the properties related to qbeast algorithm are saved.

We should make sure that all properties are contained in the Delta Log and Spark Catalog when the table is empty.
@osopardo1 osopardo1 added the type: bug Something isn't working label Jul 26, 2024
@osopardo1 osopardo1 mentioned this issue Jul 29, 2024
Merged
6 tasks
@osopardo1 osopardo1 self-assigned this Jul 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@osopardo1 osopardo1

Labels
type: bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Issue 368: Partially saved TBLPROPERTIES osopardo1/qbeast-spark
1 participant
@osopardo1