Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Qbeast Spark Refactor: Abstract the Qbeast Snapshot Module #417

Closed
JosepSampe opened this issue Sep 16, 2024 · 0 comments
Closed

Qbeast Spark Refactor: Abstract the Qbeast Snapshot Module #417

JosepSampe opened this issue Sep 16, 2024 · 0 comments
Assignees
@JosepSampe
Labels
enhancement

Comments

@JosepSampe
Copy link
Member

The current Qbeast snapshot implementation is tightly coupled with Delta. Refactor the Qbeast snapshot to allow creation using a tableID. Ensure all methods are generic, and design the abstraction to be flexible enough to support other table formats.
@JosepSampe JosepSampe self-assigned this Sep 16, 2024
osopardo1 pushed a commit that referenced this issue Sep 16, 2024
@JosepSampe
Issue #417: Abstract the Qbeast Snapshot Module (#411)
746a307 
* Abstract the QbeastSnapshot from Delta Snapshot
osopardo1 pushed a commit that referenced this issue Oct 28, 2024
@JosepSampe
Issue #398: Qbeast Spark Refactor -- Delta abstraction (#446)
de19c2e 
* Issue #417: Abstract the Qbeast Snapshot Module (#411)

* Issue #418: Abstract PreCommitHook and StagingDataManager (#421)

* Issue #418: Abstract RollupDataWriter and QbeastStats  (#423)

* Issue #419: Code Reorganization (#425)

* Issue #420: Create Separate Modules (#427)

* Issue #398: Fix small overhead added during the refactoring (#436)

* Issue #441: Fix data change on optimize (#442)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@JosepSampe JosepSampe

Labels
enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@JosepSampe