Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Qbeast Spark Refactor: Create Separate Modules #420

Closed
JosepSampe opened this issue Sep 16, 2024 · 0 comments
Closed

Qbeast Spark Refactor: Create Separate Modules #420

JosepSampe opened this issue Sep 16, 2024 · 0 comments
Assignees
@JosepSampe
Labels
enhancement

Comments

@JosepSampe
Copy link
Member

Split the current project structure into distinct modules. Focus on extracting Delta Lake-specific code into a separate module, enabling the creation of additional modules, such as Hudi. Create any other necessary modules to improve organization and flexibility.
@JosepSampe JosepSampe self-assigned this Sep 16, 2024
osopardo1 pushed a commit that referenced this issue Oct 1, 2024
@JosepSampe
Issue #420: Create Separate Modules (#427)
c4e2859 
* Separate modules between src, core and delta
osopardo1 pushed a commit that referenced this issue Oct 28, 2024
@JosepSampe
Issue #398: Qbeast Spark Refactor -- Delta abstraction (#446)
de19c2e 
* Issue #417: Abstract the Qbeast Snapshot Module (#411)

* Issue #418: Abstract PreCommitHook and StagingDataManager (#421)

* Issue #418: Abstract RollupDataWriter and QbeastStats  (#423)

* Issue #419: Code Reorganization (#425)

* Issue #420: Create Separate Modules (#427)

* Issue #398: Fix small overhead added during the refactoring (#436)

* Issue #441: Fix data change on optimize (#442)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@JosepSampe JosepSampe

Labels
enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@JosepSampe