Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Issue 264: Update qviz for multiblock files #437

Merged
merged 39 commits into from
Oct 18, 2024
Merged

Issue 264: Update qviz for multiblock files #437

merged 39 commits into from
Oct 18, 2024

Conversation

Jiaweihu08
Copy link
Member

Description

Fixes #264

Checklist:

  • A new feature/bug fix has been committed following the Contribution guide.
  • Add logging to the code following the Contribution guide.
  • Add comments to the code (make it easier for the community!).
  • Change the documentation.
  • Add tests.
  • Your branch is updated to the main branch (dependent changes have been merged).

jorgeMarin1 and others added 30 commits September 6, 2024 10:56
@jorgeMarin1
initial commit
42e11d6
@jorgeMarin1
Merge branch 'Qbeast-io:main' into qviz-bug
b0fda5d
@jorgeMarin1
initial commit
0fe8b08
@jorgeMarin1
added process table function using delta tables
5fb0956
@jorgeMarin1
create qviz using Delta tables
5f60426
@jorgeMarin1
added custom table
0ee8232
@jorgeMarin1
added custom table
30256f8
@jorgeMarin1
removed ecommerce300k_2019
cf9cfc3
@jorgeMarin1
fixed visualization
cbcbaed
@jorgeMarin1
deleted parquet files and added a new folder for table test
92cf732
@jorgeMarin1
added comments on the code
e9559f7
@jorgeMarin1
added comments to the code
ee95b87
@jorgeMarin1
Merge branch 'main' into qviz-bug
2f0aea8 
Merge main branch into qviz-bug branch, so it is up to date with the main repository.
@jorgeMarin1
deleted code and files that won't be used
a267f87
@jorgeMarin1
added unit test
032077c
@jorgeMarin1
addressed changes
398494d
@jorgeMarin1
addressed changes
353011f
@jorgeMarin1
snake case
13e95a7
@jorgeMarin1
edited example of json log file
31ac8e1
@jorgeMarin1
raised exception when failed to create delta table
8ecfdae
@jorgeMarin1
edited name of the method that extracted cubes from delta tables
6f824d4
@jorgeMarin1
made sure blocks_str is indeed a string
cb0f1a5
@jorgeMarin1
put definition of cube_string before if statement
5f06c45
@jorgeMarin1
added else statement for block_string
d565fff
@jorgeMarin1
deleted non-necessary comments
0178d1e
@jorgeMarin1
changed path to test table in README
a1d75a7
@jorgeMarin1
default value of sampling fraction is 0.02 and that value can be modi…
512dd67 
…fied by 0.01 in the dash server
@jorgeMarin1
deleted unnecessary files
22ff6b5
@jorgeMarin1
switched to version 3.2.0 of Delta Lake, which is compatible with 3.5…
1faa7c2 
….0 version of Apache Spark
@jorgeMarin1
update size of cubes using path of blocks
cda8c6d
@Jiaweihu08 Jiaweihu08 mentioned this pull request Oct 17, 2024
Closed
3 tasks
@Jiaweihu08 Jiaweihu08 requested a review from osopardo1 October 17, 2024 12:33
osopardo1
osopardo1 approved these changes Oct 18, 2024
View reviewed changes
Copy link
Member

@osopardo1 osopardo1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm 👍

@osopardo1 osopardo1 merged commit 1f3c4bb into Qbeast-io:main Oct 18, 2024
@Jiaweihu08 Jiaweihu08 deleted the 264-update-qviz-for-multiblock-files branch October 22, 2024 09:35
JosepSampe added a commit that referenced this pull request Oct 24, 2024
@JosepSampe @Jiaweihu08
@osopardo1 @jorgeMarin1
Issue #382: Update refactor branch with main changes (#445)
2129df6 
* Issue #424: Add sampling fraction option for optimization (#426)

* Add sampling fraction option for optimization and remove analyze from QbeastTable

* Issue #430: Simplify denormalized blocks creation (#431)

* Simplify Denormalized Blocks

* Issue #416: Add CDFQuantile Transformers and Transformations (#413)

* Issue 264: Update qviz for multiblock files (#437)

* Update Qbeast Visualiser (qviz) with multiblock files

---------

Co-authored-by: Jorge Marín <jorge.marin.rodenas@estudiantat.upc.edu>
Co-authored-by: Jorge Marín <100561030+jorgeMarin1@users.noreply.github.com>

* Issue #441: Fix dataChange flag in optimize (#444)

* Merge from main branch

---------

Co-authored-by: jiawei <47899566+Jiaweihu08@users.noreply.github.com>
Co-authored-by: Paola Pardo <paolapardoat@gmail.com>
Co-authored-by: Jorge Marín <jorge.marin.rodenas@estudiantat.upc.edu>
Co-authored-by: Jorge Marín <100561030+jorgeMarin1@users.noreply.github.com>
JosepSampe pushed a commit to JosepSampe/qbeast-spark that referenced this pull request Oct 24, 2024
@Jiaweihu08 @jorgeMarin1 @JosepSampe
Issue 264: Update qviz for multiblock files (Qbeast-io#437)
174c2b5 
* Update Qbeast Visualiser (qviz) with multiblock files

---------

Co-authored-by: Jorge Marín <jorge.marin.rodenas@estudiantat.upc.edu>
Co-authored-by: Jorge Marín <100561030+jorgeMarin1@users.noreply.github.com>
osopardo1 pushed a commit to osopardo1/qbeast-spark that referenced this pull request Nov 28, 2024
@Jiaweihu08 @jorgeMarin1 @osopardo1
Issue 264: Update qviz for multiblock files (Qbeast-io#437)
29edced 
* Update Qbeast Visualiser (qviz) with multiblock files

---------

Co-authored-by: Jorge Marín <jorge.marin.rodenas@estudiantat.upc.edu>
Co-authored-by: Jorge Marín <100561030+jorgeMarin1@users.noreply.github.com>
osopardo1 pushed a commit to osopardo1/qbeast-spark that referenced this pull request Nov 29, 2024
@Jiaweihu08 @jorgeMarin1 @osopardo1
Issue 264: Update qviz for multiblock files (Qbeast-io#437)
d4f7787 
* Update Qbeast Visualiser (qviz) with multiblock files

---------

Co-authored-by: Jorge Marín <jorge.marin.rodenas@estudiantat.upc.edu>
Co-authored-by: Jorge Marín <100561030+jorgeMarin1@users.noreply.github.com>
@osopardo1 osopardo1 mentioned this pull request Nov 29, 2024
Closed
osopardo1 pushed a commit to osopardo1/qbeast-spark that referenced this pull request Nov 29, 2024
@Jiaweihu08 @jorgeMarin1 @osopardo1
Issue 264: Update qviz for multiblock files (Qbeast-io#437)
0d52fb9 
* Update Qbeast Visualiser (qviz) with multiblock files

---------

Co-authored-by: Jorge Marín <jorge.marin.rodenas@estudiantat.upc.edu>
Co-authored-by: Jorge Marín <100561030+jorgeMarin1@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@osopardo1 osopardo1 osopardo1 approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Update qviz
3 participants
@Jiaweihu08 @osopardo1 @jorgeMarin1