Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Load private BigQuery tables using parquet outputs in nightly builds #3363

Open
6 tasks
zaneselvans opened this issue Feb 6, 2024 · 0 comments
Open
6 tasks

Load private BigQuery tables using parquet outputs in nightly builds #3363

zaneselvans opened this issue Feb 6, 2024 · 0 comments
Labels
bigquery Distributing or working with PUDL data using Google BigQuery cloud Stuff that has to do with adapting PUDL to work in cloud computing context. nightly-builds Anything having to do with nightly builds or continuous deployment. output Exporting data from PUDL into other platforms or interchange formats. parquet Issues related to the Apache Parquet file format which we use for long tables. release Tasks directly related to data and software releases.

Comments

@zaneselvans
Copy link
Member

zaneselvans commented Feb 6, 2024 •
edited
Loading

Once we're deploying parquet outputs internally via #3362 it's relatively easy to load those same outputs into a set of BigQuery tables for use in creating dashboards or other analytical applications.

Tasks
Beta Give feedback
@zaneselvans zaneselvans mentioned this issue Feb 6, 2024
Closed
@zaneselvans zaneselvans added output Exporting data from PUDL into other platforms or interchange formats. parquet Issues related to the Apache Parquet file format which we use for long tables. nightly-builds Anything having to do with nightly builds or continuous deployment. cloud Stuff that has to do with adapting PUDL to work in cloud computing context. release Tasks directly related to data and software releases. bigquery Distributing or working with PUDL data using Google BigQuery labels Feb 6, 2024
@zaneselvans zaneselvans moved this from New to Backlog in Catalyst Megaproject Feb 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bigquery Distributing or working with PUDL data using Google BigQuery cloud Stuff that has to do with adapting PUDL to work in cloud computing context. nightly-builds Anything having to do with nightly builds or continuous deployment. output Exporting data from PUDL into other platforms or interchange formats. parquet Issues related to the Apache Parquet file format which we use for long tables. release Tasks directly related to data and software releases.
Projects
Catalyst Megaproject
Status: Backlog
Milestone
No milestone
Development

No branches or pull requests
1 participant
@zaneselvans