100+ SQL Scripts - PostgreSQL, MySQL, Oracle, Google BigQuery, MariaDB, AWS Athena. DBA, Analytics, DevOps, performance engineering. Google BigQuery ML machine learning classification.

Data quality analytics for FHIR exported to BigQuery.

Export Google Datastore to BigQuery

Stream your CSV files to an HTTP API

An example Dataform project to load and transform the publicly available dataset from IMDB.

Business model representation automation

GCP_Data_Enginner

GitHub Action for writing data into BigQuery from within a Github workflow

Sample codes of loading data from BigQuery to RDBMS using bash, Embulk and GCS

An example Dataform project which will use the publicly available Movielens dataset to demonstrate how to upload your product catalog and user events into either the Google Cloud Retail API or Google Cloud Discovery Engine and train a personalised product recommendation model.

An example Dataform project to load and transform the publicly available dataset from H&M Group into a format which could be imported into Discovery AI for Retail or Vertex AI Search and Conversation, , allowing you to train a retail recommendations model.

A Data Engineering ELT pipeline to extract, analyse and automate Greenhouse gas emission Analytics

DBT execution from Cloud Composer. BigQuery is used for main DWH and Compute Engine is built for dbt execution.

BigQuery automatic model rebuild based on r2 score deviation

Load public IMDB datasets to Google BigQuery

Big data pipeline using stock market data from Alpha Vantage, Spark, GCS, Cloud Composer (Airflow), BigQuery and Power BI

Copy table from one dataset to another in google big query using bash script

The Data Pipeline using Google Cloud Dataproc, Cloud Storage and BigQuery

☁️ Deploy stateless Node.js applications as serverless containers on Cloud Run for efficient, scalable, and cost-effective cloud computing.

A Bash script for exporting all tables from a BigQuery dataset to local storage