Opinion Analysis of News, Threaded Conversations, and User Generated Content

Mercari Dataflow Template

Cloud-native Telco BSS hosted in GCP K8s with standalone Diameter to gRPC gateway. Rule Engine using Neo4j graphs. Analytics Events sent to GCP BigData (Dataflow+BigQuery) via PubSub. It's awesome!

Cloud Dataflow Tutorial for Beginners

Public source code for the Batch Processing with Apache Beam (Python) online course

I got Google Cloud Certified. I have what it takes to leverage Google Cloud technology. Here my certification: https://www.credential.net/ee1bd2d6-fdb0-4037-8a8d-9afae3d79c86.

Asgarde allows simplifying error handling with Apache Beam Java, with less code, more concise and expressive code.

Project showing a CI CD pipeline for Dataflow Java with Flex Template and Cloud Build

build streaming apps on spring cloud dataflow platform

ETL OnPremises Data to Google BigQuery using Google Cloud Data Flow via JDBC driver

Working example of a real-time inference pipeline on GCP Cloud Dataflow

Midgard is a wrapper on Beam Kotlin, allowing more concise and expressive code. It removes Beam boilerplate code and proposes more Functional Programming style

Samples related to data engineering, e.g. spark, embulk, airflow, etc.

Cloud Dataflow pipeline that reads the file from Cloud Storage and processes and outputs in the memory store.

Asgarde allows simplifying error handling with Apache Beam Python, with less code, more concise and expressive code.

Creating Cloud Dataflow template using Java for counting a number of words from a document.

Efficient Python data pipeline leveraging Apache Beam and Google Cloud Dataflow to update a Bucket with data concerning daily prices of instruments extracted from BMF website, serving as input for other data pipelines. The code generates a dataflow template, which is then scheduled to run periodically using Cloud Scheduler + Cloud Functions.

Experiment in using windowing and trigger for more accurate streaming analytics with Apache Beam