High-throughput, manifest-driven data pipeline engine built with Go and Apache Beam. Features Splittable DoFn (SDF) streaming, JIT columnar Parquet sinks, multi-cloud storage, Vault/GCP secrets, OpenTelemetry, and zero-drop DLQ for Google Cloud Dataflow.
golang clean-code clean-architecture dataflow apache-beam hexagonal-architecture cloud-dataflow splittable-dofn
-
Updated
Sep 30, 2026 - Go