data-mesh

Create Data Mesh. Use interoperable digital twins to create data interactions and build powerful real-time data products. This repository is a library for Decentralised Identity (DID) management with Iotics for applications in Python v3.8+.

Open-source data contract enforcement — define, sync dbt, validate, block, report. Built on ODCS v3.1 + DuckDB.

AI-native NoSQL + vector database with built-in semantic search for RAG, AI agents & LLM memory — the async Python client. Self-hosted Pinecone alternative.

This solution provides the AWS CDK and AWS CloudFormation infrastructure to build an enterprise data mesh with Amazon DataZone.

LakeLogic Core — an open-source framework for executing OLC contracts across data platforms.

The Open Platform for building Data Platforms. Ship faster. Stay compliant. Scale to Data Mesh.

Per-cell auditable lakehouse for agent-driven data engineering, EU-AI-Act-native — a Databricks-style stack built from Python open-source parts.

Portfolio project showcasing how enterprise data products and AI models can be governed for safe AI-agent consumption. I designed the governance logic, data model and product framework; built with Python, Streamlit and AI-assisted development.

This is a repo designed to show the workflow of a data contract, with pre-commit hooks and GitHub Actions on how to have the contract power a data platform

This is enterprise-level infrastructure code that would typically be developed by platform teams in companies like Google, Amazon, or Netflix. Each component solves complex distributed systems problems that junior/mid developers would struggle with without significant guidance.

PVDM: proof-gated publication. Verify-before-commit content integrity for serverless data-mesh lakehouses (reference gate + validation suite).

Enterprise retail Data Mesh on Snowflake: domain data products (dbt medallion), governance-as-code (Terraform, tags, masking, row-access), Snowflake Cortex AI, and a Streamlit BI + AI Copilot.

Open-source Data Contract Lifecycle & Metadata Governance Toolkit for ODCS, GitOps, Unity Catalog, Great Expectations, and lineage.

Serverless Data Mesh: proof-gated lakehouse writes on AWS Lambda (PVDM / Vaquar Pattern). PyPI + Docker. Apache-2.0 reference implementation.

Runnable reference implementation of the descriptor-driven pipeline executor from the cordata.tech pipeline-half posts — DuckDB and Parquet standing in for Glue and Spark, so a clean clone runs with no cloud account.

The starting point for deploying and using Dataphos components. It contains Pulumi deployment scripts and Helm charts that enable you to quickly launch Dataphos components in your cloud environment with minimal configuration.

Data contracts and data quality on Databricks. Bootstrap a governed data mesh/domain-driven lakehouse across six domains with Bronze/Silver/Gold pipelines, row quarantine, freshness and volume SLOs, lineage, SCD Type 2, and dependency-aware execution. Built with LakeLogic.

Open framework and standards for onboarding, cataloging, governing, and AI-enabling enterprise data

Modern decentralized data architecture patterns in Python — data mesh, lakehouse, and event-driven pipelines.

Intelligent data mesh for AI agents. Declarative use-case registry, self-improving Gold layer, MCP-native.