Testing framework for Databricks notebooks
-
Updated
Apr 20, 2024 - Python
Testing framework for Databricks notebooks
Black for Databricks notebooks
Databricks. Incremental data processing, task orchestration, and production job monitoring.
Databricks DLT Apparel Pipeline Project: Learn medallion architecture, streaming, and data engineering with Delta Live Tables. Includes synthetic data, step-by-step guide, and certification prep.
Databricks Data Engineer Associate Certification Lab: End-to-end hands-on project covering Auto Loader, Medallion Architecture, SCD Type 2, Unity Catalog governance, and Databricks Jobs orchestration. Build a production-grade pipeline on Databricks Free Edition.
Databricks Add-on for Splunk
Repository of notebooks and related collateral used in the Databricks Demo Hub, showing how to use Databricks, Delta Lake, MLflow, and more.
Orchestrate your Databricks notebooks in Airflow and execute them as Databricks Workflows
Delta Lake Optimization Project: Hands‑on lab to explore partitioning, Z‑Ordering, compaction (manual & auto), Liquid Clustering, and VACUUM using a synthetic sales dataset in Databricks. Includes a step‑by‑step notebook to measure file scans, bytes read, and query performance for each optimization.
A solution for on-demand training and serving of Machine Learning models, using Azure Databricks and MLflow
nbmanips allows you easily manipulate ipynb files
Databricks Real-Time Fintech Monitoring Pipeline: Hands-on lab to build a streaming fraud detection system using Auto Loader, watermarked deduplication, stream-static joins, and windowed rules engines in Databricks. Covers dual-SLA architecture for real-time alerts and batch compliance reporting.
Introducing Delta-Buddy: Your ultimate Delta Lake companion! 🚀 Streamline your data journey with an AI-powered chatbot. Ask Delta-Buddy anything about your Delta Lake.
Pacote de aceleradores para os primeiros passos no Databricks.
Databricks PySpark Certification Prep Lab: Build an e-commerce analytics pipeline covering Spark DataFrame API, Structured Streaming, data skew handling with salting, broadcast joins, and Pandas UDFs. Designed for the Databricks Certified Associate Developer for Apache Spark exam.
Databricks notebook that integrates data from Microsoft Dataverse to Databricks Delta table, including the schema inference
Genie Spaces API on Microsoft Teams
databricks-dab-lab is an end-to-end lab that shows how to deploy Databricks Asset Bundles (DABs) with GitHub Actions, using Terraform to provision an Azure Databricks workspace + cluster, then deploying and running three jobs in sequence (data setup → ETL → ML training).
Feature Engineering, Spark ML Random Forest Model, Log MLFlow, Streaming Data Source
Example of what you can do in Databricks in the Secure Data Environment (SDE) using Python, SQL, and R.
Add a description, image, and links to the databricks-notebooks topic page so that developers can more easily learn about it.
To associate your repository with the databricks-notebooks topic, visit your repo's landing page and select "manage topics."