Metadata driven Spark Declarative Pipelines framework for bronze/silver pipelines
-
Updated
Mar 27, 2026 - Python
Metadata driven Spark Declarative Pipelines framework for bronze/silver pipelines
The Metadata Driven framework for Databricks Lakeflow Declarative Pipelines (formerly Delta Live Tables). Metadata framework that generates production ready Pyspark code for Lakeflow Declarative Pipelines
Medallion Architecture for Data Engineering projects
End-to-end Lakehouse data pipeline using Spark Declarative Pipelines with Bronze, Silver, and Gold layers.
A production-ready Clickstream Data Pipeline built with Databricks Lakeflow and Spark 4.1. This project demonstrates Declarative Data Engineering, featuring Auto Liquid Clustering, SCD Type 2 tracking, and automated CI/CD using Databricks Asset Bundles (DABs).
Add a description, image, and links to the lakeflow-declarative-pipelines topic page so that developers can more easily learn about it.
To associate your repository with the lakeflow-declarative-pipelines topic, visit your repo's landing page and select "manage topics."