
📊 Data Engineering & Analytics
Warehouses, CDC and ETL pipelines, streaming analytics, data quality and governance. Open any template to see the finished diagram, then use it as the starting point for your own in the Studio.
11 templates
A typical modern data stack: data is loaded from apps and SaaS tools into a cloud warehouse, modelled with dbt, orchestrated with Airflow and served to BI dashboards.
How every insert, update and delete in an operational database is streamed to the data lake and search index in near real time using change data capture.
A classic star schema for sales analytics: one fact table of order lines surrounded by date, customer, product, store and promotion dimensions.
The steps of a nightly batch pipeline with data quality gates: extract, validate, transform, load and publish, stopping safely when checks fail.
Where a real-time analytics stack runs: Kafka for events, Flink for stream processing, a real-time OLAP database and live dashboards.
The states of a single pipeline run in an orchestrator like Airflow, including retries, upstream failures and manual reruns.
The medallion pattern for a data lake: raw data lands in bronze, is cleaned in silver, and turned into business-ready tables in gold.
How a pipeline checks data quality before publishing: expectations run against the new data, results are stored, and bad data is quarantined.
Where a company's daily data comes from and where it ends up, measured in gigabytes, to plan storage and processing costs.
The main parts of a data governance programme, from ownership and quality to privacy and access, for teams setting up one.
A 5-month plan to move reporting from an on-premise warehouse to a cloud warehouse, running both in parallel before switching off the old one.
More Data Engineering & Analytics templates are being added regularly.