Data Engineering

Notes and tutorials on data engineering — anchored by an 8-part Apache Airflow series covering DAGs, scheduling, templating, task dependencies, and best practices.

Data Modeling with Postgres
Data Engineering
Build a Relational Database using Star Schema of song’s users activities data.

Airflow Part 1 - What is Airflow?
Data Engineering
Airflow
Other than my experience and the documentation, the main resource behind this post and figures is the fantastic book: Data Pipelines with Apache. Airflow.

Airflow Part 2 - DAGs
Data Engineering
Airflow
Other than my experience and the documentation, the main resource behind this post and figures is the fantastic book: Data Pipelines with Apache. Airflow.

Airflow Part 3 - DAG Scheduling
Data Engineering
Airflow
Other than my experience and the documentation, the main resource behind this post and figures is the fantastic book: Data Pipelines with Apache. Airflow.

Airflow Part 4 - Task Context & Jinja Templating
Data Engineering
Airflow
Other than my experience and the documentation, the main resource behind this post and figures is the fantastic book: Data Pipelines with Apache. Airflow.

Airflow Part 5 - Dependencies Between Tasks
Data Engineering
Airflow
Other than my experience and the documentation, the main resource behind this post and figures is the fantastic book: Data Pipelines with Apache. Airflow.

Airflow Part 6 - Sharing Data Between Tasks
Data Engineering
Airflow
Other than my experience and the documentation, the main resource behind this post and figures is the fantastic book: Data Pipelines with Apache. Airflow.

Airflow Part 7 - Triggering Workflows
Data Engineering
Airflow
Other than my experience and the documentation, the main resource behind this post and figures is the fantastic book: Data Pipelines with Apache. Airflow.

Airflow Part 8 - Best Practices
Data Engineering
Airflow
Other than my experience and the documentation, the main resource behind this post and figures is the fantastic book: Data Pipelines with Apache. Airflow.
No matching items
Back to top