Airflow2 to Airflow3 Upgrade

Use Case

Migrating from Airflow 2 to Airflow 3

Topics:

Comparing Airflow 2 and Airflow 3 with Docker Compose
Required Configuration Updates for Airflow 3
Advantages of Upgrading to Airflow 3

Code explanation video

Architecture Diagram

Airflow 2

src: https://airflow.apache.org/docs/apache-airflow/2.6.0/core-concepts/overview.html

Airflow 3

src: https://www.astronomer.io/docs/learn/airflow-components/

Source Code

References

Data With Marc.
Airflow 3 - How to Run in Docker