📝 Notes taken by Abd @ITNA Digital

Links

🔗 Link to the Video

🔗 Official Notes from Sejal

🔗 Github Repo

🔗 Lighter Docker-Airflow Alternative || https://github.com/puckel/docker-airflow

Keywords

Table of Contents

Airflow Components

• Webserver
  • Inspect, Trigger, Debug of DAGs and Tasks
• Scheduler
  • Schedules jobs
• Worker
  • Executes tasks that was scheduled
• Metadata Database
  • Used by scheduler, Webserver and Workers
  • Stores state of the environment
• Message Broker
  • Forwards messages from Scheduler to Worker
• Flower App
  • Monitors environment available on localhost:5555
• Airflow Init
  • Initialization service for Airflow configuration (backend, user cred, env vars)