문서 보기역링크PDF로 내보내기맨 위로 이 문서는 읽기 전용입니다. 원본을 볼 수는 있지만 바꿀 수는 없습니다. 문제가 있다고 생각하면 관리자에게 문의하세요. # Basic Airflow architecture Primarily intended for development use, the basic [[Airflow]] architecture with the Local and Sequential executors in an excellent starting point for understanding the architecture of Apache Airflow {{ https://airflow.apache.org/docs/apache-airflow/stable/_images/arch-diag-basic.png }} There are a few components to note: - [[Metadata Database]]: Airflow uses a [[SQL]] database to store metadata about the data pipelines being ru. In the diagram above, this is represented as [[Postgres]] which is extremely popular with Airflow. Alternate database supported with Airflow include [[MySQL]]. - [[Web Server]] and [[Scheduler]]: The Airflow web server and Scheduler are separate processes run (in this case) on the local machine and interact with the database mentioned above. - The [[Executor]] is shown separately above, since it is commonly discussed within Airflow and in the documentation, but in reality it is NOT a separate process, but run within the Scheduler. - The [[Worker(s)]] are separate processes which also interact with the other components of the Airflow architecture and the metadata repository. - [[airflow.cfg]] is the Airflow configuration file which is accessed by the Web Server, Scheduler, and Workers. - [[DAGs]] refers to the [[DAG]] files containing [[Python]] code, representing the data pipelines to be run by [[Airflow]]. The location of these files is specified in the Airflow configuration file, but they need to be accessible by the Web Server, Scheduler, and Workers. ## Ref - https://airflow.apache.org/docs/apache-airflow/stable/start.html open/basic-airflow-architecture.txt 마지막으로 수정됨: 2021/01/28 02:06저자 127.0.0.1