FlowHub
Apache Airflow logo

Apache Airflow

Featured

Apache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows. It allows you to define workflows as code, making them more maintainable, versionable, testable, and collaborative.

PythonOpen SourceData PipelineETLSchedulingApache
Visit websiteGitHubDocs
Stars
47,139
Forks
17,989
Contributors
4,703
Latest
3.1.0

About Apache Airflow

Apache Airflow is used to programmatically author, schedule and monitor workflows. Airflow has a rich user interface which makes it easy to visualize pipelines running in production, monitor progress, and troubleshoot issues when needed. When workflows are defined as code, they become more maintainable, versionable, testable, and collaborative.

Key Features

Dynamic pipeline generation
Extensible through plugins
Elegant web UI
Scalable execution
Rich scheduling capabilities
Monitoring and alerting

Pros

Mature and stable platform
Large community and ecosystem
Extensive plugin library
Rich web interface
Python-based configuration
Strong monitoring capabilities

Cons

Steep learning curve
Resource intensive
Complex setup for beginners
Limited real-time processing

Tool Information

Language
Python
License
Apache 2.0
First release
2015-06-17
Latest version
3.1.0
Maintainer
Apache Software Foundation

Used By

AirbnbLyftTwitterAdobePayPalSlack

Compare Apache Airflow with other tools

See how Apache Airflow stacks up against other workflow orchestration engines, feature by feature.