Mage

Mage (mage-ai) is a modern alternative to Airflow for data engineering. Pipelines are composed of blocks (data loaders, transformers, data exporters, sensors) written in Python, SQL or R and edited in an interactive, notebook-like UI that previews data as you build. Mage supports batch pipelines, streaming pipelines, data integrations based on Singer taps and targets, dbt models, triggers on schedules, events or API calls, and runs locally with Docker or on Kubernetes and cloud services.