Prefect

Prefect is a modern orchestration and observability platform for workflows written in Python. It lets you transform ordinary Python functions into robust, automated, monitored pipelines with features like retries, caching, scheduling, and dynamic branching, all while providing a dashboard and execution engine (either self-hosted or via Prefect Cloud). Prefect’s design emphasizes flexibility and resilience, letting engineers build workflows that react to external signals, recover from failures, and adapt over time.