Amazon Managed Workflows for Apache Airflow Secure and highly available managed workflow orchestration for Apache Airflow
Amazon Managed Workflows for Apache Airflow (Amazon MWAA) orchestrates your workflows using Directed Acyclic Graphs ( DAGs) written in Python. You provide MWAA an Amazon Simple Storage Service (S3) bucket where your DAGs, plugins, and Python requirements reside. Then run and monitor your DAGs from the AWS Management Console, a command line interface ( CLI), a software development kit (SDK), or the Apache Airflow user interface (UI).
Support complex workflows: Create scheduled or on-demand workflows that prepare and process complicated data from big data providers.
Coordinate extract, transform, and load (ETL) jobs: Orchestrate multiple ETL processes that use diverse technologies within a complex ETL workflow.
Prepare ML data: Automate your pipeline to help machine learning (ML) modeling systems ingest and then train on data.