Hi, do you have an example of airflow DAG that cre...
# announcements
m
Hi, do you have an example of airflow DAG that create meltano elt?
d
@meir.shamay Here you go: https://gitlab.com/meltano/files-airflow/-/blob/master/bundle/orchestrate/dags/meltano.py If you've added the Airflow orchestrator to your project (
meltano add orchestrator airflow
) that file should automatically have been added to your project as well 🙂
The magic is in running
meltano schedule list --format=json
and then creating a
meltano elt {elt_args}
DAG for each pipeline schedule in the JSON output
That JSON output corresponds to the
schedules
array in your
meltano.yml
, with some additional bits for convenience, like
elt_args