I was wondering if there is a way to use Meltano also to spin up airflow workers (when in need to reran pipelines for a time period for example)

You can have any DAGs you want in the /orchestrate/dags folder for Airflow. Or you can define a schedule in the meltano.yml too

@edith_chorev Are you trying to trigger a specific Airflow DAG for a Meltano ELT pipeline with the CLI? You can interact directly with

airflow

and all of its subcommands using

meltano invoke airflow <args>

, so

meltano invoke airflow trigger_dag <dag_id>

should work

Yes I want to trigger a specific DAG but for multiple instances (execution dates) so I would like it to use multiple workers.

@edith_chorev Makes sense. Did

meltano invoke airflow trigger_dag

work?