https://meltano.com/ logo
#announcements
Title
# announcements
e

enough-gpu-64480

04/16/2021, 12:22 PM
I was wondering if there is a way to use Meltano also to spin up airflow workers (when in need to reran pipelines for a time period for example)
s

salmon-salesclerk-77709

04/16/2021, 1:36 PM
You can have any DAGs you want in the /orchestrate/dags folder for Airflow. Or you can define a schedule in the meltano.yml too
r

ripe-musician-59933

04/16/2021, 2:11 PM
@enough-gpu-64480 Are you trying to trigger a specific Airflow DAG for a Meltano ELT pipeline with the CLI? You can interact directly with
airflow
and all of its subcommands using
meltano invoke airflow <args>
, so
meltano invoke airflow trigger_dag <dag_id>
should work
e

enough-gpu-64480

04/17/2021, 2:28 PM
Yes I want to trigger a specific DAG but for multiple instances (execution dates) so I would like it to use multiple workers.
r

ripe-musician-59933

04/19/2021, 3:26 PM
@enough-gpu-64480 Makes sense. Did
meltano invoke airflow trigger_dag
work?