i have two pipelines, one tap-mysql to pipelinewise-target-s3-csv, and another pipelinewise-tap-s3-csv to target-redshift. i have airflow running, but I would like to setup a dag that would scheduler the first pipeline listed above, then automatically trigger the 2nd pipeline after succesfully completing. Is there any easy way to set this up?

https://www.invivoo.com/en/creating-your-first-apache-airflow-dag/ I think 🙂 , I'm not an airflow user but my understanding is this is the basic principle of airflow!

@mike_planting You can write a single DAG with two

BashOperators

that both call

meltano elt

/`meltano schedule run` , one after the other

Thanks!