Other question (I'm on fire today): Does airflow automatically stagger DAG runs? Because I'm realising that all of my DAGs are triggering at the same time, meaning that meltano responds with "already a pipeline in motion -> fail" Just want to validate that my pipeline will run over the weekend 🤣

I don't think Airflow will throttle or force any staggering by default - although that very possibly could implemented by customizing the

meltano.py

dag generator in your project folder.

What would be the "classic" way of circumventing this issue?

Can you say a bit more about the failure you are seeing? Multiple concurrent executions should be okay as long as they are not touching the same state IDs - meaning as long as you aren't running extract-load pairs with the same tap and target name at the same time in the same environment.

Yeah I think I set myself on the wrong trail by rerunning dags in local; this seems to be an unrelated issue. Back to trying to find my logs in production I guess