Hey guys, not sure if it fits here. Is there any w...
# troubleshooting
n
Hey guys, not sure if it fits here. Is there any way/method to auto restart a pipeline if it failed? Sth. like "try it 2 more times then error out"? Wouldn't this be a great implementation? Thanks 🙂 Greetings Nick
d
Airflow is in charge of handling the schedule, so I’d see if there’s a way to get Airflow to automatically retry DAGs!
n
Thanks , gonna try it 🙂
@douwe_maan First of all t hanks for your answer. I just took a look at https://meltano.com/docs/orchestration.html#using-airflow-directly . But can you help me how to work with Airflow? I have the UI and the scheduler running, but i do not get the way how the pipelines are affected/executed by this. In ./dags/meltano.py I have this snippet here
Copy code
DEFAULT_ARGS = {
    "owner": "airflow",
    "depends_on_past": False,
    "email_on_failure": False,
    "email_on_retry": False,
    "catchup": False,
    "retries": 1,
    "retry_delay": timedelta(minutes=5),
    "concurrency": 1,
}
but the changes of the retries do not affect my pipelines. Do you have any idea? Thank you !
Okay nevermind. Got it working 🙂