Hey Everyone! Currently facing an issue using Airf...
# troubleshooting
n
Hey Everyone! Currently facing an issue using Airflow DAGs to run our meltano pipelines hourly. Our pipelines will complete a run and give an 0 exit code after being called by Airflow, but the DAG will be stuck in the running state, and then will not run hourly until manually resetting on the Airflow UI. Has anyone faced an issue with DAGs being stuck on the RUNNING state with Meltano Pipelines before? Any ideas are appreciated!
a
@neil_gorman - Can you tell if the problem is with Meltano not finishing correctly (or finishing abnormally in some way) versus Airflow for some reason not able to update its status?
n
From all accounts the Meltano pipelines are finishing normally, it seems to be an issue with the exit code being lost in translation between meltano and airflow
a
By chance can you replicate the issue using non-meltano execution tasks? I'm not myself an Airflow expert but I wonder if opening something in the Airflow issue tracker or Airflow Slack could help.