Hi guys, newb here in Meltano (I've got basic ELT ...
# troubleshooting
l
Hi guys, newb here in Meltano (I've got basic ELT setup with Airflow as orchestrator, and I'm already experienced the cool things it's doing in my local machine now ) I'm having this roadblock that resulted to a bit of conceptual questions. If anyone has some answer or docs on these, I'll be very grateful 🙇 My roadblock: I'm trying to make airflow send an email on failure, but no emails were sent as I mark DAGs as failure. My airflow config in
meltano.yml
looks a bit like this
Copy code
orchestrators:
  - name: airflow
    config:
      email:
        email_backend: airflow.utils.email.send_email_smtp
        default_email_on_failure: true
(I omitted some of the obvious ones like SMTP) My questions: 1. In my understanding, configuring
meltano.yml
this way will be equivalent as configuring
airflow.cfg
. Is this correct? 2. I see that in the automatically generated
orchestrate/dags/meltano.py
, there's a DEFAULT_ARGS saying "email_on_failure": False. (See github version). Is this taking precedence over what I set up in
meltano.yml
? Please also let me know if I am debugging in the correct direction. Thank you so much gratitude thank you
I think I might have figured out why I couldn't receive those emails: I forced the DAGs to fail from the UI. Somehow this did not trigger the email. If I let the DAGs fail on its own (by changing some things internally) it correctly sends the emails. Thank you! 🙇