hey all, has anyone gotten datadog working with this? trying to get the dag logs from the scheduler node and get the airflow integration dashboard working correctly. installing datadog via the helm chart. i can get the airflow dashboard working if i manually edit the

airflow-airflow-config

configmap, changing the

metrics

and

scheduler

statsd_host

to the node ip, but i don't see any way to do that automagically. i think the dag logs would work best if i could get them to output to standard out, but haven't been able to get that to work or get datadog to pick them up correctly from

/opt/airflow/logs

thanks!

might depend on your setup, but a lot (if not all) of the Airflow config options seems to be overridable with env vars. So you could configure meltano to inject an env var. e.g.

env:
      AIRFLOW__METRICS__STATSD_HOST: "some.host"
      AIRFLOW__METRICS__STATSD_PORT: 4242
      AIRFLOW__METRICS__STATSD_ON: "true"