So, I've finally got Meltano + Airflow running loc...
# troubleshooting
i
So, I've finally got Meltano + Airflow running locally with
docker-compose.prod.yml
adding the airflow user was a manual process, so far. The issue I have now is that the DAGS folder is not showing up. I'd expect
orchestrate/dags/meltano.py
to show up even if there was an error but I'm seeing absolutely nothing. Any suggestions for this? In
demo-meltano-project/plugins/orchestrators/airflow--apache.lock
I can see the following which looks OK but doesn't seem to be used (as in dags not appearing)
Copy code
{
  "name": "core.dags_folder",
  "env": "AIRFLOW__CORE__DAGS_FOLDER",
  "value": "$MELTANO_PROJECT_ROOT/orchestrate/dags",
  "label": "DAGs Folder"
}
meltano invoke airflow config list
(inside the airflow webserver) provides lots of info including:
Copy code
[core]
dags_folder = /project/orchestrate/dags
hostname_callable = socket.getfqdn
default_timezone = utc
executor = LocalExecutor
Which looks OK. But dags not appearing in the Webserver UI.