ian_lewis
04/10/2023, 4:07 PMdocker-compose.prod.yml
adding the airflow user was a manual process, so far.
The issue I have now is that the DAGS folder is not showing up. I'd expect orchestrate/dags/meltano.py
to show up even if there was an error but I'm seeing absolutely nothing.
Any suggestions for this?
In demo-meltano-project/plugins/orchestrators/airflow--apache.lock
I can see the following which looks OK but doesn't seem to be used (as in dags not appearing)
{
"name": "core.dags_folder",
"env": "AIRFLOW__CORE__DAGS_FOLDER",
"value": "$MELTANO_PROJECT_ROOT/orchestrate/dags",
"label": "DAGs Folder"
}
meltano invoke airflow config list
(inside the airflow webserver) provides lots of info including:
[core]
dags_folder = /project/orchestrate/dags
hostname_callable = socket.getfqdn
default_timezone = utc
executor = LocalExecutor
Which looks OK.
But dags not appearing in the Webserver UI.