Do Meltano and Airflow need to share a DB, or can ...
# infra-deployment
f
Do Meltano and Airflow need to share a DB, or can they point to different endpoints? My understanding is that the dags are pulled from the filesystem, not the database.
Nevermind, I see the actually point to different database names.
e
out of the box I haven't even needed to instantiate any DB.. for airflow or meltano
f
It will use a sqlite db if none is specified, but it is not recommended for production.
e
good to know for me then.. I am not a prod level deployment yet
m
What is risk of using sqlite db for prod? I had a look at it and the only thing I saw populated is run logs - presuming losing that is a low consequences affair, but maybe missing something
f
It stores the state for incremental datapinelines...
m
Ah it does indeed. tx