Do Meltano and Airflow need to share a DB, or can they point to different endpoints? My understanding is that the dags are pulled from the filesystem, not the database.
fred_reimer
10/27/2021, 4:18 PM
Nevermind, I see the actually point to different database names.
e
emcp
10/27/2021, 4:25 PM
out of the box I haven't even needed to instantiate any DB.. for airflow or meltano
f
fred_reimer
10/27/2021, 4:26 PM
It will use a sqlite db if none is specified, but it is not recommended for production.
e
emcp
10/27/2021, 4:26 PM
good to know for me then.. I am not a prod level deployment yet
m
matt_arderne
10/27/2021, 5:24 PM
What is risk of using sqlite db for prod? I had a look at it and the only thing I saw populated is run logs - presuming losing that is a low consequences affair, but maybe missing something
f
fred_reimer
10/27/2021, 5:28 PM
It stores the state for incremental datapinelines...