rahul_anand
07/29/2020, 12:54 AMmeltano ui in background, similar to meltano invoke airflow webserver -D which runs airflow in background? What is the recommended way to run the UI in background in the container when other ELT pipelines are running.douwe_maan
07/29/2020, 2:35 PMmeltano ui does not currently have a native "deamonize" feature like Airflow's -D , but you can use the shell & operator to move any command to the background: https://datacadamia.com/lang/bash/process/ampersanddouwe_maan
07/29/2020, 2:36 PMWhat is the recommended way to run the UI in background in the container when other ELT pipelines are running.I wouldn't recommend using the same container to run both
meltano ui and meltano invoke airflow scheduler , although you can make it work using the & operator. Have you considered using separate containers instead?douwe_maan
07/29/2020, 2:38 PMmeltano ui to get its own -D flag 🙂)rahul_anand
07/29/2020, 3:08 PMmeltano ui much so may be some basic questions. If I run the meltano ui in a separate container how will meltno ui interact with other containers to configure, launch or schedule jobs?douwe_maan
07/29/2020, 3:56 PMmeltano ui inside a containerized project, the project will be readonly and it will not be able to make any changes to project files anymore: https://meltano.com/docs/production.html#containerized-meltano-project-7 https://meltano.com/docs/settings.html#project-readonly
That means you won't be able to install new plugins or create new schedules (since all of this would be stored in your version controlled project), but as long as you're using a separate system database (https://meltano.com/docs/production.html#storing-metadata), you can still run and view the status of existing pipelines and modify their configurationdouwe_maan
07/29/2020, 3:57 PM