what is the best way to run log base sync jobs running all t

Question

what is the best way to run log base sync jobs running all the time Airflow is good for schedules

ripe-musician-59933 · Answer

< green midnight 5977> You could set up a Docker container with `meltano elt lt tap gt lt target gt ` or `meltano schedule run lt schedule gt ` as the entrypoint with a `restart always` policy That way the container will always be running and when the job succeeds because some timeout expires without any new log messages it will automatically restart

ripe-musician-59933 · Answer

Without Docker you could send up systemd or an equivalent tool to similarly make sure `meltano elt ` is always running

green-midnight-5977 · Answer

Thank you I will do the docker approach

green-midnight-5977 · Answer

Another question does meltano support adding custom ui pages and db models like what one can do with custom airflow plugin

ripe-musician-59933 · Answer

< green midnight 5977> Not currently no but I d welcome an issue in to explore that