what is the best way to run log base sync jobs (ru...
# announcements
j
what is the best way to run log base sync jobs (running all the time)? Airflow is good for schedules
d
@jingkun_zhuang You could set up a Docker container with
meltano elt <tap> <target>
or
meltano schedule run <schedule>
as the entrypoint, with a
restart: always
policy. That way the container will always be running, and when the job succeeds because some timeout expires without any new log messages, it will automatically restart
Without Docker, you could send up systemd or an equivalent tool to similarly make sure
meltano elt ...
is always running
j
Thank you! I will do the docker approach
Another question, does meltano support adding custom ui pages and db models (like what one can do with custom airflow plugin)
d
@jingkun_zhuang Not currently, no, but I'd welcome an issue in https://gitlab.com/meltano/meltano/-/issues to explore that!