Can Meltano handle sub 5 min syncs?

Hi @espen_espelund There is an example in the documentation on how to write a cron expression that schedules a job to run every minute. Is that what you are after when you say 'sync'? https://docs.meltano.com/reference/command-line-interface#schedule

Yep. Thank you. Just curious. Why is a cron expression needed? What is the default way of scheduling when to run jobs?

I'm not sure why cron-style expressions are used in Meltano. I suppose since cron is a standard that has been in active use on computers everywhere for much longer than many of us have been alive, it stands to reason that it is a very solid standard to adapt for writing schedules in a simple and concise format. What would you use normally as a different way of expressing schedules?

Ah understood. Just wanted to know if the default in Meltano was some slider that stops as 30 minutes as it usually breaks in some way below that or something

I suppose you are asking about error handling when jobs are starting to overlap the execution windows?! I actually haven't explored that part yet. I'm only on week 3 of using Meltano. 😂

Meltano tracks pipelines by job_id. If you start a pipeline and it's already running it won't run it a second time. Now, whether you can get all your data moved in less than 5 minutes is a different question. 😉 That will depend on your data volume, target load speeds, etc.