In case anyone is interested, this AWS Batch running the Meltano container is running along pretty seamlessly for the past 3 months (linked is the template) https://github.com/mattarderne/meltano-batch

Nice! Thanks for sharing 🙂

@matt_arderne for your

aws batch list-jobs

you can add something like this:

--filters '[{"name":"JOB_NAME","values":["prod_*"]}]'

to list all jobs that start with prod_. Otherwise, it only shows RUNNING jobs. Thus you can get a list of all jobs where the job name starts with prod_. You can also use something like

--job-status "SUCCEEDED"

instead, which will return all jobs with a SUCCEEDED status, but you can only specify one job status in the call. So it depends what you want to list, SUCCEEDED jobs, or maybe FAILED jobs, use job-status; all jobs regardless of state, use --filters. You can also use --filters to filter things like BEFORE_CREATED_AT and AFTER_CREATED_AT, as well as JOB_DEFINITION. But you can only use one filter name/type at a time.