I think my org wants to move to more containerised deployments in future, so I have a lot to learn about docker. The docs have already been a great help in actually building a container, so thank you for that! Interested to know how you are running containerised jobs, I can see a number of pathways: • a single

meltano run sync_all

job on a schedule, running all tasks sequentially • kicking off a specific task from another orchestrator, ADF or AWS CloudEvents etc. • using airflow or dagster as meltano utilities in a container running 24/7

We are scheduling+running individual meltano jobs in kubernetes using Argo Workflows

Since we have a fairly simple EL set up, we do bullet #2: • Single Task Definition in AWS ECS with

meltano

as the container entrypoint • Scheduled Tasks using EventBridge to kick off different tap/target combos • State/Meta data stored in RDS • Logs all get piped to CloudWatch / DataDog