does anyone have a good list of resources to familiarize myself with some practices/patterns/reference architectures leveraging meltano within AWS? I am trying to get a general sense of what others are doing as I think through our system architecture

I have been using these two as sort of best practice places, but also keen to know how others do their staging. • https://about.gitlab.com/handbook/business-technology/data-team/platform/ • https://github.com/meltano/squared

our setup is basically • have an ECS task that is triggered by an event bridge rule every hour • the task reads credentials from AWS SSM • it reads state from s3, just using a single bucket. we don’t have a staging env for this pipeline, for local dev purposes i just override that and use sqlite • the only CI check for this repo is running

cfn-lint

on the cloudformation template that specifies all the infra, and also doing a

run --dry-run <tap> <target>

in the meltano docker image to make sure nothing is horribly broken