What's the best way to use meltano as part of existing airflow deployment? We use MWAA(on AWS) and have few pipelines existing. We want to start using meltano for a extraction and dumping to S3 . For now, i just created a bash operator and calling meltano elt

We’re also using the bash operator for this.

So, problem with MWAA is that, it's a read only file system . So, when running tap through meltano, it keeps saying access denied.. how are you dealing with this?

Ah, I guess we’re not using MWAA, so we don’t have that problem. I was just addressing how we run meltano in an existing airflow deployment, sorry.

Got it. Thank you

Kubernetes pod operator maybe? Connected to AKS

Another alternative is to dockerize meltano and subsequently use it in combination with ECS Fargate.