Hi all 👋. Excited to say I’ve just finished and published a blog post explaining how to get a Meltano pipeline running in a container on GCP and run it with Cloud Composer (GCP’s managed Airflow service). I really struggled when figuring this out as I was pretty new to containers and I wasn’t able to find much help out there for GCP. Took me ages to figure out stuff like how secrets should be handled on a container! It’s quite long as there’s a lot of detail on what to set up but hope it’s helpful to others!

Good on you Mark.

Amazing! Thank you for sharing

Love this! Thanks, @mark_macardle. cc @e.kyle3, @amanda.folson 👆

This looks great! Thanks for sharing

Thanks ! I posted a comment on Medium, because I need more information about how DAGs are used in this case (

orchestrate/dags

meltano folder ?) or DAGs stored in GCS ? I’m little bit confuse…