Hi all, I'm working on a project where I aim to le...
# docker
a
Hi all, I'm working on a project where I aim to leverage Docker for containerizing both Meltano and Dagster. My goal is to create a demo setup that showcases how these two technologies can work together, particularly focusing on data transformation workflows. Do any of you have experience or know of existing demo projects that use Docker to run Meltano alongside Dagster? Ideally, I'm looking for setups where Meltano acts as either a source or target within Dagster pipelines, all managed through Docker containers. Any insights, resources, or even example Dockerfiles/Dagster pipelines would be incredibly helpful This will not only help me understand best practices but also inspire my own project.
a
Are you looking for a single dockerfile including dagster and meltano? Or dagster invoking individual meltano container runs?
a
Hey @Ahmed Hamid I’d recommend you to take a look at this if you haven’t yet https://dagster.io/blog/dagster-meltano-integration-tutorial
🙌 1
👍 1
a
@Andy Carter Ideally i would like to have dagster invoking individual meltano container runs
👍 1