Hello! I am heavily considering running Meltano in...
# best-practicess
Steven Searcy
06/25/2025, 6:26 PMHello! I am heavily considering running Meltano inside of Dagster. I've never used Dagster before, so all tips and recommendations are welcome if anyone has any. Or maybe things I should know before proceeding down this route? I am currently just running Meltano standalone inside of an Ubuntu instance.
e
Edgar Ramírez (Arch.dev)
06/26/2025, 1:26 AMHey @Steven Searcy 👋
I'm curious, are you planning to use Dagster+ or deploy and operate the OSS package yourself?
Also, I know some folks are using https://github.com/quantile-development/dagster-meltano/.
🙌 1
a
Andy Carter
06/26/2025, 7:43 AMOSS user with dagster-meltano user here, happy to help and share some code.
ty 1
Andy Carter
06/26/2025, 7:54 AMThe current dagster-meltano implementation only works with dagster 1.9x, 1.10 introduced a breaking change. But still fine for me chugging along on 1.9x. There is a PR in the works to work with 1.10 by more knowledgable souls than me.
Are you thinking of hosting dagster containerized? Or just a local deployment.
Andy Carter
06/26/2025, 7:55 AMI also have dbt models and powerbi refreshes running downstream from my triggered meltano runs. Getting meltano up and running doesn't take tons of dagster knowledge, but you need a bit more to do the rest.
➕ 1
s
Steven Searcy
06/26/2025, 3:37 PM@Edgar Ramírez (Arch.dev) That's a great question and I haven't fully decided. Planning on switching cloud providers relatively soon, so it may be a bit premature to use the OSS.
🙌 1
Steven Searcy
06/26/2025, 3:37 PM@Andy Carter Thanks Andy! Unsure which route I will end up going, regarding the OSS or Dagster+, but will reach back out here when I have made that decision.
j
joshua_janicas
06/27/2025, 1:29 PMI just want to echo that I also do an OSS Dagster which is helpful for me as it ended up me having one container that holds all the plugins (dagster, meltano's taps and targets, along with dbt). Works pretty well for me in a prod env in azure with Azure Container APps
s
Steven Searcy
07/01/2025, 3:40 PMUpdate here: we've decided to move forward with the Dagster+ hybrid approach and I currently have a local instance up and running. Definitely a fan of Dagster so far.
👌 2