For anyone interested in the combination of Meltan...
# data-news
j
For anyone interested in the combination of Meltano and Dagster, I wrote a blog article on how to get started (in the absence of an actual plugin on Dagster’s part). If you think I mis-stated something, please let me know. I’m happy to receive feedback and correct errors. https://engineering.widen.com/blog/Dagster-+-Meltano/
j
Hi Josh, we have created a little WIP plugin for running Meltano pipelines in Dagster. https://github.com/quantile-development/dagster-meltano. It might be interesting for you guys. In the next few months we are going to move Meltano and Dagster to production and will probably make the plugin production ready.
j
@jules_huisman thanks so much for the read and the response. I just saw your repo last week while I was prepping for this article. I actually reached out to you on the Dagster Slack Workspace about it. I would love to contribute if you’re interested.
j
Oh sorry, I was not signed in to the Dagster Slack 🙃. Contributions would be definitely appreciated! The next focus would probably be on injecting tap and target settings into the solid. We can talk in DM's to not pollute the thread :)
s
hey @josh_lloyd -- i'm curious if you've continued to find success with meltano + dagster? i'm evaluating the combination now for a new data platform im owning
j
@stephen_bailey Absolutely! We’ve been running in production for about 7+ months now. Can’t imagine going back to the pipeline we had before
@jules_huisman and I probably only need a little more work on the repo He mentioned earlier in this thread before it’s ready to be tested in prime time. I think with that plugin truly in place, it would make integration of the two systems a breeze.
s
that is amazing, very helpful! i don't have a good read on how much traction dagster is gaining and how solid people are finding it. this is great to know