Hello meltano friends. I’m trying to productionize meltano with dagster, I have a working docker compose, that I would be happy to share. The only problem is that by default, the

meltano invoke dagster:start

boots dagster in

<http://127.0.0.1:3000>

which is a problem because without fishy workarounds you can’t access it. Has anyone done this, having meltano as the main project, and dagster as a utility? Is there anyway I can boot dagster to

0.0.0.0:3000

with extra parameters to the

invoke

I guess the other workaround is to have dagster being the main project and use meltano as a sub project. Many thanks :)

Yes I had to do the same. What cloud platform are you using by the way? I am using Azure, keen to see how you lock down Dagit access.

heyo!! Thanks for your reply. Glad to see you also solved it the same way haha. That's really nice, I'll be looking to do a deployment in AWS - most likely ECR/ECS

I believe you can actually build your own custom command in

meltano.yaml

for dagster like this

utilities:
  - name: dagster
    variant: quantile-development
    pip_url: dagster-ext
    commands:
      dev:
          args: dev -f $REPOSITORY_DIR/repository.py --dagit-host 0.0.0.0
          executable: dagster_invoker

oh damn, thats pretty cool

I was searching through the repo trying to identify where the commands were defined, and found this: https://github.com/quantile-development/dagster-ext/blob/2d5065c0d3978999c7f54a0493aa69e186dce2d2/project/meltano.yml#L74 I just extended the logic from there

Super nice thanks a lot for sharing!