proud-pillow-5593503/11/2021, 2:30 PM
salmon-salesclerk-7770903/11/2021, 3:07 PM
microscopic-dream-7519503/11/2021, 5:41 PM
, but that's not the path on your local. What's the specific error you're getting?
proud-pillow-5593503/11/2021, 8:29 PM
directory being copied back and forth across the Windows machine and the running container. Especially since I have that in my
file. Maybe the solution is just rebuild the image whenever I make changes, but I was just hoping to be able to make changes and immediately run a pipeline in the UI and it have the most up to date
in my Dockerfile after copying over the
but still doesn't seem to be working 🤷
salmon-salesclerk-7770903/11/2021, 9:03 PM
ripe-musician-5993303/11/2021, 9:05 PM
Docker image and mounting your project directory, or are you building a dedicated Docker image for your project?
proud-pillow-5593503/11/2021, 9:06 PM
ripe-musician-5993303/11/2021, 9:07 PM
and everything 🙂
salmon-actor-2395303/11/2021, 9:20 PM
proud-pillow-5593503/11/2021, 9:22 PM
ripe-musician-5993303/11/2021, 9:23 PM
and everything 🙂
proud-pillow-5593503/16/2021, 5:31 PM
ripe-musician-5993303/16/2021, 5:32 PM
salmon-actor-2395303/16/2021, 5:40 PM
proud-pillow-5593503/16/2021, 5:47 PM
command has to propogate those changes back to the
meltano add ...
file on my Windows machine. How would you recommend doing this? I'm currently trying to mount my local directory to the container, but it's running into issues because it's acting like certain Meltano extractors/loaders aren't installed.
salmon-actor-2395303/16/2021, 5:50 PM
proud-pillow-5593503/16/2021, 5:51 PM
version: "3.8" services: bw-meltano-ui: build: . command: ui depends_on: - bw-meltano-db - bw-meltano-target-db env_file: - ./config/meltano-ui.env.dev # environment: # - MELTANO_PROJECT_READONLY: 1 ports: - target: 5000 published: 5000 networks: - bw-meltano-net volumes: - ./meltano.yml:/project/meltano.yml - ./extract/:/project/extract/ - ./load/:/project/load/ - ./model/:/project/model/ - ./orchestrate/:/project/orchestrate/ - ./transform/:/project/transform/ bw-meltano-target-db: image: "postgres" env_file: - ./config/meltano-target-db.env.dev networks: bw-meltano-net: ports: - target: 5432 published: 5432 bw-meltano-db: image: "postgres" env_file: - ./config/meltano-db.env.dev networks: bw-meltano-net: ports: - target: 5432 published: 5433 networks: bw-meltano-net:
file. Basically, we spin up two databases (one for Meltano, and one for the
loader). I originally was binding my entire project directory to the
folder on the container, but I thought maybe that that was screwing up everything in the
directory since Meltano was letting me know that certain taps/targets weren't installed
salmon-actor-2395303/16/2021, 5:53 PM
section is mapped to individual artifact locations, which could be part of the reason other components may be missed.
proud-pillow-5593503/16/2021, 5:53 PM
ARG MELTANO_IMAGE=meltano/meltano:latest FROM $MELTANO_IMAGE WORKDIR /project # Install any additional requirements COPY ./requirements.txt . RUN pip install -r requirements.txt # Install all plugins into the `.meltano` directory COPY ./meltano.yml . RUN meltano install # Pin `discovery.yml` manifest by copying cached version to project root RUN cp -n .meltano/cache/discovery.yml . 2>/dev/null || : # Copy over remaining project files COPY . . # Expose default port used by `meltano ui` EXPOSE 5000 ENTRYPOINT ["meltano"] CMD ["ui"]
salmon-actor-2395303/16/2021, 5:57 PM
proud-pillow-5593503/16/2021, 6:00 PM
salmon-actor-2395303/16/2021, 7:28 PM
. I also proposed we plan to circle back on Windows use cases during next week’s office hours session. @proud-pillow-55935, do keep us posted if this resolves your issue. I’ll create an issue to research that potential Dockerfile issue in the meanwhile. While we’ve got it fresh, do you mind pasting back the updated Dockerfile text here in this thread?
proud-pillow-5593503/16/2021, 7:32 PM
ARG MELTANO_IMAGE=meltano/meltano:latest FROM $MELTANO_IMAGE WORKDIR /project COPY . . # Install any additional requirements RUN pip install -r requirements.txt # Install all plugins into the `.meltano` directory RUN meltano install # Expose default port used by `meltano ui` EXPOSE 5000 ENTRYPOINT ["meltano"] CMD ["ui"]
salmon-actor-2395303/16/2021, 7:45 PM