Hi all, using Meltano's Docker image I set up env ...
# troubleshooting
j
Hi all, using Meltano's Docker image I set up env vars in the
meltano.yml
file to utilize dynamically created database connections (using docker compose) cross-projects. This worked like a charm in
v2.12.0
, however since
v2.13.0
I'm receiving an exception during the
meltano install
step in the Dockerfile. This exception occurs:
Copy code
invalid literal for int() with base 10: ''
For example, the
meltano.yml
contains the following loader:
Copy code
loaders:
  - name: target-postgres
    variant: transferwise
    pip_url: pipelinewise-target-postgres
    config:
      host: ${DB_HOST}
      port: ${DB_PORT}
      user: ${DB_USER}
      password: ${DB_PASS}
And in the
docker-compose.yml
I set up the env vars:
Copy code
services:
  meltano:
    <<: *meltano-image
    command: ui
    environment:
      DB_HOST: ${DB_HOST}
      DB_PORT: ${DB_PORT}
      DB_USER: ${DB_USER}
      DB_PASS: ${DB_PASS}
If I remove the env vars from the
meltano.yml
, the exception doesn't occur. Is this changed intentionally in
v2.13.0
?
t
@Will Da Silva (Arch) I suspect that’s related to this change, correct? https://github.com/meltano/meltano/pull/7123
w
That seems likely. I was just looking through the PR to see what might be causing that.
@janick_otten Could you please report this as a bug at https://github.com/meltano/meltano/issues, and I'll see what I can do to fix/work-around this soon.
j
Sure, thanks for the quick replies guys!
Bytheway, if I comment out the
meltano install
in the
Dockerfile
, then
bash
into the container and run
meltano install
manually, it does work. I'll mention this in the bug report as well.
w
Thank you for the detailed bug report @janick_otten!
I have reproduced the error
This should be fixed by https://github.com/meltano/meltano/pull/7190 Thanks again for reporting this @janick_otten!