hello everyone! I tried using docker following gui...
# docker
a
hello everyone! I tried using docker following guidance from https://docs.meltano.com/guide/installation-guide/ My project was successfully created, I went to the my project folder. Then, when I tried to do
meltano --version
, it said
meltano: command not found
. Can you please help me?
1
v
You have to use docker for every command if you want to do the docker install route! So it'd be
Copy code
docker run -v "$(pwd)":/projects \
             -w /projects \
             meltano/meltano --version
Probably easier to alias that if you want to run it all the time 🤷
a
ah I got it now ahaha
thanks @visch
so, which installation method is better?
🤷 1
so that I don't need to run that docker run everytime I want to command with meltano
v
I liked pipx, now I like uv a lot so I"d go with
uv tool install meltano
Basically a seperate venv is what you want
a
got it, I'll spend the night playing meltano
thanks
np 1
v
Welcome to the club!
g
one of us
😆 3
a
hello again. I tried using tap-postgres. Here's what I have in meltano.yml
Copy code
version: 1
default_environment: dev
project_id: 7409e173-e451-467c-8c6f-fc0a8b099177
environments:
- name: dev
- name: staging
- name: prod
plugins:
  extractors:
  - name: tap-postgres
    variant: meltanolabs
    pip_url: git+<https://github.com/MeltanoLabs/tap-postgres.git>
    config:
      database: pagila
      host: myhost
      user: user
      password: password
      port: 26527
It's not working. Here's the error message
Copy code
Plugin configuration is invalid
(Background on this error at: <https://sqlalche.me/e/20/f405>)
I made sure all the variables are correct by trying to connect to this db using DBeaver and it's just fine using DBeaver. Anything I missed out?
e
maybe see the output of
meltano select tap-postgres --list --all
. You might wanna select some streams.
a
thanks!
on it
Copy code
version: 1
default_environment: dev
project_id: e9df638f-84cb-424f-a9e8-cf6273b55346
environments:
- name: dev
- name: staging
- name: prod
plugins:
  extractors:
  - name: tap-postgres
    variant: meltanolabs
    pip_url: git+<https://github.com/MeltanoLabs/tap-postgres.git>
    config:
      host: myhost
      port: myport
      user: myuser
      password: mypassword
      database: mydb
    select:
    - public*.*
  loaders:
  - name: target-s3
    variant: crowemi
    pip_url: git+<https://github.com/crowemi/target-s3.git>
Now it returns fine when I run
meltano config tap-postgres test
. So, I assume, we need to specify which tables in 'select' first then the test will return ok?
public*.*
means the schema is public and it selects all tables and columns under schema public.
👍 1
v
Personally I don't use the test command often I set it up then maybe run
meltano invoke tap-postgres
to be sure some data is flowing
It's really handy in some cases but for interactive cli stuff I tend not to
1
a
thanks @visch