Abednego Santoso
11/26/2024, 2:35 PMmeltano --version
, it said meltano: command not found
. Can you please help me?visch
11/26/2024, 2:41 PMdocker run -v "$(pwd)":/projects \
-w /projects \
meltano/meltano --version
Probably easier to alias that if you want to run it all the time 🤷Abednego Santoso
11/26/2024, 2:47 PMAbednego Santoso
11/26/2024, 2:47 PMAbednego Santoso
11/26/2024, 2:49 PMAbednego Santoso
11/26/2024, 2:50 PMvisch
11/26/2024, 2:50 PMuv tool install meltano
visch
11/26/2024, 2:50 PMAbednego Santoso
11/26/2024, 2:50 PMAbednego Santoso
11/26/2024, 2:50 PMvisch
11/26/2024, 2:51 PMgiphy
11/26/2024, 2:51 PMAbednego Santoso
11/28/2024, 5:18 AMversion: 1
default_environment: dev
project_id: 7409e173-e451-467c-8c6f-fc0a8b099177
environments:
- name: dev
- name: staging
- name: prod
plugins:
extractors:
- name: tap-postgres
variant: meltanolabs
pip_url: git+<https://github.com/MeltanoLabs/tap-postgres.git>
config:
database: pagila
host: myhost
user: user
password: password
port: 26527
It's not working. Here's the error message
Plugin configuration is invalid
(Background on this error at: <https://sqlalche.me/e/20/f405>)
I made sure all the variables are correct by trying to connect to this db using DBeaver and it's just fine using DBeaver.
Anything I missed out?Edgar Ramírez (Arch.dev)
11/28/2024, 3:07 PMmeltano select tap-postgres --list --all
. You might wanna select some streams.Abednego Santoso
11/29/2024, 3:05 AMAbednego Santoso
11/29/2024, 3:05 AMAbednego Santoso
11/29/2024, 7:17 AMversion: 1
default_environment: dev
project_id: e9df638f-84cb-424f-a9e8-cf6273b55346
environments:
- name: dev
- name: staging
- name: prod
plugins:
extractors:
- name: tap-postgres
variant: meltanolabs
pip_url: git+<https://github.com/MeltanoLabs/tap-postgres.git>
config:
host: myhost
port: myport
user: myuser
password: mypassword
database: mydb
select:
- public*.*
loaders:
- name: target-s3
variant: crowemi
pip_url: git+<https://github.com/crowemi/target-s3.git>
Now it returns fine when I run meltano config tap-postgres test
.
So, I assume, we need to specify which tables in 'select' first then the test will return ok?
public*.*
means the schema is public and it selects all tables and columns under schema public.visch
11/29/2024, 2:05 PMmeltano invoke tap-postgres
to be sure some data is flowingvisch
11/29/2024, 2:05 PMAbednego Santoso
12/04/2024, 11:25 AM