Hello! I am using

tap-postgres

to extract some data, I would like to pick only some columns from the table not all the columns. After I set

meltano select tap-postgres "schema-table" "id"

I can see from

meltano select tap-postgres --list

that it only contains the id in selected attributes. however, when I run

meltano elt

I still get all the columns from the original table, anyone knows a solution for it? Thank you!

Hmm seems odd that would happen if you run

meltano elt tap-postgres target-whatever --dump=catalog > catalog.json

Then look at the catalog.json, find your stream, are the fields you expect selected and the fields you're not expecting not seleted?

not really, in the json I can see all the columns

I think other folks have seen this with tap-postgres https://meltano.slack.com/archives/C01TCRBBJD7/p1619185520421900

refresh_streams_schema()

on

__init__.py

seems the culprit on the tap

or you can simply specify the collumns that you want to replicate as shown here https://transferwise.github.io/pipelinewise/connectors/taps/postgres.html