Follow up question (related to above question). I’...
# plugins-general
t
Follow up question (related to above question). I’m looking to pull in just specific columns from a
tap-postgres
extractor. When I use this environment variable:
Copy code
export TAP_POSTGRES__SELECT='["staging-emp.email", "staging-emp.emp_id"]'
and then check selected columns with
meltano select tap-postgres --list
, the extractor correctly shows just these two fields I want extracted. But then when I run a
meltano elt tap-postgres target-csv
, for example, it still pulls all of the fields in that table. Is there a way to tell Meltano that I only want to select certain fields from the table?
Also, when I run
meltano select tap-postgres --list --all
to check which fields are being selected vs excluded, I see this as the output (screenshot). The columns marked “selected” are exactly what I want, but then the schema/table of the other fields that I don’t want are also green.
t
This looks like a bug with the tap itself and isn’t something Meltano can control https://github.com/transferwise/pipelinewise-tap-postgres/issues/128
that said, we’re working on a variant of tap-postgres that’s based on our SDK which should address this!
t
Ah I see, thank you for the reply! Looking forward to that variant of the tap!