chris_kings-lynne
04/25/2021, 12:48 PMaccount
table, with the 13,000 rows in it I need, but…with every single value NULL except for the id
primary key from SF. What’s going on?chris_kings-lynne
04/25/2021, 12:48 PMchris_kings-lynne
04/25/2021, 12:49 PMplugins:
extractors:
- name: tap-salesforce
variant: meltano
pip_url: git+<https://gitlab.com/meltano/tap-salesforce.git>
config:
api_type: BULK
client_id: xxx
start_date: '2021-04-01T00:00:00Z'
select:
- Account
loaders:
- name: target-redshift
variant: transferwise
pip_url: pipelinewise-target-redshift
config:
host: xxx
port: 5439
user: xxx
password: null
dbname: xxx
s3_bucket: xxx
s3_key_prefix: xxx
compression: gzip
slices: 8
default_target_schema_select_permission: ro_group
add_metadata_columns: true
visch
04/25/2021, 1:14 PMvisch
04/26/2021, 2:25 AMselect:
- Account
You need to do
select:
- Account.*
It selects the defaulted included items for that stream which is normally just the key_properties. I just forget to include the * to include all of the attributes!visch
04/26/2021, 2:28 AMchris_kings-lynne
04/26/2021, 5:52 AMchris_kings-lynne
04/26/2021, 5:57 AMvisch
04/26/2021, 12:28 PMmeltano select --list tap-name
which would have shown you all the items that were deselected