Hi all I m trying to configure `tap rest api msdk` however I Meltano #troubleshooting

Hi all! I'm trying to configure `tap-rest-api-msd...

cole_saunders

02/04/2022, 11:48 AM

Hi all! I'm trying to configure

tap-rest-api-msdk

, however I'm struggling to know the exact meaning of setting

primary_keys

. On the taps doc, the definition is "a list of the json keys of the primary key for the stream". At first I used an API token hoping that it may work and of course it didn't. Having a look at other issues on this channel, I'm under the impression it could be some type of API key or account id. Can someone provide a little more context to what this setting means? Thanks

aaronsteers

02/04/2022, 5:13 PM

I think this should be a list of strings representing the unique key on the table or stream being referenced. So, for a

customers

stream, this would probably be something like

['customer_id']

aaronsteers

02/04/2022, 5:15 PM

Cc @josh_lloyd to confirm

josh_lloyd

02/04/2022, 5:49 PM

@cole_saunders first of all, thanks for using this tap!!

josh_lloyd

02/04/2022, 5:50 PM

also, AJ is totally right. It’s just the primary key of the “table” you need to name there. If it’s a composite primary key then you’ll list more than one

josh_lloyd

02/04/2022, 5:53 PM

The only trick is that it needs to be written in JSON notation if the primary key is more than one level into the returned data structure. For example, if the api was returning this record

Copy code

{
    {'customer_id': {'value': 1234}}
}

Then the syntax for the

primary_keys

setting would be

customer_id.value

cole_saunders

02/07/2022, 10:20 AM

Thank you!

Open in Slack

Previous Next