david_gauthier-dussureault
09/30/2022, 6:40 PMCOPY INTO
statement in Snowflake. Is there a way to pass a composite primary key to the tap so that the operation in Snowflake is a MERGE
on the composite key instead of a full insert?
I search to figure if there was a way to add a composite primary key in the tap and I found this thread. Based on this, it seems like I can configure the table-key-properties
of the entities, but this haven't worked for me so far, it still COPY INTO
instead of MERGE
. Here is the config I have:
plugins:
extractors:
- name: tap-mysql
variant: transferwise
pip_url: pipelinewise-tap-mysql
metadata:
my_entity:
table-key-properties:
- Country
- DeviceType
- EndDate
- Organization
- SerialNumber
- StartDate