Hey all, if I am using a tap (custom made) that deliberately produces duplicate data, does my target (Redshift) automatically update records based on the primary key I set in the tap?

From looking at the code: https://github.com/transferwise/pipelinewise-target-redshift/blob/80796b6c6e4647a85ddc9492e343547a027258e4/target_redshift/db_sync.py#L509 looks like if you have PK set then it attempts update then insert, but if no PK set then just inserts.

+1 to what Andy said. Also its defaulted to true but theres this primary_key_required that will raise an error if your stream doesnt have a PK to use for updates