Hey Everyone! I am trying to pull data from snowflake and push it to postgres. My meltano.yml uses the tap-snowflake and target-postgres to sync the data. Every sync, we are seeing duplicate records being created in each table, only difference being the

_sdc_*

columns being different. I have set

load_method

to

upsert

and

overwrite

but to no avail (as per the docs). Every sync I see a new duplicate record added per row. Any suggestions?

I think we need to actually bring

load_method

support into target-postgres. Since the implementation has deviated from the SDK in critical points it's missing some of the improvements.

What do I need to do to ensure that by default upsert (preferred) or overwrite behaviour is seen?

The

prepare_table

method in the target needs to be updated to check for the

load_method

setting