Hi everyone 🙂 . I’ve got a question about the transferwise variant of the snowflake target (but it may apply to other targets also). I’ve got a stream which has a replication_method set to

FULL_TABLE

… my assumption was that when updating the target table in snowflake all rows would be deleted before the inserting the new rows. Instead a merge statement is used to add the new rows. This means that any records deleted from the source remain in the target table. Is this expected behaviour?

Not specific to your question but I know my postgres to postgres full_table replication does the same

Ah ok Steven, thanks good to know.

That is the expected behavior, at least by default., Check out the hard_delete option if you want deleted rows removed.

Ah ha Thomas! My hero 🙂. Exactly what i was looking for ❤️

I remember that not working for postgres, even though it should be supported. So your mileage may vary 🙂

Personally I prefer having the rows remain, with the sdc_deleted_at column populated... that way you can still see the old rows but they're easy to exclude.

Yes good shout, have gone with the

add_metadata_columns

option 👍