Good morning everyone! I had a question regarding...
# singer-tap-development
s
Good morning everyone! I had a question regarding replication. How does log replication work? I understand the base concept, but does it need to be programmed in the loader, or only in the tap (postgres in this case). I'm trying to fully transfer to bigquery, but we'll need to ensure that log-replication is fully functional
a
Good morning, @Stéphane Burwash! The loader does not need to performa any special functions. If the target does merge upserts, for instance, those will still be performed based on the primary keys - and are not affected by incremental replication keys.
Log-based replication is basically just an alternative to incremental replication based on internal system keys instead of 'regular' columns or record properties.
s
Ok awesome! This definitely reduces the stress involved with integrating the bigquery loader into our stack 😉 Thanks @aaronsteers