proud-jackal-3879703/23/2021, 4:27 PM
ripe-musician-5993303/23/2021, 4:33 PM
proud-jackal-3879703/23/2021, 4:38 PM
ripe-musician-5993303/23/2021, 4:41 PM
> <replication key>
when the key is an interger rather than a timestamp
>= <replication key>
proud-jackal-3879703/23/2021, 4:44 PM
ripe-musician-5993303/23/2021, 4:48 PM
, unfortunately, no. you'd need to setup a dbt project and add your own dbt model to do this. Are you familiar with dbt already? @salmon-salesclerk-77709 Can you help out here? I wonder if we could make it as easy as "deduplicate on key X" if we can generate the dbt models etc...
salmon-salesclerk-7770903/23/2021, 4:53 PM
proud-jackal-3879703/25/2021, 4:20 AM
in the meltano without
? I don't know what
does. I don't find the syntax for that.. Help me here.. Thanks for the earlier support and in advance here.
salmon-salesclerk-7770903/25/2021, 1:30 PM
proud-jackal-3879703/26/2021, 8:59 AM
constraint, so that duplicate values are removed ?? I'm eager in deduplicating in the EL part itself, so that the cost of DML query in the target-bigquery side using
won't be expensive, since deduplicating DML query has to run for every scheduled elt job.
salmon-salesclerk-7770903/26/2021, 10:23 AM
proud-jackal-3879703/26/2021, 11:26 AM