https://linen.dev logo
#plugins-general
Title
# plugins-general
c

chris_stout

07/28/2022, 4:04 PM
cc: @TomasB We're having a problem where we are getting duplicate records (looks like probably the last record from the previous run). We're using postgres transferwise tap and target-bigquery adswerve target. We have replication mode set to INCREMENTAL. On the adswere Readme, they mention:
Copy code
Upserting new rows into the table, using the primary key given by the tap connector (if it finds an old row with same key, updates it. Otherwise it inserts the new row)
We have set the:
Copy code
table-key-properties:
              - id
extended
Copy code
- name: prod
  config:
    plugins:
      extractors:
      - name: tap-postgres--inventory
        config:
          default_replication_method: INCREMENTAL
          metadata:
            public-*:
              replication-key: updated_date
              table-key-properties:
              - id
I thought this would solve the problem. Is there another field for the primary key I should be using instead of table-key-properties?