I'm using tap-mssql to replicate this view, but th...
# troubleshooting
i
I'm using tap-mssql to replicate this view, but the upstream data quality is pretty bad and there are a bunch of records with an empty string for the "Doc Date" column. If I want to use this as my replication key, and it gets an empty string or null value, will that break my pipeline? The view is only a few thousand rows, so I was wondering if it might just be a better idea to do FULL_TABLE replication and set the primary keys accordingly if it's going to keep breaking with that column as the replication key. Alternatively - is there a way to ignore records that have an empty "Doc Date" column so an empty string is never stored in my stream metadata and doesn't break my pipeline?
Copy code
metadata:
      dbo-AP_VW_Fees_Billing:
        replication-method: INCREMENTAL
        replication-key: "Doc Date"