Hey folks, is there a way to disable ACTIVATE_VERS...
# troubleshootingj
jichao_sun
11/29/2023, 10:36 PMHey folks, is there a way to disable ACTIVATE_VERSION message using meltanolabs’ tap-salesforce?? I’m trying to use the tap with target-snowflake and it’s wiping all old entries.
I see that the tap is running a select with a filter by timestamp, but also sending an ACTIVATE_VERSION message at the same time.
From the spec it sounds like ACTIVATE_VERSION should only be sent on full syncs, not filtered syncs
jichao_sun
11/30/2023, 1:49 PMIf I’m reading this codebase right
1. Whenever a stream has a replication-key the select query for data always [filters by start date](https://github.com/MeltanoLabs/tap-salesforce/blob/d802f68929d9621a72a9639603b422ea90490520/tap_salesforce/salesforce/__init__.py#L340)
2. In salesforce tables like Account have
SystemModstampjichao_sun
11/30/2023, 1:51 PMGiven that, it sounds like by emitting a ACTIVATE_STATE record on incremental syncs (which pushes data with a select filter), the tap tells the target with activate_state to wipe all the prev data???
jichao_sun
11/30/2023, 1:54 PMI must be missing something here, but from what I observe in my test runs with an empty snowflake schema, it definitely wipes records in followup runs