I am using the Tap-braintree repo and loading it to S3. The incremental load is working where i can see the state is getting picked up,but there are duplicates in the data. Duplicates are there during a single run and also produced in the consecutive runs. Anyone has faced this. I am passing the catalog.json file here as the tap doesn't support discover. Has anyone faced this issue for incremental load for Tap-braintree. Any help is much appreciated

Hi @jifan musthafa. Are you seeing duplicates only in the

customers

stream or in all of them? It's probably worth reporting the issue directly to the fixdauto folks. It might have something to do with how date ranges are handled: https://github.com/fixdauto/tap-braintree/blob/e0d23cbd663a934267b5c940092bcd042673f55a/tap_braintree/client.py#L251-L255.

i am seeing duplicates in transactions stream

Ok, I think they have similar date range logic though so that may still be the root cause