Deduplication: is there something new regarding deduplication with Meltano? I have seen several dedup tools, but I would like to know if Meltano provides any best practice for the basic task of data deduplication? Any hint / url / information collection - preferably outside this horrible chat software - would be lovely to see!

@softwarelimits Can you elaborate on the "something new" portion of your comment? Regarding preventing duplication in the first place, each extractor can track

STATE

messages during extraction to both mitigate duplication initially and to pick up where it left off on future extractions. Does that make sense?