andrew_stewart
03/01/2022, 9:51 PMaaronsteers
03/01/2022, 9:57 PMaaronsteers
03/01/2022, 9:57 PMandrew_stewart
03/02/2022, 12:00 AMid or updated_at .. I’m assuming that if I use id then I will never pick up changes to previously seen id’s…. but if I use updated_at then I will start duplicating previous seen id’s with newer version and have to handle the dedup logic downstream ?aaronsteers
03/02/2022, 4:12 PMkey_properties - aka primary key, used in merging results downstream in the target
• replication_key - aka incremental key, used in detecting the changed records (this is the key that gets bookmarked in the STATE object)aaronsteers
03/02/2022, 4:13 PM["id"]
• replication_key = "updated_at"aaronsteers
03/02/2022, 4:13 PMandrew_stewart
03/03/2022, 11:47 PMandrew_stewart
03/03/2022, 11:48 PMaaronsteers
03/03/2022, 11:50 PM