prratek_ramchandani
02/28/2022, 2:48 PMfinalize_state_progress_markers()
at the end of each iteration. i logged self.stream_state
at the end of an iteration to confirm it was working and i do see the state i pushed
{'starting_replication_value': '2022-01-01T00:00:00Z', 'progress_markers': {'Note': 'Progress is not resumable if interrupted.', 'replication_key': 'created', 'replication_key_value': 1641237037}}
however, the next run starts right back at the beginning if that stream doesn't run to completion and starts with a [warning ] No state was found, complete import.
the repo is here if that helps. without this working my first run would take a couple of days 😬