Meltano

hi what is this ?
```"progress_markers": {"Note": "Progress is not resumable if interrupted.",...```


<https://sdk.meltano.com/en/latest/faq.html#i-m-seeing-note-progress-is-not-resumable-if-interrupted-in-my-state-files>

how do i fix this if it is not monotonically increasing?

seems like some of these have these while other don't. i am using partitions

&gt; how do i fix this if it is not monotonically increasing?
You can't in that case. Interruptions are unfortunately not safe by definition then, so the SDK avoids setting intermediate bookmarks that might cause records to be skipped in a future sync.

If you know a stream is sorted, then setting the `is_sorted = True` attribute is the solution.

And to be clear, incremental replication still works for unsorted streams but bookmarks are only stored at the very end of the sync, and that message is just a warning that interruptions will cause the bookmark to be lost.

this is my state which is in postgres. some of these have the progress markers and other don't. the ones that don't have progress_markers run incrementally without doing a full fresh

which is what the progress_markers is not resumable seems to be forcing

Does the state have the marker even after a complete successful run?

this worked by just overriding the state. some of them do and some of them don't; i think my implementation is a little wonky. just going through a list of keys and iterating over them and checking the state and updating tables. using partitions, but seems like maybe need to split this up into different job-id for each key