Hello! What are some of the ways that you all upda...
# best-practices
a
Hello! What are some of the ways that you all update/delete the state bookmark for individual streams? For example, we have a state file with 200+ bookmarks and it would be nice to delete or update the bookmark for one or more specific streams.
e
Is the purpose to trigger a full-refresh of that stream?
a
It depends. Sometimes I want to update the bookmark for a table to 2 months ago (for example) to reload the data since that point. Or sometimes I want to delete the bookmark so our automated load just starts from the beginning without me having to step in and manually run
--full-refresh
. Right now, the method I have of (1)
meltano state get > state.json
(2) manually update the bookmark and (3)
meltano state set --input-file state.json
just isn't very elegant and leaves room for human error. So I am hoping to see how others manage this!