does anyone use `--merge-state` flag introduced re...
# troubleshooting
m
does anyone use
--merge-state
flag introduced recently and unable to update the state in azure blob after the meltano run/el? i receive 👇 warning when i try a meltano run like described in here. the stream get full refreshed, but the state doesn't get updated.
Unable to persist state, or received state is invalid, incremental state has not been updated
1
e
Hey @merve_eren! Which extractor and loader are you using?
m
i used tap-salesforce (meltanolabs) and tap-zendesk (twilio-labs), and target-snowflake (transferwise)
e
Do both taps give you the same warning?
m
yes.
and there's no issues of updating the state in blob w/o the --merge-state flag. i get the warning only when i pass --merge-state
e
Ok, I'll take a look
If you don't use the azure blob state backend, do you get the same warning?
m
i havent tried that yet, will do.
👍 1
it's not working when i use local file as well.
e
Ok. That makes me think the state has an unexpected structure. Can you retrieve the state that's generated without the
--merge-state
flag? The commands
meltano state list
and
meltano state get
should do the trick.
m
Copy code
Reading state from Local Filesystem
{"singer_state": {"bookmarks": {"groups": {"updated_at": "2023-08-23T08:15:01Z"}, "organizations": {"updated_at": "2024-05-14T17:16:39Z"}}}}
e
Oh, I think this is a 🐛 that's been lurking for some time. Let me test a few things.
m
@Edgar Ramírez (Arch.dev) thanks 👍
e
Merged. Will cut a patch release shortly.
v3.4.2
is available, please give it a try!
👍 1
🙏 1
m
seems like the issue is fixed 👍 thanks @Edgar Ramírez (Arch.dev)
🙌 1