also where does meltano actually store singer state for pipelines? It seems like this pipelines is starting over every time when it gets interrupted in the middle. I expected the state to be in the

job

table but I don't see it there

It's stored in the

job

table in the

payload

column, but only if the run actually succeeds, not when it fails or is otherwise interrupted. That bug is tracked in https://gitlab.com/meltano/meltano/-/issues/2147 and I plan to look at it next week!

got it. thanks!