General state / testing question -- I'm trying to ...
# announcements
p
General state / testing question -- I'm trying to debug some tap/target incremental update issues. I'm using
meltano elt tap-foo target-bar
to trigger the run. I don't see any state persisted between runs. Is that the intended behaviour, or am I missing something? The logs say:
Copy code
meltano       | Running extract & load...
meltano       | No state was found, complete import.
...
meltano       | Incremental state has been updated at 2020-08-11 22:02:21.109205.
meltano       | Extract & load complete!
So it's leading me to believe that state is being stashed somewhere...
d
@paul_tiplady Don't forget to pass a
--job_id
to
meltano elt
if you'd like it to save and pick up state! See https://meltano.com/docs/command-line-interface.html#pipeline-state
The homepage also mentions "Meltano [...] keeps track of the state of your extraction, so that subsequent pipeline runs with the same job ID will always pick up right where the previous run left off.", but I guess that's not quite as explicitly stated in the ELT CLI docs as it could be.
p
Ah, that'll be it, I just found that flag as I was digging through the code
Yep, that was it. Thanks for the quick reply!