Hi all, I new to Meltano and whole tap and target...
# plugins-general
l
Hi all, I new to Meltano and whole tap and target concept, I have been looking the documentation but there are quite some confuse. Can I trouble anyone to explain these 1. Where is the job state files / information is stored ? 2. How the state of each
select
is kept if there are multiple table selected? (I think in singer, the state will be saving for each) 3. Does every tap have
start-date
? Is there any easy way to validate this beside try to find it in the code (I did look into some and tbh can't find it ? Thanks everyone
e
Hi @ly_pham waves , 1. According to the docs:
Meltano stores this pipeline state in its system database, identified by the meltano elt run's Job ID.
2. Just like in singer, the state for each stream is stored in its own key in the state object, and that object is stored in the db. 3. Not every tap has a
start_date
setting. The ones that support it should be documenting it. For example, tap-google-analytics and tap-stripe both document it.
l
thanks. I will have a look