Hi <@U06CASRQ0H0> , are there plans to make write ...
# singer-tap-development
s
Hi @Edgar Ramírez (Arch.dev) , are there plans to make write state message override, I am able to make parallel calls for child using process but the only catch I have is state is created and destroyed in each process to keep state I have to return state in each process merge them and send to write message to add it to current state. Are there any other options apart from using write state message to sync state message for child streams.
e
state is created and destroyed in each process to keep state
Where does this happen in the SDK codebase?
s
Its implicit in SDK , What i am trying to do is .
Call Parallel from Parent stream response for each page so that I can send a burst of calls as my Child API can handle 1800 calls/sec
e
So what changes would the SDK need to do in order to support this pattern?
s
As everytime we create a process its resources are local to it
tap_state is not updated in the main process
I have tried returning 2 objects which are maintained at tap level
Untitled
stream.tap_state and stream._sync_costs
I need to update this with the tap object in Main Process to keep all the state emitted in Parallel Process