Hi, I am trying to pull ZOOM data, which is hierar...
# singer-tap-development
s
Hi, I am trying to pull ZOOM data, which is hierarchical. A sample extract is Get users, Pass userid to Child Stream. I want to check if I have 300 records in a call from a parent, and I want to GET all these 300 for Child parallel as they are independent calls. Do we have any similar implementation available in Melatno or any custom implementation that has this?
r
So you want to make 1 request with all user IDs instead of 300 with a single user ID each? I've done something like this here: https://github.com/Matatika/tap-spotify/blob/master/tap_spotify/streams.py#L41:L94
s
It’s more like 300 child api calls in parallel each with userid we got from parent , can be x parallel calls no necessary 300.
r
Ah, right. I don't think there is a way through Meltano, it would have to be a custom implementation like you say. Have you had a look through Meltano/SDK repo issues?
s
Yes there is a one PR for parallel streams few open issues for this use case , I believe community is fiddling with it ,not sure if someone has figured it out.
👍 1