Hi Team , Is there a way to send data loaded from database as query parameters , I have 2 endpoints which give 300k records of meta data once I get this I have to query child endpoints passing this metadata as query patient. I can’t use parent child streams as it will take 24 hrs for meta data pull only adding more endpoints is never ending process.
So I am planning to get all meta data and store it in DB and then create new pipeline for child’s and pass all data received in first pull as a batch of 10k records. I am wondering how can we implement this and is there a better way to do it.