Hi, is there any way to get an api stream to depend on a queue to get ids and the stream continues to run popping one by one until queue becomes empty.

A queue like SQS or rabbitmq? You could try to override some of the methods in https://github.com/meltano/sdk/blob/main/singer_sdk/streams/core.py to get the partitions/contexts from the queue.

Hi @Edgar Ramírez (Arch.dev), sorry I meant queue data structure in code.

You might wanna look at https://sdk.meltano.com/en/v0.37.0/classes/singer_sdk.Stream.html#singer_sdk.Stream.generate_child_contexts

thanks @Edgar Ramírez (Arch.dev) looks like this can solve for parent-child relation objects. but I'm also trying to sync sibling types. like syncing undetermined number of folders by id fetched from array converted from string of os env.

Do create a feature request (or even better a PR :)) if the current API makes it hard to accomplish what you need