Heyo :wave:
What's a good method to process indepe...
# best-practiceso
Oscar Gullberg
11/18/2024, 2:28 PMHeyo 👋
What's a good method to process independent streams in parallel?
v
visch
11/18/2024, 2:32 PMWhat have you tried? I use select filters, but your question needs more context!
o
Oscar Gullberg
11/18/2024, 2:36 PMHaven't tried anything yet but thought about trying that too (multiple instances of the tap with different select filters)
Oscar Gullberg
11/18/2024, 2:36 PMThought there might be some kind of support for it in the tap SDK
v
visch
11/18/2024, 3:42 PMHaven't tried anything yet but thought about trying that too (multiple instances of the tap with different select filters)Select filters can by dynamic with env vars as well
Thought there might be some kind of support for it in the tap SDKYou can run multiple requests in paraellel but nothing async done yet, there is an issue here you can upvote https://github.com/meltano/sdk/issues/183
âž• 2
🙌 1
10 Views