Hi All , Do we have any tap that show case generic...
# getting-started
s
Hi All , Do we have any tap that show case generic stream class and implemented parent child streams.
e
There's a bunch of public examples https://github.com/search?q=language%3APython+NOT+is%3Afork+NOT+repo%3Ameltano%2Fsdk+parent_stream_type&type=code. I'm curious what you are looking for in particular in an implementation?
s
I am trying to expand rest-api tap to adapt to parent child streams, I see that we can achieve the same by adding stream parent and get-child-context . I was able to test initial run with hardcoded values but I am stuck with get-child-context to use dynamic values from config its fails with undefined type when I invoke the tap . So I was wondering if there are any implementations already
e
So you're trying to adapt tap-rest-api-msdk to use parent-child streams? If so, it's probably waaay easier to just implement the tap for the API from scratch 😅
s
Can’t agree more 😁 but we have a lot of use cases and I don’t want to keep on creating tap for each use case. This use case are as small as 2 to 3 endpoints for each . Building taps will get crowded overtime
On top of your head do you feel this impossible, I am ok if a lot of skill needed to get this done I can get that figured out with help . Do you feel there are any blockers which makes it simpler to ignore and move on with tap building.
v
https://hub.meltano.com/extractors there's a reason there's 600 taps on this site and they aren't all rest-api taps
e
On top of your head do you feel this impossible
No, probably not impossible but it's hard to anticipate how much refactoring would be needed
1
And also how complex the resulting configuration would need to be, but if that's limited to your fork it's fine
👍 2