https://linen.dev logo
#singer-tap-development
Title
# singer-tap-development
m

Matt Menzenski

03/28/2023, 3:00 PM
what is the meltonic (is that a word?) way to split an array of objects (a REST response) into an Iterable[dict] in an SDK tap implementation, and do some minor transformation/flattening of those objects? I can set the
records_jsonpath = "$['results'][*]"
in my stream subclass and this seems to handle the splitting part, but it’s not obvious to me where the right place is to do the transform? For context, I’m working on porting the singer-io tap-pendo to the SDK, and I’m interested in this transform: https://github.com/singer-io/tap-pendo/blob/master/tap_pendo/streams.py#L757-L767