https://linen.dev logo
#singer-tap-development
Title
# singer-tap-development
p

prratek_ramchandani

02/04/2022, 3:19 PM
I'm building a tap for Instagram that has a parent stream for media objects and a child stream for insights on those objects. Neither support request params that would enable incremental replication so it's a full refresh each time, but when fetching insights for a really old media object FB returns a 400 for only the insights stream if the piece of media was created before the account was converted from personal to business. I'd like to just skip these rows and maybe log a warning instead of having the tap fail and just wanted a gut check on whether my approach makes sense. does overriding
validate_response()
and
parse_response()
like i did in the attached snippet seem like the recommended move here?