Are there any examples of taps developed using the...
# singer-tap-development
j
Are there any examples of taps developed using the SDK that use a pre-existing python packages. Specifically I am looking to use this https://mws.readthedocs.io/en/latest/orders.html ?
p
I have one that uses the Stripe library and can share later today.
j
That would be great @prratek_ramchandani. I'm just looking for inspiration to make sure I'm on the right track
p
this is still a WIP but here you go https://github.com/prratek/tap-stripe
j
Nice one 🙂
p
Thanks! If it helps I selected the “custom” API and auth types during setup instead of going with one of the template options like REST + oAuth
j
Great I did the same. Are you making a Stripe Tap to learn about using the SDK?
p
To learn about the SDK and because Stripe is one of our most important data sources. The product team is often using new features, which means we need to ingest data from streams that the singer variant may not support yet. Figured I’d rather build a tap with the SDK than use a fork of that one and keep making PRs for new streams and schema fields.
j
Interesting. I need to do some work with Stripe so happy to contribute where I can
p
Any contributions are welcome! Do you work with Stripe today? Honestly the most tedious part has been fully fleshing out the schemas - to be able to load to a BigQuery target you typically need to specify the types of nested fields as well and using something like singer-infer-schema will only get be the schema for fields seen in my data, which often doesn’t include a number of additional fields the Stripe API could return if the account in question is using them (but in my case are just always null)
j
We use Stripe but currently have nothing set up to extract the data from the API yet. It's on my list of things to do. I'll be loading it to BiqQuery as well
p
Cool - feel free to hit me up with questions. We’re using a custom Python DAG (w/ Airflow) at the moment but I’m hoping to move over to this tap soon.