Hi, my use-case is to download a report (web page ...
# plugins-general
m
Hi, my use-case is to download a report (web page request using http header for auth returning a CSV) from Adyen. I do not want to use the (seemingly) stale Adyen tap. I found https://hub.meltano.com/extractors/tap-csv, which seems able to handle the CSV loading part. However: • How do I load the CSV from web page? ◦ Do I need to cURL (or equivalent) externally from Meltano first? Appreciate your support 🙂 Thanks in advance!
p
@magnus_avitsland have you tried https://github.com/sendinblue/singer-tap-adyen? It's not listed on the hub but is a fork of the Yoast variant listed and it has commits in the last few weeks. You should be able to just update the pip_url in your meltano.yml from the Yoast variant and run a
meltano install extractor tap-adyen --clean
.
UPDATE: the sendinblue variant is listed on the hub now 🚀! If you previously installed the Yoast variant then I'd run
meltano remove extractor tap-adyen
then
meltano add extractor tap-adyen --variant sendinblue
. Otherwise just the second command should work
I'll add that variant to the hub but if it works for you then we can make it the default moving forward.
Aside from that - your other options is totally valid too. If you have the option to make a curl command before running meltano then tap-csv should work fine.
e
I know https://hub.meltano.com/extractors/tap-spreadsheets-anywhere supports getting csvs from a URL
m
Thx, will look more into this on Monday. Isn’t the Adyen tap deprecated? Thought I saw it was very stale, but might be wrong…. :)
p
@magnus_avitsland the Yoast variant does look stale (although sometimes stale variants still work fine) but theres a sendinblue fork that has been adding features and doing maintenance with commits in the last 2 weeks so I'd give that one a shot.
Its not uncommon to see a fork overtake the main repo for some of these taps where potentially the original developers change jobs or just simply stop using it
m
Good to know @pat_nadolny, now I’ll just wait until Monday 😛
Finally Monday - yayyyyy!!!!
adyen-tap-testing day ftw!1
Hi again @pat_nadolny, that tap
adyen-tap--sendinblue
worked when we introduced
streams
. Thank you Pat!!
p
@magnus_avitsland great news! Just to clarify though, what do you mean by introduce streams? Did you need to fork the repo? If not I'll plan to make this sendinblue variant the new default
m
Hi again, sorry I meant the tap config
select
. Sry for being unclear 🙂