Is there a tap that works with CSV over HTTPS? `...
# plugins-generala
andrew_stewart
11/13/2020, 2:23 AMIs there a tap that works with CSV over HTTPS?
tap-spreadsheets-anywhered
douwe_maan
11/13/2020, 4:09 PM@andrew_stewart https://github.com/ets/tap-spreadsheets-anywhere uses https://github.com/RaRe-Technologies/smart_open, which supports HTTPS, but I'm not sure how you're expected to configure
pathnamepatterndouwe_maan
11/13/2020, 5:16 PMRE https://meltano.slack.com/archives/CFG3C3C66/p1605287658319800?thread_ts=1605232922.316200&cid=CFG3C3C66, if HTTPS is not actually supported, it should be removed from the README. Or would it be relatively easy to add, @eric_simmerman?
a
andrew_stewart
11/14/2020, 11:37 PMJust FYI, we’re working on this over at https://github.com/ets/tap-spreadsheets-anywhere/issues/2
andrew_stewart
11/14/2020, 11:37 PMWorking on a PR to add http/https support.
e
eric_simmerman
11/16/2020, 2:23 PMJust seeing this but Andrew and I corresponded over tickets on this one and made a commit that provides support for http/s now. Since we can’t reliably list files under a URL path - the named config block combination of path and pattern has to point to single target. Other than that - the protocol is supported like all the others.
a
andrew_stewart
11/16/2020, 7:04 PMThat was a nice little foray for me into the basics of singer taps. I have some other ideas I could contribute, depending how much functionality you think is appropriate to pack into this single tap.
andrew_stewart
11/16/2020, 7:05 PMMostly related to schema overrides due to working with some pesky xlsx formats.