Anyone ever come across a singer tap for AWS API’s...
# plugins-generala
andrew_stewart
04/06/2021, 6:28 PMAnyone ever come across a singer tap for AWS API’s, like the S3 API? Meaning, not to extract files from S3 but rather to run a bunch of GETs to retrieve things like lists of objects w/ metadata (file sizes, etc)?
Looked around a bit and haven’t found anything, but just curious to ask here. (Otherwise setting up AWS API logging to csv files in s3 and extracting those is the obvious alternative)
v
visch
04/06/2021, 6:44 PMI'm not certain this is what you're saying but check out https://github.com/ets/tap-spreadsheets-anywhere
You can run Discovery (metadata stuff) against s3 paths with that tap
visch
04/06/2021, 6:44 PMa
andrew_stewart
04/07/2021, 10:23 PMHmm, that could potentially be the start of a new tap for sure.
andrew_stewart
04/07/2021, 10:24 PM(basically consuming the discovery as the data )
v
visch
04/07/2021, 11:32 PMYeah it would work, I"m not sure about the use case though!