Anyone got any recommendations on taps for AWS logs ? (More just curious to see what exists out there than any particular purpose)

Our use-case is probably a little different, but I've found CloudWatch logs too clunky to be useful. Instead we send logs to Papertrail and then use their S3 integration to automatically archive them. It was relatively straightforward to set up Athena on top of that. We haven't needed the logs in the warehouse, but if we did we could just use an S3 tap or perhaps an Athena tap

@andrew_stewart - It would require direct access to your AWS account, and some technical gymnastics, but another option is to use Kinesis to stream data into S3 from Cloudwatch. I worked on something like this with @alvin_mwangi and @John Timeus (Slalom Consulting).

Ok, so sounds like it’s best to get data out of cloudwatch first.