is there anything like a general tap-aws-service t...
# singer-tap-developmentm
Matt Menzenski
03/10/2023, 4:45 PMis there anything like a general tap-aws-service template? I’ve been looking at https://github.com/MeltanoLabs/tap-cloudwatch as inspiration because I want to try building taps for AWS Glue, AWS QuickSight, and AWS Pinpoint (and maybe others) and had the thought that it could be really nice to have an extension of the SDK that provided the boto3 dependency and exposed a standard authentication configuration for AWS services.
v
visch
03/10/2023, 4:46 PMMaybe just a
tap-awsvisch
03/10/2023, 4:47 PMI've seen this with other services, it works pretty well to just combine them all. Then you use
selectm
Matt Menzenski
03/10/2023, 4:52 PMoh man - i feel like
tap-awsMatt Menzenski
03/10/2023, 4:53 PMI feel like
tap-salesforceselectMatt Menzenski
03/10/2023, 4:53 PMthinkspin
Matt Menzenski
03/10/2023, 4:55 PMpart of my question is motivated by our migration of Meltano from GitHub actions (where we provide it with AWS access key and secret via environment variables) to Argo Workflows in kubernetes (where it will use a kubernetes ServiceAccount to assume an AWS IAM role with necessary access privileges). I’m having to do some testing and might have to make some changes in the taps to use the AWS_WEB_IDENTITY_TOKEN_FILE credential that comes with the IAM role.
v
visch
03/10/2023, 5:00 PMYou can start with just supported a few of them and slowly add 🤷 😄
m
Matt Menzenski
03/10/2023, 5:00 PMyeah, for sure
Matt Menzenski
03/10/2023, 5:00 PMthanks for the thought! it’s a good one
a
aaronsteers
03/10/2023, 5:04 PMit could be really nice to have an extension of the SDK that provided the boto3 dependency and exposed a standard authentication configuration for AWS servicesI love this idea. While a tap to get any AWS service would be really hard, it would not be very hard to create a generic AWS authenticator class in the SDK.
aaronsteers
03/10/2023, 5:05 PMIf you know me by now, you can guess I'm gonna log an issue on this 😄
aaronsteers
03/10/2023, 5:05 PMbrb
m
Matt Menzenski
03/10/2023, 5:05 PMmeaning, REST vs GraphQL vs AWS authenticator types, etc?
Matt Menzenski
03/10/2023, 5:05 PMI really like that too
a
aaronsteers
03/10/2023, 5:09 PMaaronsteers
03/10/2023, 5:16 PMcc @edgar_ramirez_mondragon 🙂 👆