I have a general question around same issue - I am trying to download a few csvs from an s3 bucket. I chose to use the Amazon-S3-CSV tap. I installed the tap but not sure where to go next. My two questions are 1) is this the right tap to use for a CSV in an s3 bucket? Or something better? And 2) very important question to me overall - I never know how to fill out the YAML. Since it's considered a custom tap it gave me a very bare yaml. When I go to the GitHub for the tap, there's just some .json stuff. What is the best way to get a base template for a tap? Thanks!

Hey @greg_vaslo - I've used pipelinewise-tap-s3-csv but I know theres also tap-spreadsheets-anywhere I honestly dont know which one is better since I havent used spreadsheets anywhere, although I've heard good things. Here is a reference to a custom plugin yaml config https://docs.meltano.com/tutorials/custom-extractor#add-the-plugin-to-your-meltano-project. In the near future you will be able to install all of the MeltanoHub taps/targets directly into your meltano.yml via the CLI so this will be much easier! Here the issue for that https://gitlab.com/meltano/meltano/-/issues/3283

Thanks for this advice - I am going to have to use the spreadsheets tap anyway because I have data pulled from spreadsheets that people send me, so let me kill two birds with one stone by trying that upload next - can't wait for those template updates, will be so helpful for people doing data engineering on the side like me!