Meltano

```Hi All - New to meltano and looking for some advice. We have 1000+ Aurora Mysql Dbs and looking to replicate these (not real time) to S3 Data Lake for ML and Analytics use? Would Meltano self hosted be suitable for this? ```

yes

`meltano run tap-mysql target-s3`

Get one project going for 1 of the 1000. Then look into how to set vars with environment variables etc and you'll be cooking

So it is possible at this scale? and be manageable?

Everything is possible yes, I wouldn't hesitate myself but :shrug:  you do have to figure out how you want to manage it all which is really up to you.

Arch can help, but you said self hosted

Then do 5 manually and see what you want to do orchestration wise (there's infinite options all of which work fine, context matters a lot to make the choice here)