Does anyone have any suggestions on how to extract data from an on premise data source? I'm thinking about retooling our current setup to actually extend our GCP network to the on premise network via CloudVPN, but I wanted to see if anyone else had any suggestions on how they normally do this.
Thank you!
s
stephen_lloyd
07/29/2021, 1:00 PM
SSH server with specific IPs white-listed. I think this is how Stitch, Fivetran typically enable connections to sources in an AWS VPC, for instance.
v
visch
07/29/2021, 1:01 PM
Stephen beat me! But here's this anyway 😄
You can run Meltano on prem, and push the data off prem. That's probably the easiest.
Past that you're into doing a VPN / SSH tunnel of some sort for your GCP network to reach out to you. There's no easy tools on the Meltano side built for helping with that.
All the cloud providers really want to hook into On Prem data so they all have a bunch of ways to do it
r
ricky_renner
07/29/2021, 1:05 PM
Thanks @stephen_lloyd@visch! Yeah these were a few of the options that we were exploring, so just wanted to see what worked best for different folks.