Just finished building my first custom tap! Now I’m to the part I’ve been dreading…. getting it to run in production. My company uses GCP, but we don’t currently have any existing infrastructure like K8s or Airflow or anything else we can leverage so I’m starting from scratch. I would strongly prefer to just use a hosted Meltano that could import my custom tap, but I’m not finding many options. Some searching in this slack space mentioned singerly.co, but it looks like a very immature product (blog link is empty, feature request links to a different product). Don’t think I want to get started there. I’m loathe to build out my own infrastructure just to support this one custom tap. Any other options out there I should be aware of? How close is a hosted version of Meltano? I’m thinking about spinning up a small GCE server and running Meltano as CRON job without a DB backend and manual git pull’s just to get by until something more long term can work. But those quick-and-dirty “temporary” solutions tend to live much longer than we’d like 😬

Is the data sensitive? You could consider using GitHub CI with scheduled workflows if you just want a single tap->target flow.

It doesn’t contain PII or HIPPA data, but it does contain IP, so it is sensitive.

If you are already using Gitlab CI for data of similar sensitivity, that might be a path forward. Optionally, I think you can hide logs and CI artifacts to be private. And otherwise... our Meltano-managed service is still a little ways off but it you'll be able to sign up for the waitlist shortly. There are lots of other approaches using GCP or another hosting provider. Many users will create a Dockerfile for their project, which eases deployment to environments like GCP.

Know of any solid simple deployment walkthroughs out there? I can build a container, but preferably I wouldn’t want to have to set up Postgres, Airflow….

Hi @sterling_paramore, this sounds like something we can help with! Check out matatika.com and feel free to try out our app, which uses Meltano behind the scenes. Let us know how you get on! 😁

Hi @sterling_paramore please DM me if you'd be up for a chat about a hosted solution. I'd love to hear what you need - we’re aiming to help users who don't want to manage all the infrastructure, but love meltano because they might in the future and not need us anymore!