<!channel> Last week, it was once again my turn to host a GitLab Group Conversation (a publicly live streamed Q&A on the GitLab Unfiltered YouTube channel) on Meltano! I used the opportunity to share a recap of: • the 7 releases we’ve had since the last update 2 months ago, • 17 recent contributions made by 11 community members, • recent weekly Slack activity, • other exciting recent and ongoing developments (including the brand-new Singer SDK and plans to hire community contributors onto the team at GitLab), • this week’s priorities, and • a list of upcoming priorities. If you’re curious, check out the presentation on Google Slides and on YouTube. The presentation content is also reproduced on the blog: https://meltano.com/blog/2021/01/18/building-meltano-in-public-bimonthly-recap/ Slack Conversation

Just checking back in on the project... looks like you're making great progress, SDK would be sweet! Seems like there should be a market for a Kubernetes-off-the-shelf solution. It appears at least companies are prepared to shell out for dbt-cloud on-prem for data privacy reasons although that is higher up the stack. For a hosted offering, I would imagine a lot of Snowflake pre-sales engineers would point prospects your way if you had solid Oracle/Sql Server integrations. Price point would probably need to be fixed as opposed to consumption based so that costs are more predictable than Fivetran. A typical solution might be Meltano-Cloud CDC Oracle plus a few heavy usage/ custom taps, then Fivetran for some of the long tail not yet high enough quality singer taps. Fivetran is rarely the only ELT tool companies use. Maybe the CDC code is under a different licence, but would reassure companies using it that they can debug and hotfix in a pinch, something more difficult to do with Fivetran. Also investigating a Firebolt.io target (which Firebolt themselves should build) might be an idea, as they are the up-and-coming low-cost snowflake though still immature. If gitlab get acquired, Meltano could also be a nice spin-off to Snowflake.... end of thought stream!

@jolly-book-79428 Thanks for the brain dump, I appreciate it 😄 As it happens, I just heard yesterday that @rhythmic-iron-98827 and team are building a hosted Meltano platform as we speak, exactly because the deployment step is often the trickiest to figure out for data engineers without extensive DevOps experience. I'm sure he'd love to give some more context on what they're working on. As for SQL Server, there's been some discussion on that in https://gitlab.com/meltano/meltano/-/issues/1175, but no one has stepped up yet to verify that https://github.com/wintersrd/pipelinewise-tap-mssql works as expected and can be added out of the box. Any chance that's something you'd like to look into? 🙂 We don't have an issue yet about out-of-the-box Oracle support, but I invite you to create one! There's https://github.com/singer-io/tap-oracle and https://github.com/transferwise/pipelinewise-tap-oracle, so it may just be a matter of validating those work and adding it to

discovery.yml

. Either way, I like the idea of building a relationship with Snowflake pre-sales engineers and having them point users in the direction of Singer/Meltano/some hosted Meltano platform... Something I'll have to think on more in the coming quarters

good to hear there'll be a hosted version. AFAICT Fivetran invested a lot in building a scalable infra (using only log replication for reliability purposes), and one of the core building blocks (massively-scalable, reliable, cost effective messaging system) is now available off the shelf. Coupled maybe with GKE kNative, it seems like the building blocks are there without needing a massive amount of devops. Although I haven't actually researched Fivetran/Stitch's stack to know what makes sense/doesn't. https://streamnative.io/

Thanks @ripe-musician-59933. We’ll make an announcement here as soon as we have the beta ready