Hi everyone, I'm trying to setup meltano as a SaaS...
# getting-started
m
Hi everyone, I'm trying to setup meltano as a SaaS where users can manage their own pipelines. I've a few questions about that. 1. Is there user management/authentication in meltano? I want to make meltano web UI accessible publicly but I can't seem to find any user authorization mechanism in meltano. For example, I'm using airflow as orchestrator which has its own user authorization but airflow is just a scheduler and cannot be used to create new pipelines. 2. If there's no such user authorization in Meltano then is there a way to achieve this purpose so that meltano web ui can be made accessible securely. 3. How does one properly kill a running pipeline job (ran through meltano web ui scheduling) so that it's state is updated automatically both in meltano web ui and airflow web ui.
a
Cool idea. Seriously! A couple of years ago we had a similar thought - data analysts could do so much more with a hugely flexible platform. Imagine modelling + elt + analytics, notebooks, orchestration all in one platform. Then we stumbled upon meltano - awesome! That's it! We've made some contributions, built various end to end models, considered adopting the ui as a project to enhance and along the way realised just how hard it is to make a platform straight forward enough for data analysts, esp, those who don't want to be engineers. Meanwhile meltano themselves realised the data engineers needed better foundations too (my take by the way) My advice, dive into the code. The UI has some of the things you need to create a SaaS and the Singerly guys have created a great platform with the meltano + airflow stack - https://www.singerly.co I have opinions on what would be even better! Happy to share if you wanted to meet on a call.
m
Yea a call sounds great
What's your availability like
a
I'll DM you