good article from tristan’s roundup. meltano menti...
# data-news
s
good article from tristan’s roundup. meltano mentioned a couple times, around missteps that Stitch made in managing the Singer community : https://towardsdatascience.com/how-to-become-the-next-30-billion-data-company-1204751de54f
v
Nice read! #14
But once we get a general layer wrapping data sources & targets, I think a big change will happen in the data realm.
My feeling is that this will never happen in the "wrapper" everyone's thinking, people have been saying this and building companies around it for ages. Progress will be made when people give up on that dream. The reason is actually really simple why a simple wrapper can't work but no one wants to accept it. "Companies use products differently because companies are different" The traditional "wrapper" assumes products are used the same way across all companies.
s
Agreed. I think there’s two challenges that make it hard to “wrap” data assets — translation and versioning. Unlike with “wrapping” the creation of a postgres database, you can’t make a guarantee that the Salesforce (e.g.) data schema isn’t going to change, which makes it hard to build on top of. And to your point — if you’re extracting an intermediate schema to map source-to-destination, there’s lots of subtle decisions you have to make, and companies will want to make differnt decisions based on their use case
t
allows a sidekick called Gitlab
😒
@stephen_bailey can you share the link for the DSR this week? I seemed to have deleted it from my inbox by mistake
This is a great article though and highlights many of the challenges in open source. I'm interested in the Prefect hybrid model b/c I can see that working for some companies 🤔
s
j
Sorry if this question hits a little too close to home, but I’ve been wondering for a while now (related to the question they posted in this article) What is Gitlab’s view of Meltano’s future? How involved will they be up to what point? Feel free to provide me a link to a blog article that I’ve probably missed on this topic. I’d really like to see Meltano succeed! I’m a huge fan already. However, I know from personal experience, having been an entrepreneur in a previous startup that had a parent company that didn’t really believe in us, it can be hard. They cut us loose at the first sign of difficulty primarily, I feel, because they were in such a different business they couldn’t/wouldn’t understand us.
t
@josh_lloyd come to office hours on June 30 and we'll answer your question in detail 😁