<https://benn.substack.com/p/the-data-os> so, Melt...
# data-newst
taylor
09/03/2021, 5:40 PMhttps://benn.substack.com/p/the-data-os so, Meltano? 😏
v
visch
09/03/2021, 5:47 PMyes
visch
09/03/2021, 5:47 PMBest abstraction layer to date is singer
visch
09/03/2021, 5:48 PMPeople still don't see it, it'll be obvious in 10 years
t
taylor
09/03/2021, 5:48 PMhopefully before then 😅
v
visch
09/03/2021, 5:56 PMWe are at the innovators stage possibly
visch
09/03/2021, 5:56 PMProbably not even there yet
t
taylor
09/03/2021, 5:57 PMis this a graph of my Twitter followers??
v
visch
09/03/2021, 5:57 PMhahaha
visch
09/03/2021, 5:57 PMMy graph would look more like this _______________
t
taylor
09/03/2021, 5:57 PMneed more shit posting 😅
v
visch
09/03/2021, 6:01 PMhahaha maybe some day, fornow I"m ok with my little tribe that hears some random junk from me once a month or two.
Copy code
The second solution is extreme decentralization. I'm not, to be honest, entirely sure what this means. As best I can tell, it's a proposal for a shared open standard of communication between data tools, controlled by nobody but agreed to by everybody. While that sounds lovely, I'm skeptical we can pull it off. Data has long been a centralized asset, built for the boardroom down. Our historical starting point isn't a commonwealth to unify, but a monolith of executive reporting to break apart. Moreover, the data ecosystem just isn't that big. We probably don't need a complex, fully decentralized system for figuring out how to make a few thousand tools talk to each other.5visch
09/03/2021, 6:02 PMWell I guess I'm doing it but just haven't wrote directly to AD / Google with a target yet! I probably should though
visch
09/03/2021, 6:15 PMHome automation is another avenue I've been kicking around after talking to some folks
visch
09/03/2021, 6:15 PMI'm not really into it, but it seems like they have a bunch of integration issues as well
t
taylor
09/03/2021, 6:22 PMDouwe and I were talking about that as well. HomeBridge and Home Assistant are two popular ones
v
visch
09/03/2021, 6:24 PMI use ynab which struggles from the same stuff, they need a tap for every credit union / bank, and there's the few big integrators that manage them all
visch
09/03/2021, 6:25 PMPretty sure you have been pondering that one too, curious stuff! Traction will be found
visch
09/03/2021, 6:27 PMGotta keep trying!
I'm seeing a bunch of the internal issues between teams that exists with ETLs at big orgs. The cool part is Meltano/DBT is a great fit even in a siloed org, each silo should have their own setup
visch
09/03/2021, 6:27 PMHard part for me is making sure I"m not seeing every problem as a nail / hammer with meltano/dbt
4 Views