This is pretty cool…. <https://octo.github.com/pro...
# data-newst
taylor
05/18/2021, 7:16 PMThis is pretty cool…. https://octo.github.com/projects/flat-data
e
edgar_ramirez_mondragon
05/18/2021, 7:45 PMpeople working on covid datasets last year would've loved this
v
visch
05/18/2021, 8:38 PMyet another tool! I like that they are at least doing something somewhat new and not just reimplementing stuff.
Git scraping as a concept is semi interesting, it's kinda like an implementation of IPFS for HTTP. There's certainly some new things that will come from "Web 3.0" and the ideas of immutability and security. It's pretty unclear how it'll all come together.
t
taylor
05/18/2021, 8:41 PMI mean, they straight up took this from Simon (they mention him at the bottom) and kind of just put some polish around it
v
visch
05/18/2021, 8:41 PMhahaha alright maybe it's not new enough to warrant any credit
visch
05/18/2021, 8:42 PMPipelines have been done in a ridiculous number of ways too, add another to the list
a
al_whatmough
05/19/2021, 5:52 AMI actually had some silly idea that it'd be nice to implement a front end for Meltano inspired by Yahoo! Pipes. I dislike GUIs for ETL/ELT as much as the next person, but I actually thought a UI for designing the steps (extractors, transforms in dbt, targets, and scheduling) which then auto generates the config would be quite useful 😛
10 Views