I want to compliment the Meltano for the design of...
# announcementss
srini_kadamati__apache_superset_
08/07/2020, 3:35 PMI want to compliment the Meltano for the design of the system. I love the borrowing from Unix metaphors, lots of pipes and files. I can open an entire Meltano project in Sublime text and get a full system view ☀️
d
douwe_maan
08/07/2020, 3:36 PM"<anything> as code" ftw!
douwe_maan
08/07/2020, 3:37 PMSpeaking of opening everything in an editor and getting a full system view, this: https://gitlab.com/meltano/meltano/-/issues/2211 will enable validation and autocompletion for
meltano.ymls
srini_kadamati__apache_superset_
08/07/2020, 3:37 PMits great! Like I can do everything in “local mode” first. I’ve used tools like Pachyderm or other docker heavy reliant stuff and that approach is good for production but man is it a pain in the ass for a data hacker like myself to iterate and test stuff out quickly!
srini_kadamati__apache_superset_
08/07/2020, 3:38 PMI also need to play with the Meltano UI a bit more. Ultimately, all this stuff is passing data around and the metaphors are nicely setup for a powerful GUI for 80% of use cases!
d
douwe_maan
08/07/2020, 3:38 PMGlad to hear you're enjoying it 🙂 And the nice thing is that once you want to get it up in production, you can easily containerize it all and replicate the same setup you got working locally: https://meltano.com/#containerization
s
srini_kadamati__apache_superset_
08/07/2020, 3:38 PMyeah once I build out a few more pipelines, docker and airflow to aws is next!
4 Views