Pre compiled / single executable for meltano proje...
# best-practices
v
Pre compiled / single executable for meltano project? Right now the containers have to be kind of big because you need to include a c compiler in them (very big on Windows because of this). I don't really care that the size is huge, I care that it takes so long to iterate to make new changes. I can get around this (as once I get the right compiler setup the correct docker layers should make my iterations faster) but it'd be even nicer to not have to include a c compiler in the docker containers I use in prod. It'd also be really great to not have a dependency on the internet for a container. I don't care too much about this, but again the iteration time from when I can get running goes down significantly if I can reduce complexity
w
I can imagine a path forward where we have images for
meltano
and
meltano-slim
, where the former includes the whole build tool chain that you'd need to install most Python programs, and the latter is only likely to work for Python packages that have few to no system dependencies, and come packaged as a wheel (or zipapp if/when Meltano supports that, and the Hub hosts them).
v
I have no idea why this comment posted, I wrote it like 3 months ago and then forgot about it.
w
A nice reminder for me to open an issue about
meltano-slim
in any case
v
Got it, yeah I think I still like "precompiling" all the taps/targets with something like zipapps before better, but there's all the problems around that (versioning, when to upgrade or not, etc) that pip already solves that makes it hard to want to jump for
w