Hello, I am using VS code attached to a Meltano container to develop on my mac M1. Meltano only provides amd64 images on the docker hub, I don’t know if it is the root of the problem but it seems to have poor performances in my case. Each file operation that is instantaneous when run on my host machine takes like a few tenths of a second. I’m not a docker expert but I suspect that it is linked to how volumes are managed in docker for macos arm. Anyone has the same problem or has managed to fine tune their docker config to increase performance ?

I am experiencing something similar on my Mac with M1 chip, but I haven't gotten any good way of investigating this, because it's not like things take "forever" but yeah, things seem to take longer (especially parsing the mounted env file etc.). My solution: Switch over to development fully in codespaces.

It’s probably related to https://github.com/meltano/meltano/issues/7325

Indeed @edgar_ramirez_mondragon, I will change the .meltano location. The problem occurs also on git commits, file creations and also VS code plugin installations (but i’m not sure that it is related for the last one)

Hi guys, with @Stéphane Burwash We were able to get meltano 2.5 (python3.8) to run on M1 with a native arm64 build ! We would like to discuss with you on way to make it official so that we can get arm64 images for meltano !

Thanks @arthur_fournier! Awesome work 😄 cc @aj_steers @pat_nadolny ⬆️

@arthur_fournier That's awesome! We've got an issue open to support multi-arch Docker images for the official Meltano image, and we'd love if you'd be willing to open a PR with your changes to support arm64. Alternatively, if you have any findings from getting Meltano working on macOS arm64 that you'd like to share in the issue that'd be appreciated.

Hmmmm so I just did some modification on the Dockerfile, but I don't really know the procedure in CI for multiple arch build 🤔 So I can open a Pull request, but I will probably need some help on the docker build part :D

Thanks @arthur_fournier! I'll review that soon - no later than tomorrow

Hey @arthur_fournier, thanks for this arm version ! @Will Da Silva (Arch) is it possible to pull the arm64 version from docker hub yet ? I don’t see the arm64 platform in the tags list

@ken_payne could you please publish a new version of Meltano. @luis_ventura once that's done, the images for the new version will support arm64

oooh nice, so as we are still using the 2.5 version with python 3.8 will we get a arm64 build for it ? 😄

@arthur_fournier We don't currently make a habit of updating previously published Docker images. Technically Docker tags can be updated to point to new images at any time, but many people would be surprised and upset if we pushed a new image for the tag

v2.5

and it broke their workflow because e.g. transitive dependencies changed.

for that I need to ask @Stéphane Burwash he is our Meltano expert here ahah

@Will Da Silva (Arch) yes, but it's something that we plan on doing soon. This is a crutch I have been carrying for too long 😅 no need to retroactively create new images - we'll catch up and happily import the latest image with arm64 support

Meltano `v2.19.0` has been released 🎉 Its Docker images now support arm64 in addition to amd64: https://hub.docker.com/r/meltano/meltano/tags

@arthur_fournier congrats! This is awesome!

Nice, thanks a lot !!