Hey everyone - I am having issues running Meltano ...
# getting-started
m
Hey everyone - I am having issues running Meltano with target-snowflake Here’s my setup • tap-mongodb (menzenski variant) • target-snowflake (transferwise varient) • Error message:
RuntimeError: Event loop is closed
• First image: running on mac m1 natively • Second and third images: running inside docker container with ubuntu setup I am consistently getting this error when running ELT on bigger tables. Has anyone had this problem? Is there a stable version of the target-snowflake connector out there?
t
Based on my searching in Slack this seems like it could be an asyncio error. You could test out the meltanolabs variant that we’ve been building https://hub.meltano.com/loaders/target-snowflake--meltanolabs/ but not sure if it has the same feature coverage that you’re needing from the transferwise variant. Tagging @Will Da Silva (Arch) b/c you were working on a related event loop error in the past.
d
From the logs, the error seems to be coming from Meltano itself rather than a tap, though. @matt_elgazar Can you try with a newer version of Python just to rule out already-fixed asyncio issues?
If that doesn't help, I'd try an older Meltano version (like a month back), to rule out issues there.
e
The pipelinewise loader is fairly reliable, so having a look at the logs above the start of the traceback might help. Maybe try setting a lower
batch_size_rows
, the container might be running OOM.
m
Hey guy I figured it out - thanks for the suggestions. I tried many different combinations and narrowed it down to the python MUST be version 3.10.X for target-snowflake (3.9.15 failed and 3.11.0 failed).
d
Ah great to hear it!