Hello! I also have an error with `target-snowflak...
# troubleshooting
f
Hello! I also have an error with
target-snowflake
, using pipelinewise’s variant:
Copy code
Loading failed                 code=-11
ELT could not be completed: Loader failed
I’m using Python 3.10.11, and also tried 3.10.1 without success. The logs (even in debug mode) give 0 indication 🥲
Data gets loaded, but everything crashes at the end. Not sure what happens there. The loader works when using
meltano invoke snowflake-target
r
meltano elt
is quite old now. Have you tried with
meltano run
?
Copy code
meltano --log-level debug run tap-slack target-snowflake
Otherwise (you may have already tried this), separate out just the target process like
Copy code
# redirect tap stdout to file
meltano invoke tap-slack > tap.out

# pipe tap stdout from file to target
cat tap.out | meltano --log-level debug invoke target-snowflake
f
Same issue with
meltano run
(see screenshot) I didn’t try splitting the processes, and turns out it’s working... I’m not sure I should be happy about that 😅 It confirms the fact that the data is indeed correctly sent to Snowflake - but something when ending the
run
process crashes
r
Yeah, I agree. 😅 Could very well be an bug if you did manage to get the data loading the
meltano invoke
way. Unless someone else has any suggestions, I would probably open an issue.
e
Hi @florian_ernst! Have you loaded using a different tap before using tap-slack? I wonder if it’s a bug in the interaction between tap-slack and target-snowflake that’s not handled correctly. If a different tap works, that’d be an indication that it’s a problem with the target that Meltano is failing to surface 🙂
f
Same issue with the
tap-csv
tap 🥲 It works well when doing
meltano invoke tap-csv | meltano invoke target-snowflake
, but
meltano run tap-csv target-snowflake
fails.
I opened an issue here
The issue was
target-snowflake
’s Pyarrow version, which was stuck to 8.0.0 - a version known to randomly fail for some people