I am trying to use the Snowflake loader Variant da...
# troubleshootingc
carolus_holman
10/15/2021, 2:47 PMI am trying to use the Snowflake loader Variant datamill-co, and I am getting many errors, I tried using the default, but it needed a filetype entry, and was causing issues. Scanned the docs, but unsure of which Loader is the best, easiest to use for a POC, thanks.
Copy code
meltano add loader target-snowflake --variant datamill-coa
aaronsteers
10/15/2021, 4:14 PMWe are actually just in the middle of switching the default variant to the Wise (pipelinewise) version: https://github.com/transferwise/pipelinewise-target-snowflake I've logged an issue there in the pipelinewise repo to hopefully use a config-based file_type instead of requiring it to be pre-created.
aaronsteers
10/15/2021, 4:16 PMFor the POC, if you are able to precreate a FILE_TYPE, that should get you through the hurdle you ran into with the pipelinewise tap. But otherwise, the DataMill variant doesn't require the FILE_TYPE object pre-created, but I think it does require pre-installing some postgres libs on your machine.
aaronsteers
10/15/2021, 4:17 PMcc @taylor , @pat_nadolny
p
pablo_seibelt
10/18/2021, 1:19 PMAn issue i had with Snowflake, either variant, is that i didn't have the right permissions for the taps, and the error messages were not very helpful
t
taylor
10/18/2021, 1:34 PMYeah, that’s a consistent challenge I’ve had with Snowflake no matter the context. Security through obscure errors it seems .
p
pablo_seibelt
10/18/2021, 2:22 PMIn my case however it was that both taps were not showing me the actual error, so i had to debug in which query it was failing and then i found out i messed up with permissions
14 Views