Hello! I'm trying to run a pipeline that will down...
# troubleshooting
m
Hello! I'm trying to run a pipeline that will download data from S3 and add it to snowflake. tap-s3-extractor is configured and the tests pass successfully, it looks like there is an error somewhere in the target-snowflake configuration - is there anyone here who has gone through such a configuration and would be able to guide me to the correct solution? Below is a fragment of the log with an error:
Copy code
2023-09-28T13:29:59.553077Z [error] Loader failed
2023-09-28T13:29:59.553463Z [error] Block run completed. block_type=ExtractLoadBlocks err=RunnerError('Loader failed') exit_codes={<PluginType.LOADERS: 'loaders'>: 1} set_number=0 success=False
e
Hi @mateusz_garbacz! Which variant of target-snowflake are you using?
m
Hi @edgar_ramirez_mondragon! I'm using meltanolabs variant
m
error.txt
This is a full stack trace with debug on
export MELTANO_CLI_LOG_LEVEL=debug
we are trying to access snowflake using private key, not sure if this is relevant for this error
Okay we solved that error but that was far from straightforward. The issue was in the config where we set
dbname
instead of
database
Those two are very likely to be mixed together and it is not obvious what is the difference between them on the first glace.
e
Thanks for letting us know you solved it. I can't see a
dbname
setting for target-snowflake in its Hub page not its github readme. That should've definitely given a better error message.