Hi everyone, I'm running into an issue with

target-snowflake

variant=

meltanolabs

and a custom Shopify GraphQL tap that we've built. While the tap works fine with target-jsonl, I'm getting the error "Loader failed, Block run completed." when loading into Snowflake. I've attached the relevant logs and config files. Any pointers or troubleshooting tips would be greatly appreciated! Thanks in advance!

can I ask you do the following to narrow down the problem:

meltano invoke tap-smoke-test > smoke.singer.jsonl
cat smoke.singer.jsonl | meltano invoke target-snowflake

and share the resulting output from the target.

Thanks @Edgar Ramírez (Arch.dev), here' the log output of the above command sequence.

Did that load the data correctly and that is all the logs?

That didn’t load the data; it just logged 'Initializing target sink for stream 'animals'...' and exited silently. Thats all it logged.

Could it be a typo?

warehour: MELTANA_WAREHOUR

instead

warehouse: MELTANA_WAREHOURE

Noops! 🥲

I hope it's just that and that fixes your problem, but it then means we need to look into why that would cause the behavior you're seeing

How could we do that? I can zip the codebase and share it with you, or would you prefer to get on a call with me, Chief?

but it then means we need to look into why that would cause the behavior you're seeing

Oh, by "we" here I mean myself and maybe other internal members of the Arch.dev team 😅 So, did addressing the typo fix the problem for you?

No, I corrected it and ran it again, but I'm seeing the same behavior.

Oh 😢, let's try then

LOGLEVEL=debug cat smoke.singer.jsonl | meltano invoke target-snowflake

and see if the target reveals some more details. By the way, I've tested that the same steps work with these settings:

# .env
TARGET_SNOWFLAKE_USER=...
TARGET_SNOWFLAKE_PASSWORD=...
TARGET_SNOWFLAKE_ACCOUNT=...
TARGET_SNOWFLAKE_DATABASE=...
TARGET_SNOWFLAKE_WAREHOUSE=...
TARGET_SNOWFLAKE_ROLE=...

# meltano.yml
plugins:
  loaders:
  - name: target-snowflake
    variant: meltanolabs
    pip_url: -e ..
    config:
      add_record_metadata: true
      default_target_schema: public

so maybe there's something different in your setup, but I haven't figured out what.

In my case, running

meltano invoke target-snowflake --initialize

did not save to the

.env

file. So, I created the

.env

file as you suggested above, and now it works. That was it! Thanks boss! Thank you so much, @Edgar Ramírez (Arch.dev) 🙏🏻😇

Oh wow, I'm glad you got it to work!!