Hello Can please somebody help with the target snowflake err Meltano #troubleshooting

Hello! Can please somebody help with the target-sn...

alexander_andreyanov

05/31/2023, 12:46 PM

Hello! Can please somebody help with the target-snowflake error: Run invocation could not be completed as block failed: Loader failed Cannot find anything related at the troubleshooting page.

edgar_ramirez_mondragon

05/31/2023, 12:54 PM

Hi @alexander_andreyanov! It seems like you need to specify a port.

edgar_ramirez_mondragon

05/31/2023, 12:57 PM

This seems to be a bug in target-snowflake cc @pat_nadolny @ken_payne

alexander_andreyanov

05/31/2023, 1:05 PM

@edgar_ramirez_mondragon could you please describe where are you find this? 🙂

alexander_andreyanov

05/31/2023, 1:08 PM

and also how can I specify a port? using snowflake meltanolabs variant, btw. https://hub.meltano.com/loaders/target-snowflake--meltanolabs/

edgar_ramirez_mondragon

05/31/2023, 1:39 PM

https://github.com/MeltanoLabs/target-snowflake/blob/86f5390f450c576be628250e294b926b0f44be18/target_snowflake/sinks.py#L86-L94

edgar_ramirez_mondragon

05/31/2023, 1:40 PM

However, I can't reproduce the error:

Copy code

>>> import sqlalchemy
>>> from snowflake.sqlalchemy import URL
>>> url = URL(account='21321423', user='edgar', password='secret', database='dev')
>>> sqlalchemy.create_engine(url=url, echo=False, connect_args={"session_parameters": {"QUOTED_IDENTIFIERS_IGNORE_CASE": "TRUE"}})
Engine(<snowflake://edgar>:***@21321423/dev)

edgar_ramirez_mondragon

05/31/2023, 2:58 PM

@alexander_andreyanov can you share your

meltano.yml

? (with secrets redacted)

alexander_andreyanov

05/31/2023, 3:05 PM

@edgar_ramirez_mondragon

Copy code

version: 1
default_environment: dev
project_id: ***
environments:
- name: dev
  config:
    plugins:
      loaders:
      - name: target-snowflake
        config:
          account: ***
          database: ***
          default_target_schema: MELTANO_TEST
          role: SYSADMIN
          schema: MELTANO_TEST
          user: ***
          warehouse: ***
      extractors:
      - name: tap-gitlab
        config:
          api_url: ***
          groups: Engineering
          ultimate_license: false
          fetch_merge_request_commits: true
          start_date: '2023-05-29T00:00:00Z'

alexander_andreyanov

05/31/2023, 3:58 PM

so, I’ve been able to run load with target-snowflake--transferwise loader, but they require lot more additional steps, for example creating custom file format, role, user for loader. How target-snowflake--meltanolabs handling this, because there are no any mentions about this in their “Getting started” guide…

alexander_andreyanov

05/31/2023, 4:21 PM

and seems like I fixed “_Loader failed”_ error, but this time i have “[Errno 32] Broken pipe”

Open in Slack

Previous Next