Hi we are running into a customer issue for tap snowflake wh Meltano #troubleshooting

Hi, we are running into a customer issue for tap-s...

nidhi_kakulawaram

11/02/2023, 6:17 PM

Hi, we are running into a customer issue for tap-snowflake where we are unable to validate configurations nor do imports. However, I am able to test select using meltano config custom-snowflake-tap test. Anyone have any ideas?

meltano select custom-snowflake-tap --list

is returning customer_schema-customer_table.* selected attributes However, when I run

meltano config custom-snowflake-tap test

, I get the error

Copy code

Plugin configuration is invalid
No RECORD message received

the configurations for your reference.

Copy code

- config:
      account: <redacted>
      database: CUSTOMER_DB
      password: <redacted>
      schema: customer_schema
      user: <redacted>
      warehouse: CUSTOMER_WH
      tables:
       - customer_schema.table_name
    inherit_from: tap-snowflake
    metadata: {}
    name: custom-snowflake-tap
    schema: {}
    select:
    - customer_schema-table_name.*
    select_filter: []

nidhi_kakulawaram

11/02/2023, 6:44 PM

For more context, here are the logs in debug mode for meltano config custom-snowflake-tap test. You can see that the schema is retrieved but following queries fail and get rolled back: ```2023-11-02T181822.151982Z [debug ] 2023-11-02 111822,151 | INFO | tap-snowflake | Beginning full_table sync of 'customer_schema-customer_table'... 2023-11-02T181822.152086Z [debug ] 2023-11-02 111822,151 | INFO | tap-snowflake | Tap has custom mapper. Using 1 provided map(s). 2023-11-02T181822.152160Z [debug ] {"type": "SCHEMA", "stream": "customer_schema-customer_table", "schema": {"properties": {"Paid Channel Group": {"type": ["string", "null"]}, "Paid Channel": {"type": ["string", "null"]}, "Date": {"format": "date", "type": ["string", "null"]}, "Ad Group Name": {"type": ["string", "null"]}, "Campaign Name": {"type": ["string", "null"]}, "Campaign Type": {"type": ["string", "null"]}, "Ad Final URLs": {"type": ["string", "null"]}, "Network": {"type": ["string", "null"]}, "Account Name": {"type": ["string", "null"]}, "Category": {"type": ["string", "null"]}, "Sub Category": {"type": ["string", "null"]}, "Device": {"type": ["string", "null"]}, "Headline Part 1": {"type": ["string", "null"]}, "Headline Part 2": {"type": ["string", "null"]}, "Description": {"type": ["string", "null"]}, "Impressions": {"type": ["number", "null"]}, "Clicks": {"type": ["number", "null"]}, "Ad Spend": {"type": ["number", "null"]}, "Conversions": {"type": ["number", "null"]}, "Revenue": {"type": ["number", "null"]}, "Leads": {"type": ["number", "null"]}}, "type": "object"}, "key_properties": []} 2023-11-02T181822.156288Z [debug ] 2023-11-02 111822,156 | INFO | snowflake.connector.connection | Snowflake Connector for Python Version: 3.2.0, Python Version: 3.10.12, Platform: macOS-13.0-arm64-arm-64bit 2023-11-02T181822.156462Z [debug ] 2023-11-02 111822,156 | INFO | snowflake.connector.connection | This connection is in OCSP Fail Open Mode. TLS Certificates would be checked for validity and revocation status. Any other Certificate Revocation related exceptions or OCSP Responder failures would be disregarded in favor of connectivity. 2023-11-02T181822.156541Z [debug ] 2023-11-02 111822,156 | INFO | snowflake.connector.connection | Setting use_openssl_only mode to False 2023-11-02T181822.901750Z [debug ] 2023-11-02 111822,901 | INFO | snowflake.connector.cursor | query: [select current_database(), current_schema();] 2023-11-02T181823.046943Z [debug ] 2023-11-02 111823,046 | INFO | snowflake.connector.cursor | query execution done 2023-11-02T181823.047050Z [debug ] 2023-11-02 111823,046 | INFO | snowflake.connector.cursor | Number of results in first chunk: 1 2023-11-02T181823.050682Z [debug ] 2023-11-02 111823,050 | INFO | snowflake.connector.cursor | query: [ROLLBACK] 2023-11-02T181823.210850Z [debug ] 2023-11-02 111823,210 | INFO | snowflake.connector.cursor | query execution done 2023-11-02T181823.210974Z [debug ] 2023-11-02 111823,210 | INFO | snowflake.connector.cursor | Number of results in first chunk: 1 2023-11-02T181823.211140Z [debug ] 2023-11-02 111823,210 | INFO | snowflake.connector.cursor | query: [ROLLBACK] 2023-11-02T181823.958796Z [debug ] 2023-11-02 111823,958 | INFO | snowflake.connector.cursor | query execution done 2023-11-02T181823.958873Z [debug ] 2023-11-02 111823,958 | INFO | snowflake.connector.cursor | Number of results in first chunk: 1 2023-11-02T181823.959051Z [debug ] 2023-11-02 111823,958 | INFO | snowflake.connector.cursor | query: [select current_database(), current_schema();] 2023-11-02T181824.086920Z [debug ] 2023-11-02 111824,086 | INFO | snowflake.connector.cursor | query execution done 2023-11-02T181824.087046Z [debug ] 2023-11-02 111824,086 | INFO | snowflake.connector.cursor | Number of results in first chunk: 1 2023-11-02T181824.087336Z [debug ] 2023-11-02 111824,087 | INFO | snowflake.connector…

Open in Slack

Previous Next