https://linen.dev logo
Join Slack
Powered by
hey yall, recieving the error below when running `...
# getting-started
k
hey yall, recieving the error below when running 
meltano elt tap-hellobatontarget-snowflake
. This happened after merging in https://github.com/dluftspring/tap-hellobaton/pull/22 and doing a 
meltano install extractor tap-hellobaton --clean
. Any ideas anyone? Was working before reinstalling. that pr just adds a new json field to the json file in schemas.
Copy code
2023-03-07T16:49:13.015707Z [info     ]   File "/home/ubuntu/repos/lane-meltano/.meltano/loaders/target-snowflake/venv/lib/python3.8/site-packages/snowflake/connector/network.py", line 865, in _request_exec cmd_type=loader name=target-snowflake run_id=686c0813-25d4-484f-9103-4c5b17a51775 state_id=2023-03-07T164858--tap-hellobaton--target-snowflake stdio=stderr
2023-03-07T16:49:13.015875Z [info     ]     raise RetryRequest(err)    cmd_type=loader name=target-snowflake run_id=686c0813-25d4-484f-9103-4c5b17a51775 state_id=2023-03-07T164858--tap-hellobaton--target-snowflake stdio=stderr
2023-03-07T16:49:13.016043Z [info     ] snowflake.connector.network.RetryRequest: could not find io module state (interpreter shutdown?) cmd_type=loader name=target-snowflake run_id=686c0813-25d4-484f-9103-4c5b17a51775 state_id=2023-03-07T164858--tap-hellobaton--target-snowflake stdio=stderr
2023-03-07T16:49:13.057537Z [info     ] time=2023-03-07 16:49:13 name=tap-hellobaton level=INFO message=INFO METRIC: {'type': 'timer', 'metric': 'http_request_duration', 'value': 0.420433, 'tags': {'endpoint': '/activity/', 'http_status_code': 200, 'status': 'succeeded'}} cmd_type=extractor name=tap-hellobaton run_id=686c0813-25d4-484f-9103-4c5b17a51775 state_id=2023-03-07T164858--tap-hellobaton--target-snowflake stdio=stderr
2023-03-07T16:49:13.070368Z [error    ]
e
the error seems to be coming from snowflake (
snowflake.connector.network.RetryRequest
, https://github.com/snowflakedb/snowflake-connector-python/issues/145). Can you share your (redacted) 
meltano.yml
?
k
hey @edgar_ramirez_mondragon! so sorry fo rthe late response i seemed to hav emissed this. the meltano yml file is as follows:
Copy code
version: 1
send_anonymous_usage_stats: true
project_id: c817018d-de7b-45fb-9fff-260fa84ddaf9
plugins:
  extractors:
  
  - name: tap-essensys
    namespace: tap_essensys
    pip_url: <git+ssh://git@github.com/joinlane/tap-essensys.git>
    executable: tap-essensys
    settings:
    - name: username
      kind: string
    - name: password
      kind: password
    - name: client_secret
      kind: string
    - name: results_per_page
      kind: integer
    - name: user_agent
      kind: string
    - name: dev_mode
      kind: string
    config:
      user_agent: vts-data-extractor
      username: <mailto:zach.targos+tishmandata@vts.com|zach.targos+tishmandata@vts.com>
    load_schema: essensys

  - name: tap-hellobaton
    namespace: tap_hellobaton
    pip_url: git+<https://github.com/dluftspring/tap-hellobaton.git>
    executable: tap-hellobaton
    capabilities:
    - catalog
    - state
    - discover
    settings:
    - name: company
      kind: string
    - name: api_key
      kind: password
    - name: user_agent
      kind: string
    config:
      company: lane
      user_agent: Singer Tap for hellobaton
    schema:
      project_attachments:
        created_by:
          type: [string, 'null']
      time_entries:
        created_by:
          type: [string, 'null']
        user:
          type: [string, 'null']
      project_users:
        user:
          type: [string, 'null']
    load_schema: hellobaton

  - name: tap-hellobaton--inherited
    inherit_from: tap-hellobaton
    pip_url: git+<https://github.com/dluftspring/tap-hellobaton.git>
    executable: tap-hellobaton
    capabilities:
    - catalog
    - state
    - discover
    settings:
    - name: company
      kind: string
    - name: api_key
      kind: password
    - name: user_agent
      kind: string
    config:
      company: vtsrise
      user_agent: Singer Tap for hellobaton
    schema:
      activity:
        group:
          type: [string, 'null']
      time_entries:
        rate:
          hourly_rate:
            type: [string, 'null']
    load_schema: vts_hellobaton

  loaders:
  - name: target-snowflake
    variant: meltano
    pip_url: git+<https://gitlab.com/gitlab-data/edcast-target-snowflake>
    config:
      account: ***
      username: ***
      role: ***
      database: ***
      warehouse: ***
  - name: target-jsonl
    variant: andyh1203
    pip_url: target-jsonl
    config:
      destination_path: load/jsonl_target_tests
  orchestrators:
  - name: airflow
    pip_url: apache-airflow==2.1.2 --constraint <https://raw.githubusercontent.com/apache/airflow/constraints-2.1.2/constraints-${MELTANO__PYTHON_VERSION}.txt>
  files:
  - name: airflow
    pip_url: git+<https://gitlab.com/meltano/files-airflow.git>
e
So, nothing seems immediately off. Are you still running into the error?
k
hey @edgar_ramirez_mondragon I am unfortunately
hey @edgar_ramirez_mondragon! currently getting 
Detected SQLite 3.22.0, but Meltano requires at least 3.25.1. Upgrade your database to be compatible with Meltano or use a different database.
noticed you were involved in https://github.com/meltano/meltano/issues/6405 . What would be the best way to uprade the db? my pip installs wont work
e
Hi @kevin, the process to update sqlite depends on your OS and Python version. Are you on Ubuntu, Windows, macOS?
k
i am on mac! i think i got it figured out but ran into an auth issue with the target-snowflake install I posted here - https://meltano.slack.com/archives/CMN8HELB0/p1680052476582039 . Would you happen to know how to get by this? I never had to input any gitlab creds / PAT for the install. I followed some steps to create an account and generate a personal access token with 
read_repository
permissions but still couldn't get it to work!
Open in Slack
PreviousNext
Powered by