Hello everyone! I am trying to run

meltano run tap-shopify target-clickhouse

I was able to configure the connection to Shopify but I am facing issues in Clickhouse. Meltano doesn't have

meltano config target-clickhouse test

for me to understand any errors. So when I run the pipeline, I am getting the following error:

2025-01-13T12:28:19.036210Z [info     ] ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host cmd_type=elb consumer=True job_name=dev:tap-shopify-to-target-clickhouse name=target-clickhouse producer=False run_id=05ce472f-e308-43bf-8d19-c1aeeb290bd4 stdio=stderr string_id=target-clickhouse
2025-01-13T12:28:19.036210Z [info     ]                                cmd_type=elb consumer=True job_name=dev:tap-shopify-to-target-clickhouse name=target-clickhouse producer=False run_id=05ce472f-e308-43bf-8d19-c1aeeb290bd4 stdio=stderr string_id=target-clickhouse
2025-01-13T12:28:19.036210Z [info     ] During handling of the above exception, another exception occurred: cmd_type=elb consumer=True job_name=dev:tap-shopify-to-target-clickhouse name=target-clickhouse producer=False run_id=05ce472f-e308-43bf-8d19-c1aeeb290bd4 stdio=stderr string_id=target-clickhouse
2025-01-13T12:28:19.050806Z [info     ]                                cmd_type=elb consumer=True job_name=dev:tap-shopify-to-target-clickhouse name=target-clickhouse producer=False run_id=05ce472f-e308-43bf-8d19-c1aeeb290bd4 stdio=stderr string_id=target-clickhouse
2025-01-13T12:28:19.068031Z [info     ] urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionResetError(10054, 'An existing connection was forcibly closed by the remote host', None, 10054, None)) cmd_type=elb consumer=True job_name=dev:tap-shopify-to-target-clickhouse name=target-clickhouse producer=False run_id=05ce472f-e308-43bf-8d19-c1aeeb290bd4 stdio=stderr string_id=target-clickhouse
2025-01-13T12:28:19.068031Z [info     ]                                cmd_type=elb consumer=True job_name=dev:tap-shopify-to-target-clickhouse name=target-clickhouse producer=False run_id=05ce472f-e308-43bf-8d19-c1aeeb290bd4 stdio=stderr string_id=target-clickhouse
2025-01-13T12:28:19.068031Z [info     ] During handling of the above exception, another exception occurred: cmd_type=elb consumer=True job_name=dev:tap-shopify-to-target-clickhouse name=target-clickhouse producer=False run_id=05ce472f-e308-43bf-8d19-c1aeeb290bd4 stdio=stderr string_id=target-clickhouse
2025-01-13T12:28:19.068031Z [info     ]                                cmd_type=elb consumer=True job_name=dev:tap-shopify-to-target-clickhouse name=target-clickhouse producer=False run_id=05ce472f-e308-43bf-8d19-c1aeeb290bd4 stdio=stderr string_id=target-clickhouse
2025-01-13T12:28:19.113807Z [info     ]     raise ConnectionError(err, request=request) cmd_type=elb consumer=True job_name=dev:tap-shopify-to-target-clickhouse name=target-clickhouse producer=False run_id=05ce472f-e308-43bf-8d19-c1aeeb290bd4 stdio=stderr string_id=target-clickhouse
2025-01-13T12:28:19.113807Z [info     ] requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(10054, 'An existing connection was forcibly closed by the remote host', None, 10054, None)) cmd_type=elb consumer=True job_name=dev:tap-shopify-to-target-clickhouse name=target-clickhouse producer=False run_id=05ce472f-e308-43bf-8d19-c1aeeb290bd4 stdio=stderr string_id=target-clickhouse
2025-01-13T12:28:19.113807Z [info     ] 2025-01-13 17:58:19,068 | INFO     | singer_sdk.metrics   | METRIC: {"type": "timer", "metric": "http_request_duration", "value": 0.538986, "tags": {"stream": "collects", "endpoint": "/collects.json", "http_status_code": 200, "status": "succeeded"}} cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-clickhouse name=tap-shopify producer=True run_id=05ce472f-e308-43bf-8d19-c1aeeb290bd4 stdio=stderr string_id=tap-shopify
2025-01-13T12:28:19.129431Z [info     ] 2025-01-13 17:58:19,082 | INFO     | singer_sdk.metrics   | METRIC: {"type": "counter", "metric": "http_request_count", "value": 1, "tags": {"stream": "collects", "endpoint": "/collects.json"}} cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-clickhouse name=tap-shopify producer=True run_id=05ce472f-e308-43bf-8d19-c1aeeb290bd4 stdio=stderr string_id=tap-shopify
2025-01-13T12:28:19.130359Z [info     ] 2025-01-13 17:58:19,082 | INFO     | singer_sdk.metrics   | METRIC: {"type": "timer", "metric": "sync_duration", "value": 0.553743839263916, "tags": {"stream": "collects", "context": {}, "status": "succeeded"}} cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-clickhouse name=tap-shopify producer=True run_id=05ce472f-e308-43bf-8d19-c1aeeb290bd4 stdio=stderr string_id=tap-shopify
2025-01-13T12:28:19.130866Z [info     ] 2025-01-13 17:58:19,082 | INFO     | singer_sdk.metrics   | METRIC: {"type": "counter", "metric": "record_count", "value": 3, "tags": {"stream": "collects", "context": {}}} cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-clickhouse name=tap-shopify producer=True run_id=05ce472f-e308-43bf-8d19-c1aeeb290bd4 stdio=stderr string_id=tap-shopify
2025-01-13T12:28:19.208450Z [error    ] Loader failed
2025-01-13T12:28:19.208450Z [error    ] Block run completed.           block_type=ExtractLoadBlocks err=RunnerError('Loader failed') exit_codes={<PluginType.LOADERS: 'loaders'>: 1} set_number=0 success=False

When I try the connection through separate python code myself or through http request, it is successful. So I am not sure what exactly is I have missed. This is my loaders config:

plugins:
  loaders:
    - name: target-clickhouse
      variant: shaped-ai
      pip_url: git+<https://github.com/shaped-ai/target-clickhouse.git>
      config:
        database: shopify_db
        driver: http
        host: 'my-host-name'
        port: 8443
        username: default

I have my password in the .env file

You can separate out the tap/target processes, which might help you debug:

meltano invoke tap-shopify > tap.out
cat tap.out | meltano invoke target-clickhouse