Hi All I have been using Shopify extractor for almost 3 mont Meltano #troubleshooting

Hi All, I have been using Shopify extractor for al...

Chandana S

05/07/2025, 8:20 AM

Hi All, I have been using Shopify extractor for almost 3 months now and I use the command to run the tap and target within my python code based on some triggers and other factors. This code of mine is hosted on AKS (Azure Kubernetes Service) and for the past 2 - 3 days I have been getting this error.

Copy code

2025-05-06T11:49:43.936442Z [info     ] Backing off 8.99 seconds after 3 tries calling function <bound method RESTStream._request of <tap_shopify.streams.AbandonedCheckouts object at 0x7f17392cfb50>> with args (<PreparedRequest [GET]>, None) and kwargs {} cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:49:52.951378Z [info     ] Backing off _request(...) for 16.6s (requests.exceptions.SSLError: HTTPSConnectionPool(host='<http://triumph-sg.myshopify.com|triumph-sg.myshopify.com>', port=443): Max retries exceeded with url: /admin/api/2023-10/checkouts.json (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1007)')))) cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:49:52.951885Z [info     ] Backing off 16.64 seconds after 4 tries calling function <bound method RESTStream._request of <tap_shopify.streams.AbandonedCheckouts object at 0x7f17392cfb50>> with args (<PreparedRequest [GET]>, None) and kwargs {} cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.658595Z [info     ] Giving up _request(...) after 5 tries (requests.exceptions.SSLError: HTTPSConnectionPool(host='<http://triumph-sg.myshopify.com|triumph-sg.myshopify.com>', port=443): Max retries exceeded with url: /admin/api/2023-10/checkouts.json (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1007)')))) cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.660324Z [info     ] METRIC: {"type": "counter", "metric": "http_request_count", "value": 0, "tags": {"stream": "abandoned_checkouts", "endpoint": "/checkouts.json"}} cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.661527Z [info     ] METRIC: {"type": "timer", "metric": "sync_duration", "value": 33.077449560165405, "tags": {"stream": "abandoned_checkouts", "context": {}, "status": "failed"}} cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.662679Z [info     ] METRIC: {"type": "counter", "metric": "record_count", "value": 0, "tags": {"stream": "abandoned_checkouts", "context": {}}} cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.663754Z [info     ] An unhandled error occurred while syncing 'abandoned_checkouts' cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.664790Z [info     ] Traceback (most recent call last): cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.665754Z [info     ]   File "/app/.meltano/extractors/tap-shopify/venv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 716, in urlopen cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.666726Z [info     ]     httplib_response = self._make_request( cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.667769Z [info     ]   File "/app/.meltano/extractors/tap-shopify/venv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 404, in _make_request cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.668799Z [info     ]     self._validate_conn(conn)  cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.669838Z [info     ]   File "/app/.meltano/extractors/tap-shopify/venv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 1061, in _validate_conn cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.673645Z [info     ]     conn.connect()             cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.674254Z [info     ]   File "/app/.meltano/extractors/tap-shopify/venv/lib/python3.10/site-packages/urllib3/connection.py", line 419, in connect cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.674991Z [info     ]     self.sock = ssl_wrap_socket( cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.675908Z [info     ]   File "/app/.meltano/extractors/tap-shopify/venv/lib/python3.10/site-packages/urllib3/util/ssl_.py", line 458, in ssl_wrap_socket cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.676620Z [info     ]     ssl_sock = _ssl_wrap_socket_impl( cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.677561Z [info     ]   File "/app/.meltano/extractors/tap-shopify/venv/lib/python3.10/site-packages/urllib3/util/ssl_.py", line 502, in _ssl_wrap_socket_impl cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.678446Z [info     ]     return ssl_context.wrap_socket(sock, server_hostname=server_hostname) cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.679288Z [info     ]   File "/usr/local/lib/python3.10/ssl.py", line 513, in wrap_socket cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.679617Z [info     ]     return self.sslsocket_class._create( cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.679994Z [info     ]   File "/usr/local/lib/python3.10/ssl.py", line 1071, in _create cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.680335Z [info     ]     self.do_handshake()        cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.680723Z [info     ]   File "/usr/local/lib/python3.10/ssl.py", line 1342, in do_handshake cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.681206Z [info     ]     self._sslobj.do_handshake() cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify
2025-05-06T11:50:09.681679Z [info     ] ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1007) cmd_type=elb consumer=False job_name=dev:tap-shopify-to-target-jsonl name=tap-shopify producer=True run_id=e28fde8d-bbf2-44d3-a8ac-088b2049364c stdio=stderr string_id=tap-shopify

There is a certificate added to the https url we are using and I am not sure why there is this ssl certificate issue now as for probably a month and a half it was working fine.

✅ 1

Edgar Ramírez (Arch.dev)

05/07/2025, 4:05 PM

Shopify seems to be affected by https://github.com/certifi/python-certifi/issues/349. Can you add
certifi==2025.01.31
to your plugin
pip_url
, run
meltano install
and try again? See the comment below

Edgar Ramírez (Arch.dev)

05/07/2025, 4:06 PM

(cc @Reuben (Matatika) might be worth pinning