Hallo everyone I have an issue with tap-freshdesk ...
# singer-taps
s
Hallo everyone I have an issue with tap-freshdesk as below. FYI - I am using same code from git [ https://github.com/acarter24/tap-freshdesk/tree/main/tap_freshdesk] INFO - [2024-08-23 092206,413] {'name': 'meltano', 'run_id': 'bd838a6e-069b-4fd1-81d8-9391ff041690', 'state_id': 'freshdesk_roles_to_s3', 'stdio': 'stderr', 'cmd_type': 'elt', 'event': "ELT could not be completed: Cannot start extractor: Catalog discovery failed: command ['/meltano/.meltano/extractors/tap-freshdesk/venv/bin/tap-freshdesk', '--config', '/meltano/.meltano/run/elt/freshdesk_roles_to_s3/bd838a6e-069b-4fd1-81d8-9391ff041690/tap.d6430c39-0f98-4d4a-8619-6a9eb811a77c.config.json', '--state', '/meltano/.meltano/run/elt/freshdesk_roles_to_s3/bd838a6e-069b-4fd1-81d8-9391ff041690/state.json', '--discover'] returned 1 with stderr:", 'level': 'info', 'timestamp': '2024-08-23T092206.411402Z'} "ImportError: cannot import name 'metrics' from 'singer_sdk' (/meltano/.meltano/extractors/tap-freshdesk/venv/lib/python3.9/site-packages/singer_sdk/__init__.py)", 'level': 'info', 'timestamp': '2024-08-23T092206.416659Z'} If I remove metrics from stream.py line number 9 . Getting below error from client.py as below from singer_sdk.pagination import BasePageNumberPaginator, SinglePagePaginator ModuleNotFoundError: No module named 'singer_sdk.pagination' ++++++++same tap works in windows without any issues ++++++++++++
e
Try reinstalling,
meltano install --clean
s
meltano install --clean did installed again but when I perform meltano elt tap-freshdesk target-s3-parquet has same error ELT could not be completed: Cannot start extractor: Catalog discovery failed: command ['/project/.meltano/extractors/tap-freshdesk/venv/bin/tap-freshdesk', '--config', '/project/.meltano/run/elt/2024-08-23T151822--tap-freshdesk--target-s3-parquet/d063ca04-2e66-407f-a082-d144850376ec/tap.6d7dbfe6-2d8f-431f-8b03-937f53205fdf.config.json', '--discover'] returned 1 with stderr: Traceback (most recent call last): File "/project/.meltano/extractors/tap-freshdesk/venv/bin/tap-freshdesk", line 5, in <module> from tap_freshdesk.tap import Tapfreshdesk File "/project/.meltano/extractors/tap-freshdesk/venv/lib/python3.9/site-packages/tap_freshdesk/tap.py", line 14, in <module> from tap_freshdesk import streams File "/project/.meltano/extractors/tap-freshdesk/venv/lib/python3.9/site-packages/tap_freshdesk/streams.py", line 9, in <module> from singer_sdk import Tap, metrics ImportError: cannot import name 'metrics' from 'singer_sdk' (/project/.meltano/extractors/tap-freshdesk/venv/lib/python3.9/site-packages/singer_sdk/__init__.py)
e
What does your
meltano.yml
look like?
(I suspect there's something off with this variant of tap-freshdesk, so I wanna rule out you're not using a personal fork)
s
version: 1 send_anonymous_usage_stats: true project_id: tap-freshdesk default_environment: test environments: - name: test plugins: extractors: - name: tap-freshdesk namespace: tap_freshdesk pip_url: -e . capabilities: - state - catalog - discover - about - stream-maps settings: - name: start_date config: start_date: 2024-08-15 domain: rrr api_key: aa select: - roles.* - tickets.* loaders: - name: target-jsonl variant: andyh1203 pip_url: target-jsonl elt: buffer_size: 52428800
e
Oh, ok. So this works on Windows but not Linux, right?
s
yes. exactly windows working. Python 3.9.X Meltano 3.3.2 In linux via docker image -it has an issue. More info : docker file - installation of tap and target is success. than I am running below scripts 1.meltano dragon - image appears 2.meltano invoke tap-freshdesk - same Import error 3.meltano elt tap-freshdesk target-s3-parquet - same Import error it was working fine before but now I added some functionality in streams, client and pushed as whl file [ same approach as earlier process] but has an issue in imports from SDK singers , which I don't understand 😇 attached whl file contains tap,stream,client & schema files to reproduce that would be helpful - Thank you