Hey I m trying to use `tap autodesk bim360` but having hard Meltano #getting-started

Hey! I’m trying to use `tap-autodesk-bim360` but h...

Omer Moran

02/11/2024, 9:02 AM

Hey! I’m trying to use

tap-autodesk-bim360

but having hard time connecting. I’ve set up everything according to the guide here: https://github.com/singer-io/tap-autodesk-bim-360/tree/master But still unable to access data, I’m getting the following:

requests.exceptions.HTTPError: 403 Client Error: Forbidden for url

(logs are in the comment in this thread)

Omer Moran

02/11/2024, 9:03 AM

Copy code

meltano ❯ meltano run tap-autodesk-bim-360 target-jsonl
2024-02-11T09:01:02.222151Z [info     ] Environment 'dev' is active
2024-02-11T09:01:04.295209Z [info     ] INFO Skipping stream: checklists cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:04.297876Z [info     ] INFO Skipping stream: projects cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:04.298336Z [info     ] INFO Skipping stream: issues   cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:04.298851Z [info     ] INFO Skipping stream: business_units cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:04.299537Z [info     ] INFO hub_projects - Syncing: <https://developer.api.autodesk.com/project/v1/hubs/b.Z3JgMTKyfvjHTteaY4fW7yqmofhiEonl/projects> cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:04.300049Z [info     ] INFO hub_projects - <https://developer.api.autodesk.com/project/v1/hubs/b.Z3JgMTKyfvjHTteaY4fW7yqmofhiEonl/projects> - limit: 100, offset: 0 cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:05.024269Z [info     ] INFO METRIC: {"type": "timer", "metric": "http_request_duration", "value": 0.7234220504760742, "tags": {"http_status_code": 200, "status": "succeeded"}} cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:05.952447Z [info     ] INFO METRIC: {"type": "timer", "metric": "http_request_duration", "value": 0.9234528541564941, "tags": {"endpoint": "hub_projects", "http_status_code": 403, "status": "succeeded"}} cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:05.956053Z [info     ] CRITICAL 403 Client Error: Forbidden for url: <https://developer.api.autodesk.com/project/v1/hubs/b.Z3JgMTKyfvjHTteaY4fW7yqmofhiEonl/projects?page%5Blimit%5D=100&page%5Bnumber%5D=0> cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:05.956656Z [info     ] Traceback (most recent call last): cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:05.956995Z [info     ]   File "/Users/omermoran/veev-data-code/meltano/poc-project/.meltano/extractors/tap-autodesk-bim-360/venv/bin/tap-autodesk-bim-360", line 8, in <module> cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:05.958257Z [info     ]     sys.exit(main())           cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:05.958535Z [info     ]   File "/Users/omermoran/veev-data-code/meltano/poc-project/.meltano/extractors/tap-autodesk-bim-360/venv/lib/python3.9/site-packages/singer/utils.py", line 229, in wrapped cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:05.971170Z [info     ]     return fnc(*args, **kwargs) cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:05.971552Z [info     ]   File "/Users/omermoran/veev-data-code/meltano/poc-project/.meltano/extractors/tap-autodesk-bim-360/venv/lib/python3.9/site-packages/tap_autodesk_bim_360/__init__.py", line 41, in main cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:05.977636Z [info     ]     sync(client,               cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:05.977910Z [info     ]   File "/Users/omermoran/veev-data-code/meltano/poc-project/.meltano/extractors/tap-autodesk-bim-360/venv/lib/python3.9/site-packages/tap_autodesk_bim_360/sync.py", line 161, in sync cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:05.986972Z [info     ]     sync_endpoint(client,      cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:05.987278Z [info     ]   File "/Users/omermoran/veev-data-code/meltano/poc-project/.meltano/extractors/tap-autodesk-bim-360/venv/lib/python3.9/site-packages/tap_autodesk_bim_360/sync.py", line 69, in sync_endpoint cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:05.988194Z [info     ]     data = client.request('GET', cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:05.988488Z [info     ]   File "/Users/omermoran/veev-data-code/meltano/poc-project/.meltano/extractors/tap-autodesk-bim-360/venv/lib/python3.9/site-packages/backoff/_sync.py", line 94, in retry cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:05.992732Z [info     ]     ret = target(*args, **kwargs) cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:05.993025Z [info     ]   File "/Users/omermoran/veev-data-code/meltano/poc-project/.meltano/extractors/tap-autodesk-bim-360/venv/lib/python3.9/site-packages/ratelimit/decorators.py", line 113, in wrapper cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:06.000006Z [info     ]     return func(*args, **kargs) cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:06.001364Z [info     ]   File "/Users/omermoran/veev-data-code/meltano/poc-project/.meltano/extractors/tap-autodesk-bim-360/venv/lib/python3.9/site-packages/ratelimit/decorators.py", line 80, in wrapper cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:06.002357Z [info     ]     return func(*args, **kargs) cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:06.002654Z [info     ]   File "/Users/omermoran/veev-data-code/meltano/poc-project/.meltano/extractors/tap-autodesk-bim-360/venv/lib/python3.9/site-packages/tap_autodesk_bim_360/client.py", line 141, in request cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:06.009811Z [info     ]     response.raise_for_status() cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:06.010103Z [info     ]   File "/Users/omermoran/veev-data-code/meltano/poc-project/.meltano/extractors/tap-autodesk-bim-360/venv/lib/python3.9/site-packages/requests/models.py", line 941, in raise_for_status cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:06.015162Z [info     ]     raise HTTPError(http_error_msg, response=self) cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:06.015639Z [info     ] requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: <https://developer.api.autodesk.com/project/v1/hubs/b.Z3JgMTKyfvjHTteaY4fW7yqmofhiEonl/projects?page%5Blimit%5D=100&page%5Bnumber%5D=0> cmd_type=elb consumer=False name=tap-autodesk-bim-360 producer=True stdio=stderr string_id=tap-autodesk-bim-360
2024-02-11T09:01:06.088840Z [info     ] Incremental state has been updated at 2024-02-11 09:01:06.088692.
2024-02-11T09:01:06.113819Z [error    ] Extractor failed
2024-02-11T09:01:06.114132Z [error    ] Block run completed.           block_type=ExtractLoadBlocks err=RunnerError('Extractor failed') exit_codes={<PluginType.EXTRACTORS: 'extractors'>: 1} set_number=0 success=False
Need help fixing this problem? Visit <http://melta.no/> for troubleshooting steps, or to
join our friendly Slack community.

Run invocation could not be completed as block failed: Extractor failed

Open in Slack

Previous Next