Hi, I am new to Meltano and testing hubspot tap for my data pipeline. I am using meltano potloc variant to extract data from hubspot. I get this error while testing or extraction:

Need help fixing this problem? Visit <http://melta.no/> for troubleshooting steps, or to
join our friendly Slack community.

ELT could not be completed: Cannot start extractor: Catalog discovery failed: command ['/Users/admin/Desktop/Analytics/meltano/hubspot-variant/.meltano/extractors/tap-hubspot/venv/bin/tap-hubspot', '--config', '/Users/admin/Desktop/Analytics/meltano/hubspot-variant/.meltano/run/elt/2023-05-03T175545--tap-hubspot--target-jsonl/2d784bbb-0dd9-4f91-a3a2-a2f11819ed0e/tap.dc64f0b1-7803-44d5-8abe-afa713c0f2ef.config.json', '--discover'] returned 1 with stderr:
 time=2023-05-03 10:55:46 name=tap-hubspot level=INFO message=tap-hubspot v0.0.1, Meltano SDK v0.4.9)
time=2023-05-03 10:55:46 name=tap-hubspot level=INFO message=Skipping parse of env var settings...
time=2023-05-03 10:55:46 name=tap-hubspot level=INFO message=Config validation passed with 0 warnings.
time=2023-05-03 10:55:46 name=root level=INFO message=Operator '__else__=None' was not found. Unmapped streams will be included in output.
Traceback (most recent call last):
  File "/Users/admin/Desktop/Analytics/meltano/hubspot-variant/.meltano/extractors/tap-hubspot/venv/lib/python3.10/site-packages/tap_hubspot/client.py", line 185, in get_properties
    return res["results"]
KeyError: 'results'

Looking for help from hubspot tap users in meltano who has successfully tested an ELT or EL from hubspot to other targets. Any idea on how to fix this? or please share relevant resources that could be helpful. Thanks

This error is happening when fetching the schemas for the stream, the hubspot api is not returning the fields available for the stream, but the error message is not useful. Other variants are working? you can try an other one to see if you can get a more detailed error message.

@Stéphane Burwash have you seen this before? 👆

hubspot-tap variant requires hapi which is discontinued and replaced by oauth. @josue_sehnem what other variants would you suggest?

I worked a lot on the hotglue one, but it is not available on meltano 😕 https://gitlab.com/hotglue/tap-hubspot-beta

@josue_sehnem if it's ready we can get it added to the Hub. cc @pat_nadolny

It is used in production there

I opened a PR to add it! https://github.com/meltano/hub/pull/1297

Sorry for the late reply @sweta_garai. My best guess - the properties API may be returning null values, and I hard-coded it to get results at the "results" key, causing it to bust. Sorry for the issue 😅 To confirm, I would recommend you try an API request on your end with the problematic parameters just to validate. I'm OOO currently, but I'd be happy to help in any way I can when I get back :D

Thanks for your suggestion @Stéphane Burwash I tried to make an api call to https://api.hubapi.com/crm/v3/objects/contacts and it returns me value for results.

Awesome perfect! And what does your select statement look like in your meltano.yml?

This is my meltano.yml file. Where do I add the select statement? @Stéphane Burwash

@sweta_garai check out the docs on selection! https://docs.meltano.com/guide/integration#selecting-entities-and-attributes-for-extraction

Thank you @pat_nadolny. Taking a look.

FWIW I proposed a PR to gracefully continue if discovery fails so users with a subset of scopes can use select criteria to only sync the streams they have access to https://github.com/potloc/tap-hubspot/pull/41