Hi, I want to send data from tap_exchangeratesapi ...
# plugins-general
m
Hi, I want to send data from tap_exchangeratesapi to stitch and have configured both when trying to run pipeline getting below error, it seems some issue with exchangerates extractor. Am I missing something?: meltano elt tap-exchangeratesapi target-stitch --job_id=tap-exchangeratesapi-to-target-stitch 2021-12-20T113512.363695Z [info ] Running extract & load... job_id=tap-exchangeratesapi-to-target-stitch name=meltano run_id=1eb2156f-6dc8-4976-aedc-09af400978dd 2021-12-20T113512.481283Z [info ] ELT could not be completed: Cannot start extractor: Catalog discovery failed: command ['/home/azureuser/meltano-projects/my-meltano-project/.meltano/extractors/tap-exchangeratesapi/venv/bin/tap-exchangeratesapi', '--config', '/home/azureuser/meltano-projects/my-meltano-project/.meltano/run/elt/tap-exchangeratesapi-to-target-stitch/1eb2156f-6dc8-4976-aedc-09af400978dd/tap.7ab667c5-14c9-40b6-97ef-d274ce9220da.config.json', '--discover'] returned 2 cmd_type=elt job_id=tap-exchangeratesapi-to-target-stitch name=meltano run_id=1eb2156f-6dc8-4976-aedc-09af400978dd stdio=stderr ELT could not be completed: Cannot start extractor: Catalog discovery failed: command ['/home/azureuser/meltano-projects/my-meltano-project/.meltano/extractors/tap-exchangeratesapi/venv/bin/tap-exchangeratesapi', '--config', '/home/azureuser/meltano-projects/my-meltano-project/.meltano/run/elt/tap-exchangeratesapi-to-target-stitch/1eb2156f-6dc8-4976-aedc-09af400978dd/tap.7ab667c5-14c9-40b6-97ef-d274ce9220da.config.json', '--discover'] returned 2 Please help solving this issue.
e
Hi @mohammad_alam! Could be that the tap is misconfigured. You need to set
base
and
start_date
. Can you share your
meltano.yml?
m
Hi @edgar_ramirez_mondragon please have a look at meltano.yml file of the project.
e
Ok @mohammad_alam so there's a few things: • That tap doesn't support the
catalog
and discover
capabilites
. This is a bug in the hub page for the tap (https://hub.meltano.com/taps/exchangeratesapi):
Copy code
$ meltano --log-level=debug invoke tap-exchangeratesapi
usage: tap-exchangeratesapi [-h] [-c CONFIG] [-s STATE]
tap-exchangeratesapi: error: unrecognized arguments: --discover
Catalog discovery failed: command ['/Users/edgarramirez/Code/meltano-personal/.meltano/extractors/tap-exchangeratesapi/venv/bin/tap-exchangeratesapi', '--config', '/Users/edgarramirez/Code/meltano-personal/.meltano/run/tap-exchangeratesapi/tap.d6fe3cb5-b606-4d5d-9a49-e01bb299a983.config.json', '--discover'] returned 2
So this should work
Copy code
version: 1
send_anonymous_usage_stats: true
project_id: 9b5bab07-b16e-4f4c-8cf5-1c47b8107780
plugins:
  extractors:
  - name: tap-exchangeratesapi
    namespace: tap_exchangeratesapi
    pip_url: git+<https://github.com/singer-io/tap-exchangeratesapi.git>
    executable: tap-exchangeratesapi
    capabilities:
    - state # it does support this one
    config:
      start_date: '2019-05-26'
      base: EUR
• Even with that change the tap won't work because earlier this year they made their API require the access key you're trying to pass but the tap hasn't been updated: https://github.com/singer-io/tap-exchangeratesapi/issues/13 • In the github pr thread above, they recommend https://hub.meltano.com/taps/exchangeratehost, which should work with the same capabilities as above (
state
only)
m
Thank You @edgar_ramirez_mondragon