Anyone have suggestions for good free-to-use taps ...
# getting-started
a
Anyone have suggestions for good free-to-use taps that do not require paid credentials on an external service?
t
I remember we added the
free service
keyword to a few conenctors on the hub
a
Thanks, @taylor. These are the ones I know of: • tap-stackoverflow-sampledata - a large dataset used for some perf benchmarking • tap-spreadsheets-anywhere - if when paired with a publicly available source file • tap-rickandmorty - a simple example used in some trainings
I know we removed
tap-carbon-intensity
from the Hub search results because it is hard coded to a specific date and not broadly useful. Another one widely used in examples but missing some key features is tap-exchangeratesapi. It supports incremental sync but not discovery or the optional API key.
cc @Sven Balnojan, @aleksei_razvodov
At one point, I think @cody_hanson was working also on a generic tap for Socrata open data.
c
Yeah, there’s a WIP branch in this (currently private) repo for tap-socrata. Sounds like it’s worth me spending some time in our next hack week to get it across the finish line. It definitely makes for a great entry point for Meltano and for tutorial or proof-of-concept projects: it’s real-world, usable, interesting data that’s free and open.
Lot of API calls for that though, may want to skip as a recommendation
j
We just tried tap-airtable, they provide trial for free. Is it possible to tap open-source Jira projects(e.g. Apache foundation projects) for free? tap-bls requires registration but no paying it seems.
a
@taylor https://hub.meltano.com/extractors/tap-open-library looked promising but doesn't work. It requires keys: ['change_date', 'kind'] but config doesn't provide parameters to set Two other I've tried already
meltano config tap-open-library test
Copy code
2023-01-31T17:49:39.949844Z [info     ] The default environment 'dev' will be ignored for `meltano config`. To configure a specific environment, please use the option `--environment=<environment name>`.
Need help fixing this problem? Visit <http://melta.no/> for troubleshooting steps, or to
join our friendly Slack community.

Plugin configuration is invalid
Catalog discovery failed: command ['/home/AlexRaz/meltano_projects/lib/.meltano/extractors/tap-open-library/venv/bin/tap-open-library', '--config', '/home/AlexRaz/meltano_projects/lib/.meltano/run/tap-open-library/tap.d6020379-8175-4aca-a6ac-caed628f5792.config.json', '--discover'] returned 1 with stderr:
 CRITICAL Config is missing required keys: ['change_date', 'kind']
Traceback (most recent call last):
  File "/home/AlexRaz/meltano_projects/lib/.meltano/extractors/tap-open-library/venv/bin/tap-open-library", line 8, in <module>
    sys.exit(main())
  File "/home/AlexRaz/meltano_projects/lib/.meltano/extractors/tap-open-library/venv/lib/python3.9/site-packages/singer/utils.py", line 229, in wrapped
    return fnc(*args, **kwargs)
  File "/home/AlexRaz/meltano_projects/lib/.meltano/extractors/tap-open-library/venv/lib/python3.9/site-packages/tap_open_library/__init__.py", line 94, in main
    args = utils.parse_args(REQUIRED_CONFIG_KEYS)
  File "/home/AlexRaz/meltano_projects/lib/.meltano/extractors/tap-open-library/venv/lib/python3.9/site-packages/singer/utils.py", line 182, in parse_args
    check_config(args.config, required_config_keys)
  File "/home/AlexRaz/meltano_projects/lib/.meltano/extractors/tap-open-library/venv/lib/python3.9/site-packages/singer/utils.py", line 190, in check_config
    raise Exception("Config is missing required keys: {}".format(missing_keys))
Exception: Config is missing required keys: ['change_date', 'kind']
t
Ah, those aren’t defined in the hub metadata. You can add them locally by adding the
settings:
key in your meltano.yml (see https://docs.meltano.com/guide/configuration#overriding-discoverable-plugin-properties)