Hi, I am working on a Meltano project that uses the tap-fastly extractor. When I add it and try to run it, it keeps complaining about the missing schemas. However when checking the tap-fastly repo and setup.py, schemas should have been included and I don’t understand why they aren’t being pulled by meltano when installing the plugin. Anybody has any idea of what may be wrong with either my setup (I just followed the tutorial), the plugin (I can edit it as needed) or meltano? Here is the output I get:

vscode ➜ /workspaces/meltano/meltano_split_project $ meltano run tap-fastly target-jsonl
2023-07-10T16:59:10.129099Z [info     ] Environment 'prod' is active
2023-07-10T16:59:11.406763Z [warning  ] No state was found, complete import.
2023-07-10T16:59:11.941618Z [error    ] Cannot start plugin tap-fastly: Catalog discovery failed: command ['/workspaces/meltano/meltano_split_project/.meltano/extractors/tap-fastly/venv/bin/tap-fastly', '--config', '/workspaces/meltano/meltano_split_project/.meltano/run/tap-fastly/tap.67576960-a9f6-4ff9-9db3-6079e8348c08.config.json', '--discover'] returned 1 with stderr:
 CRITICAL [Errno 2] No such file or directory: '/workspaces/meltano/meltano_split_project/.meltano/extractors/tap-fastly/venv/lib/python3.8/site-packages/tap_fastly/schemas'

Does the directory exist?

/workspaces/meltano/meltano_split_project/.meltano/extractors/tap-fastly/venv/lib/python3.8/site-packages/tap_fastly/schemas

and can the user that runs meltano job able to write and read from it? write

touch /workspaces/meltano/meltano_split_project/.meltano/extractors/tap-fastly/venv/lib/python3.8/site-packages/tap_fastly/schemas/test

read

cat /workspaces/meltano/meltano_split_project/.meltano/extractors/tap-fastly/venv/lib/python3.8/site-packages/tap_fastly/schemas/test

cleanup

rm /workspaces/meltano/meltano_split_project/.meltano/extractors/tap-fastly/venv/lib/python3.8/site-packages/tap_fastly/schemas/test

the directory is missing there (/workspaces/meltano/meltano_split_project/.meltano/extractors/tap-fastly/venv/lib/python3.8/site-packages/tap_fastly/schemas) which what confuses me. I can’t find the json files anywhere either. I tried a clean install but keep having the issue. That’s what confuses me. Why aren’t it pulling the schema files. I didn’t have that problem when using a different tool than meltano to manage the tap (pipelinewise).

What's your meltano yaml for the

plugins.extractors

key? I'd like to try to reproduce this.

Last night I compared the tap-fastly with a couple of others and made some edits to the setup.py that seemed to have fix that issue. I pushed those changes to the tap and now I am passed that, on to the next issue with that tap 🙂