Ricardo Celso
02/16/2024, 2:51 PMplugins:
extractors:
- name: tap-athena
variant: meltanolabs
pip_url: git+<https://github.com/MeltanoLabs/tap-athena.git>
2. Run meltano install
3. I define the environment variables
4. I run a discover with meltano invoke tap-athena --discover and it works normally (image 1)
5. Now I create a folder called custom and clone the git repository with git clone <https://github.com/MeltanoLabs/tap-athena.git>
6. Delete the meltano environment with rm -rf .meltano
7. I set meltano.yml to the settings for local execution
plugins:
extractors:
- name: tap-athena
namespace: tap_athena
pip_url: -e ./custom/tap-athena
executable: tap-athena
8. I install the meltano tools with meltano install and works well
9. I run a discover with meltano invoke tap-athena --discover and the tap cannot get the same variables (image 2)Ricardo Celso
02/16/2024, 2:54 PMReuben (Matatika)
02/16/2024, 3:31 PMsettings for the custom plugin in the meltano.yml (for non-custom plugins, these are provided in a .lock file):
plugins:
extractors:
- name: tap-athena
namespace: tap_athena
pip_url: -e ./custom/tap-athena
executable: tap-athena
settings:
- name: ...
- name: ...
kind: ...
- name: ...
value: ...Reuben (Matatika)
02/16/2024, 3:33 PMsettings, you'll probably see that Meltano reports the configuration you are providing as Custom, possibly unsupported by the plugin with
meltano config tap-athena listRicardo Celso
02/16/2024, 3:51 PMRicardo Celso
02/16/2024, 3:52 PMReuben (Matatika)
02/16/2024, 4:01 PMexecutable where you might not need/want it? Try removing that line and running
meltano install --clean extractor tap-athenaRicardo Celso
02/16/2024, 4:13 PM