Ricardo Celso
02/16/2024, 2:51 PMplugins:
extractors:
- name: tap-athena
variant: meltanolabs
pip_url: git+<https://github.com/MeltanoLabs/tap-athena.git>
2. Run meltano install
3. I define the environment variables
4. I run a discover with meltano invoke tap-athena --discover
and it works normally (image 1)
5. Now I create a folder called custom
and clone the git repository with git clone <https://github.com/MeltanoLabs/tap-athena.git>
6. Delete the meltano environment with rm -rf .meltano
7. I set meltano.yml to the settings for local execution
plugins:
extractors:
- name: tap-athena
namespace: tap_athena
pip_url: -e ./custom/tap-athena
executable: tap-athena
8. I install the meltano tools with meltano install
and works well
9. I run a discover with meltano invoke tap-athena --discover
and the tap cannot get the same variables (image 2)Ricardo Celso
02/16/2024, 2:54 PMReuben (Matatika)
02/16/2024, 3:31 PMsettings
for the custom plugin in the meltano.yml
(for non-custom plugins, these are provided in a .lock
file):
plugins:
extractors:
- name: tap-athena
namespace: tap_athena
pip_url: -e ./custom/tap-athena
executable: tap-athena
settings:
- name: ...
- name: ...
kind: ...
- name: ...
value: ...
Reuben (Matatika)
02/16/2024, 3:33 PMsettings
, you'll probably see that Meltano reports the configuration you are providing as Custom, possibly unsupported by the plugin
with
meltano config tap-athena list
Ricardo Celso
02/16/2024, 3:51 PMRicardo Celso
02/16/2024, 3:52 PMReuben (Matatika)
02/16/2024, 4:01 PMexecutable
where you might not need/want it? Try removing that line and running
meltano install --clean extractor tap-athena
Ricardo Celso
02/16/2024, 4:13 PM