i am having some python issues 😢 😢 . Set everything on my computer up with Python3.9 and now trying to use

pyenv

and

poetry

to set my meltano project back to 3.8 (because a bunch of SDK taps I made require 3.8). In my Meltano dir, I did:

poetry env use python3.8
poetry install
poetry run meltano install

Many packages install correctly but for the ones that are from pypi, I get:

Extractor 'tap-jira' could not be installed: failed to install plugin 'tap-jira'.
/Users/sbailey/Documents/github/data-infrastructure/meltano/.meltano/extractors/tap-jira/venv/bin/python: No module named pip

If i run

poetry run pip install --upgrade pip

, i get

Requirement already satisfied: pip in ./.venv/lib/python3.8/site-packages (21.3.1)

, so I don't see any reason why

pip

wouldn't be found. I hate asking for environment help, but has anyone seen something like this before?

@stephen_bailey I am seeing this issue too inside the 3.7 docker image for Meltano/Meltano. The pip and python files are in the directory it states as not found. I’ll watch this and let you know if I find an answer.

amazing! i totally did not realize that meltano was isntalling these in the

.meltano

directory and not in

.venv

, because obviously i am not going to read the actual error mesage that i posted

Yea, Meltano creates a separate venv for each plugin. So each tap/extractor and target/loader has its own venv. I use pyenv also, but it really is only setting the venv for the main meltano process/program. If you do --log-level=debug you can see the full path it is using when it shells out and calls the tap/target/transform(dbt).