stephen_bailey
09/07/2021, 1:04 PMmeltano install extractor tap-gong
Installing 1 plugins...
Installing extractor 'tap-gong'...
Extractor 'tap-gong' could not be installed: failed to install plugin 'tap-gong'.
Running command git clone -q <https://github.com/immuta/tap-gong.git> /tmp/pip-req-build-ulyq992e
ERROR: Command errored out with exit status 1:
command: /src/data-infrastructure/meltano/.meltano/extractors/tap-gong/venv/bin/python -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] =
'"'"'/tmp/pip-install-ut51fk2i/simpleeval_c7a4ae89a7e74b83afeaf64f436b8c75/setup.py'"'"'; __file__='"'"'/tmp/pip-install-ut51fk2i/simpleeval_c7a4ae89a7e
74b83afeaf64f436b8c75/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setupto
ols import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info
--egg-base /tmp/pip-pip-egg-info-3fq1go2j
cwd: /tmp/pip-install-ut51fk2i/simpleeval_c7a4ae89a7e74b83afeaf64f436b8c75/
Complete output (1 lines):
error in simpleeval setup command: use_2to3 is invalid.
----------------------------------------
WARNING: Discarding <https://files.pythonhosted.org/packages/62/25/aec98426834844b70b7ab24b4cce8655d31e654f58e1fa9861533f5f2af1/simpleeval-0.9.10.tar.gz#>
sha256=692055488c2864637f6c2edb5fa48175978a2a07318009e7cf03c9790ca17bea (from <https://pypi.org/simple/simpleeval/>). Command errored out with exit status
1: python setup.py egg_info Check the logs for full command output.
ERROR: Cannot install tap-gong because these package versions have conflicting dependencies.
ERROR: ResolutionImpossible: for help visit <https://pip.pypa.io/en/latest/user_guide/#fixing-conflicting-dependencies>
Failed to install plugin(s)
The taps are installed in a Docker container built from meltano/meltano:v1.79.1-python3.8
. I am able to install them on my local machine's environment (i.e. only fails during the dockerized runs.) I am guessing I have done something wrong in the way I set up my tap requirements / pyproject file, but not sure what. Anyone seen this error before?stephen_bailey
09/07/2021, 1:04 PMstephen_bailey
09/07/2021, 1:08 PM"^1.78.0"
to "^1.79"
martijn_wouters
09/07/2021, 1:32 PMOrchestrator 'airflow' could not be installed: failed to install plugin 'airflow'.
ERROR: Command errored out with exit status 1:
command: /project/.meltano/orchestrators/airflow/venv/bin/python -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-g8rc5i_t/flask-openid_b02636d256a1457daa8e5d35116652ca/setup.py'"'"'; __file__='"'"'/tmp/pip-install-g8rc5i_t/flask-openid_b02636d256a1457daa8e5d35116652ca/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-r8lhwbha
cwd: /tmp/pip-install-g8rc5i_t/flask-openid_b02636d256a1457daa8e5d35116652ca/
Complete output (1 lines):
error in Flask-OpenID setup command: use_2to3 is invalid.
----------------------------------------
WARNING: Discarding <https://files.pythonhosted.org/packages/d1/a2/9d1fba3287a65f81b9d1c09c4f7cb16f8ea4988b1bc97ffea0d60983338f/Flask-OpenID-1.2.5.tar.gz#sha256=5a8ffe1c8c0ad1cc1f5030e1223ea27f8861ee0215a2a58a528cc61379e5ccab> (from <https://pypi.org/simple/flask-openid/>). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
ERROR: Cannot install apache-airflow because these package versions have conflicting dependencies.
ERROR: ResolutionImpossible: for help visit <https://pip.pypa.io/en/latest/user_guide/#fixing-conflicting-dependencies>
The pip_url which we are using is:
pip_url: psycopg2==2.9.1 apache-airflow==2.1.2 --constraint <https://raw.githubusercontent.com/apache/airflow/constraints-2.1.2/constraints-3.8.txt>
It suddenly started, also using meltano 1.79.1martijn_wouters
09/07/2021, 1:39 PMmartijn_wouters
09/07/2021, 1:48 PM<https://gitlab.com/meltano/meltano/-/blob/master/src/meltano/core/venv_service.py#L177>
?martijn_wouters
09/07/2021, 2:01 PMedgar_ramirez_mondragon
09/07/2021, 2:27 PMsetuptools
pablo_seibelt
09/07/2021, 5:43 PMaaronsteers
09/07/2021, 8:00 PMaaronsteers
09/07/2021, 10:49 PMsetuptools
version in each Meltano-managed virtual environment. https://meltano.slack.com/archives/CFG3C3C66/p1631054744023100
Huge thanks to everyone who helped debug this, and especially @maarten_van_gijssel for submitting the fix.
Note:
The Python 3.9Ā dockerĀ image will be published tomorrow afternoon. (PingĀ #CKHP6G5V4Ā for more info.)
stephen_bailey
09/07/2021, 10:59 PM