Hey y’all :wave:
Im trying to add the airflow orch...
# troubleshootinga
alexander_rougellis
09/21/2022, 5:58 PMHey y’all 👋
Im trying to add the airflow orchestrator, but I get this error upon installation
Copy code
Added orchestrator 'airflow' to your Meltano project
Variant: apache (default)
Repository: <https://github.com/apache/airflow>
Documentation: <https://docs.meltano.com/guide/orchestration>
Installing orchestrator 'airflow'...
Orchestrator 'airflow' could not be installed: failed to install plugin 'airflow'.
ERROR: 404 Client Error: Not Found for url: <https://raw.githubusercontent.com/apache/airflow/constraints-2.1.2/constraints-3.10.txt>
Failed to install plugin(s)w
Will Da Silva (Arch)
09/21/2022, 6:02 PMLooks like the URL works for Python 3.9/3.8/3.7, so I'm guessing that the issue is that it doesn't support Python 3.10.
Will Da Silva (Arch)
09/21/2022, 6:05 PMFor whatever reason, it's trying to use version 2.1.2, which lacks Python 3.10 support. The latest version (2.4.0) supports Python 3.10.
Will Da Silva (Arch)
09/21/2022, 6:08 PMWhen I run
.meltano/orchestrators/airflow/venv/bin/pip list installed | grep airflow Copy code
apache-airflow 2.1.2
apache-airflow-providers-ftp 2.0.0
apache-airflow-providers-imap 2.0.0
apache-airflow-providers-sqlite 2.0.0Will Da Silva (Arch)
09/21/2022, 6:10 PMI have reproduced the problem with Python 3.10
Will Da Silva (Arch)
09/21/2022, 6:20 PM@edgar_ramirez_mondragon my Meltano knowledge is lacking here. Maybe you can help. What causes Meltano to use
apache-airflow==2.1.2e
edgar_ramirez_mondragon
09/21/2022, 6:35 PM@Will Da Silva (Arch) Airflow 2.1.2 is the pinned version in Hub. One can override the
pip_urlw
Will Da Silva (Arch)
09/21/2022, 6:37 PMWhere is it pinned? I looked around a bit, but didn't find it.
e
edgar_ramirez_mondragon
09/21/2022, 6:45 PMw
Will Da Silva (Arch)
09/21/2022, 8:12 PMf
farid
02/24/2023, 3:44 PMhi @alexander_rougellis
I am having same issue and not able to install airflow but I manage with below steps and seems is working fine
Copy code
cd .meltano/orchestrators/airflow
source venv/bin/activate
AIRFLOW_VERSION=2.5.1
PYTHON_VERSION="$(python --version | cut -d " " -f 2 | cut -d "." -f 1-2)"
CONSTRAINT_URL="<https://raw.githubusercontent.com/apache/airflow/constraints-${AIRFLOW_VERSION}/constraints-${PYTHON_VERSION}.txt>"
pip install "apache-airflow[async,postgres,google]==${AIRFLOW_VERSION}" --constraint "${CONSTRAINT_URL}"