https://linen.dev logo
#plugins-general
Title
# plugins-general
a

anna

05/03/2023, 8:46 PM
Hey everyone! I’m trying to install airflow orchestrator in meltano on my MAC (with M1 chip). I’ve tried with python3.9, meltano 2.4.0 and airflow 2.1.2 It either never finishes the installation… It writes this:
Copy code
(venv3.8) anna@Annas-MacBook ~/git/repo (main) % meltano --log-level debug install orchestrator airflow --clean
2023-05-03T20:30:16.862595Z [debug    ] Creating engine '<meltano.core.project.Project object at 0x106921d60>@sqlite:////Users/anna/git/repo/.meltano/meltano.db'
2023-05-03T20:30:17.117231Z [debug    ] Encoding detection: ascii is most likely the one.
2023-05-03T20:30:17.811007Z [debug    ] Found plugin parent            parent=airflow plugin=airflow source=<DefinitionSource.DISCOVERY: 1>
Installing 1 plugins...
Installing orchestrator 'airflow'...
2023-05-03T20:30:18.218489Z [debug    ] Variable '$COLOR_PROMPT' is not set in the provided env dictionary.
2023-05-03T20:30:18.218542Z [debug    ] Variable '$vcs_info_msg_0_' is not set in the provided env dictionary.
2023-05-03T20:30:18.341165Z [debug    ] Removed old virtual environment for 'orchestrators/airflow'
2023-05-03T20:30:18.341235Z [debug    ] Creating virtual environment for 'orchestrators/airflow'
2023-05-03T20:30:18.551449Z [debug    ] Upgrading pip for 'orchestrators/airflow'
2023-05-03T20:30:18.551542Z [debug    ] Upgrading with args '--upgrade pip setuptools==57.5.0 wheel' in existing virtual environment for 'orchestrators/airflow'
2023-05-03T20:30:19.686327Z [debug    ] Installing with args 'psycopg2 apache-airflow[cncf.kubernetes]==2.1.2 --constraint <https://raw.githubusercontent.com/apache/airflow/constraints-2.1.2/constraints-3.8.txt>' into virtual environment for 'orchestrators/airflow'
…and I never get back control. Or if I use python3.9 I get some numpy error in a 2000+ lines stderr message like ```Installing 1 plugins... Installing orchestrator 'airflow'... Orchestrator 'airflow' could not be installed: failed to install plugin 'airflow'. error: subprocess-exited-with-error × Building wheel for numpy (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> [2306 lines of output] Running from numpy source directory. numpy/random/_bounded_integers.pxd.in has not changed numpy/random/_philox.pyx has not changed numpy/random/_bounded_integers.pyx.in has not changed numpy/random/_sfc64.pyx has not changed numpy/random/_mt19937.pyx has not changed numpy/random/bit_generator.pyx has not changed Processing numpy/random/_bounded_integers.pyx numpy/random/mtrand.pyx has not changed numpy/random/_generator.pyx has not changed numpy/random/_pcg64.pyx has not changed numpy/random/_common.pyx has not changed Cythonizing sources blas_opt_info: blas_mkl_info: customize UnixCCompiler libraries mkl_rt not found in ['/Users/anna/git/fuel/.meltano/orchestrators/airflow/venv/lib', '/usr/local/lib', '/usr/lib'] NOT AVAILABLE blis_info: libraries blis not found in ['/Users/anna/git/fuel/.meltano/orchestrators/airflow/venv/lib', '/usr/local/lib', '/usr/lib'] NOT AVAILABLE openblas_info: libraries openblas not found in ['/Users/anna/git/fuel/.meltano/orchestrators/airflow/venv/lib', '/usr/local/lib', '/usr/lib'] NOT AVAILABLE atlas_3_10_blas_threads_info: Setting PTATLAS=ATLAS libraries tatlas not found in ['/Users/anna/git/fuel/.meltano/orchestrators/airflow/venv/lib', '/usr/local/lib', '/usr/lib'] NOT AVAILABLE atlas_3_10_blas_info: libraries satlas not found in ['/Users/anna/git/fuel/.meltano/orchestrators/airflow/venv/lib', '/usr/local/lib', '/usr/lib'] NOT AVAILABLE atlas_blas_threads_info: Setting PTATLAS=ATLAS libraries ptf77blas,ptcblas,atlas not found in ['/Users/anna/git/fuel/.meltano/orchestrators/airflow/venv/lib', '/usr/local/lib', '/usr/l…