pankaj_saini
02/09/2021, 10:33 PM[2021-02-09 22:25:17,544] [1|MainThread|meltano.cli.invoke] [ERROR] Traceback (most recent call last):
File "/project/.meltano/orchestrators/airflow/venv/bin/airflow", line 25, in <module>
from airflow.configuration import conf
File "/project/.meltano/orchestrators/airflow/venv/lib/python3.6/site-packages/airflow/__init__.py", line 47, in <module>
settings.initialize()
File "/project/.meltano/orchestrators/airflow/venv/lib/python3.6/site-packages/airflow/settings.py", line 439, in initialize
configure_orm()
File "/project/.meltano/orchestrators/airflow/venv/lib/python3.6/site-packages/airflow/settings.py", line 250, in configure_orm
engine = create_engine(SQL_ALCHEMY_CONN, connect_args=connect_args, **engine_args)
File "/project/.meltano/orchestrators/airflow/venv/lib/python3.6/site-packages/sqlalchemy/engine/__init__.py", line 500, in create_engine
return strategy.create(*args, **kwargs)
File "/project/.meltano/orchestrators/airflow/venv/lib/python3.6/site-packages/sqlalchemy/engine/strategies.py", line 87, in create
dbapi = dialect_cls.dbapi(**dbapi_args)
File "/project/.meltano/orchestrators/airflow/venv/lib/python3.6/site-packages/sqlalchemy/dialects/postgresql/psycopg2.py", line 778, in dbapi
import psycopg2
ModuleNotFoundError: No module named 'psycopg2'
Airflow metadata database could not be initialized: `airflow initdb` failed
I tried adding psycopg2-binary==2.8.6
in requirements.txt file, but the build log says Requirement already satisfied: psycopg2-binary==2.8.6 in /usr/local/lib/python3.6/site-packages (from -r requirements.txt (line 1)) (2.8.6)
.pankaj_saini
02/09/2021, 10:41 PMAIRFLOW__CORE__EXECUTOR: SequentialExecutor
in docker-compose.prod.yml) works okay, but i want to use an external postgresdb for this.douwe_maan
02/09/2021, 11:09 PMFor this to work, the `psycopg2` package will also need to be installed alongside `apache-airflow` , which you can realize by addingto `airflow`'spsycopg2
in your `meltano.yml` project file (e.g.pip_url
) and runningpip_url: psycopg2 apache-airflow
.meltano install orchestrator airflow
douwe_maan
02/09/2021, 11:11 PMdouwe_maan
02/09/2021, 11:12 PMpankaj_saini
02/10/2021, 12:30 AMdouwe_maan
02/10/2021, 5:50 PM