evan_azevedo
11/03/2023, 12:07 AMexecutor
to LocalExecutor
.
Setup info:
• Meltano version: 3.1.0
• Airflow (in meltano.yaml
)
utilities:
- name: airflow
variant: apache
pip_url: psycopg2 apache-airflow-providers-postgres git+<https://github.com/meltano/airflow-ext.git@main>
apache-airflow==2.3.3 --constraint <https://raw.githubusercontent.com/apache/airflow/constraints-2.3.3/constraints-no-providers-${MELTANO__PYTHON_VERSION}.txt>
config:
core:
executor: LocalExecutor
webserver:
web_server_port: '8973'
database:
sql_alchemy_conn: <postgresql://jobyatp:xM2jaGOzfsOTe3o71TPBU1H8IzHvT6@172.29.1.3:5432/airflow>
• Double checked that there is no orchestrator version of airflow present.
• I ran meltano config airflow set core.executor LocalExecutor
However, this is what I get when I run `meltano invoke airflow config list`:
[core]
...
executor = SequentialExecutor
I just switched from using the Orchestrator version because it looks like the utilities version is preferred. Any help is appreciated!evan_azevedo
11/05/2023, 6:27 PMorchestrator
version of airflow, the utilities
version generates airflow.cfg
within orchestrate/airflow
in the root project folder. core.executor
is no longer a setting recognized by Meltano, so if you want to have it set in the Airflow instance managed by Meltano, you'll need to change that setting within airflow.cfg
.