Hi awesome Meltano team! I'm unable to set Airflow...
# troubleshooting
e
Hi awesome Meltano team! I'm unable to set Airflow's
executor
to
LocalExecutor
. Setup info: • Meltano version:
3.1.0
• Airflow (in
meltano.yaml
)
Copy code
utilities:
- name: airflow
    variant: apache
    pip_url: psycopg2 apache-airflow-providers-postgres git+<https://github.com/meltano/airflow-ext.git@main>
      apache-airflow==2.3.3 --constraint <https://raw.githubusercontent.com/apache/airflow/constraints-2.3.3/constraints-no-providers-${MELTANO__PYTHON_VERSION}.txt>
    config:
      core:
        executor: LocalExecutor
      webserver:
        web_server_port: '8973'
      database:
        sql_alchemy_conn: <postgresql://jobyatp:xM2jaGOzfsOTe3o71TPBU1H8IzHvT6@172.29.1.3:5432/airflow>
• Double checked that there is no orchestrator version of airflow present. • I ran
meltano config airflow set core.executor LocalExecutor
However, this is what I get when I run `meltano invoke airflow config list`:
Copy code
[core]
...
executor = SequentialExecutor
I just switched from using the Orchestrator version because it looks like the utilities version is preferred. Any help is appreciated!
Here's the solution I found: unlike the
orchestrator
version of airflow, the
utilities
version generates
airflow.cfg
within
orchestrate/airflow
in the root project folder.
core.executor
is no longer a setting recognized by Meltano, so if you want to have it set in the Airflow instance managed by Meltano, you'll need to change that setting within
airflow.cfg
.