Meltano

Hello Everyone,
Is there any way to run airflow scheduler in an  background after logout, i want my scheduler will always run.

Adding the `-D` flag should do it!

&gt; `meltano invoke airflow scheduler -D`
and similarly, for the airflow webserver:

&gt; `meltano invoke airflow webserver -D`
(More in <https://meltano.com/docs/orchestration.html#starting-the-airflow-scheduler|the Meltano docs>.)

You can also run:

&gt; `meltano invoke airflow scheduler --help`
to see the other command line arguments you can use with the scheduler or webserver. For example, here is what it says about the `-D` flag:

&gt;    -D, --daemon          Daemonize instead of running in the foreground

<@U06CEFD456Y> i run this command and it stops

<@U06D0K745A4> <@U06D0PMASN4> <@U06CC8PD1JN> <@U06C901PP9T>

that readout looks correct

are you using the Meltano DAG generator?

<https://gitlab.com/meltano/files-airflow/-/blob/master/bundle/orchestrate/dags/meltano.py>

<https://meltano.com/docs/orchestration.html#installing-airflow>

I think first we need to change the sequentialexecutor as it's good for testing but not in production environment.

<@U06CQN9N73K> When the scheduler is deamonized, it will continue running in the background even when your terminal/shell lets you enter another command. The point of deamonization is that it isn’t dependent on a specific shell, and doesn’t block you from following it up with another command

Thanks <@U06CE9BN604> this was very helpful

<@U06CC8PD1JN> here's our thread about scheduling / daemonizing

Hello <@U06CE9BN604> <@U06CEFD456Y>,
Thank you for the previous help on scheduler. Need some suggestions as we shifted from sqlite database to postgresdb ,  the `meltano invoke airflow scheduler -D`
Commnad is not working anymore. It is not scheduling the pipeline so i need to run `meltano invoke airflow scheduler`   to run the scheduler.
As i researched that we need to change the `executor` , right now it is `sequentialExecutor.`

So my question is how we can change the executor for airflow while using `postgresdb` .
Right now we believe might be celeryExecutor could be the solution but have not sure how to change from s`equentialExecutor` to `celeryExceutor.`

<@U06D0K745A4>