Is it possible to run a new schedule (for example ...
# announcements
z
Is it possible to run a new schedule (for example via the meltano.yml) w/o restarting the scheduling service?
d
@zlatan While
meltano invoke airflow scheduler
is running, it should automatically pick up new pipelines because it re-executes
orchestrate/dags/meltano.py
regularly, which will pick up the newly scheduled pipelines.
Or are you asking about running a scheduled pipeline right now as a one-off?
z
@douwe_maan Right, just tested and it works. It seems that if the schedule is added to meltano.yml it picks it up, but when it is deleted, it doesn't remove it from scheduler's UI. For example the second one was stopped last month on 22nd and it is deleted from the yml, but still shows.
d
That's right, Airflow will still keep a record of that DAG since it once existed and it has relevant historical data, but I don't think it'll still run it on a schedule
z
Got it. If I delete it from the scheduler's UI would it make an issue with the meltano DB?
d
No, feel free