How can I stop a pipeline from running? One seems to be running for several hours, log doesn't show an issue, but I doubt it should run this long. What would be the proper way to stop a pipeline?

@ofer_kulka What are you using the run the pipelines? Airflow? Then I suggest looking for Airflow's own mechanism for stopping a running pipeline/task/DAG

manually running it within the gui

Ah, all right. The UI doesn't have a way yet to gracefully stop a pipeline 😅 Killing the

meltano ui

process will do it, though.

yea sure, i thought there might be a command to cli a pipe

Happy to help, consider filing an issue to add a native way in the UI and/or CLI to stop a pipeline!

is there a CLI way to stop a pipeline gracefully?

@krishna_chaitanya If you're running

meltano elt

in a shell, you can hit Control+C or just send the SIGTERM signal to the process. I like the concept of a

meltano stop <name of schedule/job ID>

though! Consider filing an issue in https://gitlab.com/meltano/meltano/-/issues

thanks…

I've been using

pkill -f {pipeline_name}

. You might want to start with

pgrep -f {pipeline_name}

and verify that you get exactly 3 pids (1 for the pipeline, 1 for the tap, 1 for the target). This solution probably only works on Linux.

I am running the pipeline in screen…so when needed to stop i just kill the screen

@monika_rajput here's another thread about stopping Meltano processes from UI