Hello,
We are trying to stop the pipeline but it's continuously running ( like for more than 3 days).
Is there any way to stop the pipeline or kill the process via CLI command.
@edward_ryan@jo_pearson
e
edward_ryan
03/07/2022, 11:55 AM
For additional context, the pipeline says it is running but is not loading data
t
thomas_briggs
03/07/2022, 1:41 PM
When you say "continuously running" - does that mean you can see the tap and/or target processes in the OS process list? Or just that meltano says the pipeline is already running when you run 'meltano elt'? If the former you can kill the processes with OS tools. If the latter you can use the --force option to tell meltano to assume the previous run failed and start again.
m
monika_rajput
03/07/2022, 4:01 PM
It's in production, do you really think it works ? @thomas_briggs
t
thomas_briggs
03/07/2022, 4:15 PM
I know --force will cause Meltano to restart the pipeline if the processes failed unexpectedly. But the right thing to do depends on whether the tap/target processes are still running, I think... you need to do different things depending on that.
e
edward_ryan
03/07/2022, 6:28 PM
Thanks Thomas -- in this case the pipeline was not running but it reflected that it was in the UI