Can you please suggest how to monitor the pipelines, I thought just integrate sentry inside the tap?

@meir.shamay What orchestrator are you using to run your pipelines? Monitoring is typically the responsibility of of the tool that runs the

meltano elt

commands (that themselves run the

tap

and

target

commands), rather than the

tap

or

target

commands themselves. The commands will exist with a non-zero error code and some error output if they fail, which the orchestrator will be able to detect and alert you of.

I am using airflow

@meir.shamay All right — then I'd suggest researching Airflow monitoring unless you were looking for monitoring really specific to taps and targets.

👍