is there any way to prevent Meltano from logging t...
# troubleshooting
d
is there any way to prevent Meltano from logging the intermediate results of a pipeline when executing
meltano run
? we have a pipeline of this form:
Copy code
meltano run tap mapper target
where
mapper
is responsible for obfuscating data from one of the fields that's being emitted by
tap
. however the output of
tap
is leaking sensitive information into logs which has to be avoided
i suppose we can either use
--quiet
or set the
--log-level
?
e
Hi @daniel 👋🏼 1. What tap is this? (if it's public and ok to share) 2. For most taps using a quieter log level, e.g.
WARNING
, should help
d
hey @edgar_ramirez_mondragon, the tap is
twilio-tap-zendesk
and for now we've addressed this by setting the log level to `WARNING`: https://github.com/twilio-labs/twilio-tap-zendesk