<#8555 feature: Allow Meltano to collect log recor...
# meltano-repo-activity
g
#8555 feature: Allow Meltano to collect log records from plugins to support collecting log-level and other Python logging features Issue created by edgarrmondragon ### Feature scope CLI (options, error messages, logging, etc.) ### Description The main blocker is the fact that we only capture a tap's stdout and stderr without parsing any log record details (e.g. level, logger name, etc.). The way I can imagine Meltano supporting this is by starting a socket server in a thread when the CLI starts, and then use Python's logging config in the tap side to configure a
logging.handlers.SocketHandler
that points to Meltano's socket server. The biggest questions are probably: • How to safely run the socket server in a thread without causing too much overhead for Meltano • How to handle SerDe for log records, e.g. pickle vs third-party like msgpack From Slack: https://meltano.slack.com/archives/C069CQNHDNF/p1716407008999839 meltano/meltano