Hi all, I wonder if Meltano can load its logs like...
# troubleshooting
r
Hi all, I wonder if Meltano can load its logs like schedule/job running logs to Postgres or sth cuz I also want to monitor the loading logs. Is it possible? Currently, I can't find if there is a way.
h
I don’t think there is anything by default, the logging is pure python, but python has a flexible framework for logging and a quick chat with GPT suggests it is possible to create a custom postgres logger for python. This would be outside of the meltano framework though. I suspect you have already checked out the logging section of the docs, but here’s the link just in case: https://docs.meltano.com/guide/logging/#logging This would actually be pretty interesting to try…
a
Bit of a long way round, but I am using dagster to orchestrate meltano, and persisting the compute logs in Azure storage account; I guess I could use log analytics over the top if I wanted to. But feels like a sledgehammer to crack a nut here.