Hi all, I am a bit confused by the loglevel setti...
# troubleshooting
f
Hi all, I am a bit confused by the loglevel settings in Meltano: When using the following
logging.yaml
settings, I get the record information as
info
in my console and log file:
Copy code
formatters:
  structured_colored:
    (): meltano.core.logging.console_log_formatter
    colors: True
  json:
    (): meltano.core.logging.json_formatter

handlers:
  console:
    class: logging.StreamHandler
    level: INFO
    formatter: structured_colored
    stream: "<ext://sys.stderr>"
  file:
    class: logging.handlers.TimedRotatingFileHandler
    level: INFO
    filename: meltano.log
    formatter: json
    when: midnight
    backupCount: 5

root:
  level: DEBUG
  propagate: yes
  handlers: [console, file]
When switching also root level to INFO, the record
info
messages disappear, together with other
info
messages, depending on the tap / target I am running. In case of
tap-oracle
(s7clarke10/pipelinewise-tap-oracle), e.g., no
producer=True
entries are created at all. What confuses me even more: Without any
logging.yaml
, I get certain
info
messages again, except for those for records.
This is actually exactly the behavior I want for my custom log-file
meltano.log
.
Any hints how I have to setup my
logging.yaml
to achieve this behavior?
EDIT: I just retried running without
logging.yaml
. The output looks like
root: level: INFO
. Hm. I am (quite) sure that this was not the case before an upgrade from 3.7.8 to 3.9.1 Anyway, my major question remains: Why are there
info
messages suppressed with
root: level: INFO
? And can this be adjusted?
I at least solved my problem for tap-oracle, which is not based on singer_sdk: Logging messages with level "info" within the tap are not shown. In order to have messages displayed during meltano run, the log level has to be at least warning. Maybe this helps others, in case they are searching for missing messages.