Is there any way to get the run_id of a meltano ru...
# troubleshootingt
thomas_briggs
05/04/2023, 9:20 PMIs there any way to get the run_id of a meltano run other than from the internal DB? Really what I'm after is the log file for the run but that is in a directory named for the run_id, so...
v
visch
05/04/2023, 9:21 PMI do this
meltano run tap-name target-name > \log\somewhere_$timestamp_here 2>&1t
thomas_briggs
05/04/2023, 9:23 PMYeah, i suppose I should just proactively generate my own log rather than depending on the one meltano generates... hadn't thought about that. Thanks @visch!
v
visch
05/04/2023, 9:23 PMYeah idk what the best option is 🤷 I think a combo of the idea I listed with using a
logging.yamlvisch
05/04/2023, 9:24 PMSo instead of redirecting* maybe use https://docs.meltano.com/guide/logging#logging and direct the files to where you want them to go 🤷
t
thomas_briggs
05/04/2023, 9:29 PM🤔
thomas_briggs
05/04/2023, 9:51 PMAh, with the
--log-configthomas_briggs
05/04/2023, 9:53 PMI'm working on a script to execute meltano and process the output for various purposes so I don't necessarily want to control how logging behaves for all executions of meltano, only those run by my script... which would happen if I created a logging.yaml.
thomas_briggs
05/04/2023, 9:53 PMAnyway, thanks for listening 😉