If I specify multiple extractor/loader pairs in a single

meltano run

command followed by one or more transformers or utilities, do the utilities get executed once per extractor/loader pair?? e.g. if I run

meltano run tap-mysql1 target-postgres tap-mysql2 target-postgres dbt-postgres:run

the logs for both pipelines include the output from dbt. The dbt log lines have exactly the same timestamps though. So is dbt getting run twice (‼️ 😱 ) or is the output just sent to both logs?

dbt should just be running once with that run command assuming there's no misdirection with naming of taps/targets 😄

It should just run once, but it’s a bit surprising that it’s in both logs. @pat_nadolny have you seen anything like this?

@taylor I dont have any pipelines like this so I havent run into it. Although I did just run a local test and I was able to replicate this, it looks like dbt runs only once based on timestamps but the logs get added to both elt.log files for the two EL pairs.

Implementing something like https://github.com/meltano/meltano/issues/7081 would probably solve this. I would just expect a separate dbt log file

@taylor @pat_nadolny thanks for investigating. The duplicate log output is annoying but as long as dbt is actually only running once I'm ok.