I have a situation where we have the same Postgres database schema, same tables, but different hosts for different clients. In total there are about 100-150 different hosts. What's the best way to extract all these different hosts?

"best" is subjective as it really depends. One way would be to setup one meltano project with a

tap-postgres

and then call something like

meltano run tap-postgres target-postgres

but set the environment variables properly (Including load_schema to something like

client_name_postgres

for each client before the run.

from a yml perspective, i use anchors & aliases to handle duplicate config

@jacob_matson what do you mean by “anchor” here? I haven’t come across this term yet in the Meltano world

cool, thank you! I wasn’t aware of this

here is a better example i wrote about https://www.dataduel.co/three-steps-to-handling-sharded-databases-with-dbt/

Thanks! This has been very helpful!