Meltano

Is it possible to have two bigquery loaders in meltano?

<@U06C59WQRKQ> Right now, the closest you can get is to configure the same loader differently at runtime using <https://meltano.com/docs/integration.html#pipeline-specific-configuration>, but having multiple instances of the same plugin with different configurations in your project at the same time will be made possible by <https://gitlab.com/meltano/meltano/-/issues/2390>, which I hope to still get out in a release this week!

If you can tell me what exactly you're trying to accomplish by having two bigquery loaders, I can help you find the best way to realize that right now

I have two sources, one is gitlab, another is a PG database, I want each to go to their own dataset.

All right! Did you see the default value under <https://meltano.com/plugins/loaders/bigquery.html#dataset-id>? If you leave it unset, it will automatically use a different dataset for each extractor

By default, that will be the namespace of the extractor: `tap_gitlab`  and `tap_postgres` . If you'd like to change that, you can set a different load_schema on the extractors: <https://meltano.com/docs/plugins.html#load-schema-extra>

<@U06C59WQRKQ> Can I assume you figured this one out?

<https://gitlab.com/meltano/meltano/-/issues/2390> took me a little longer to get over the finish line than expected, but I promise it was worth the wait: <https://meltano.slack.com/archives/CP8K1MXAN/p1608746095055200>