Meltano

Hi… New Here :smile:
I’m looking to extract data from mongoDB to bigQuery. When extracting this data I’m getting three columns in BigQuery. `_id`, `documnent` and `_sdc_deleted_at` . What Im looking for is to simply extract the document object as a flattened structure in BigQuery as this is where my real data resides in MongoDb. any ideas how I would go about to accomplish this. Any help appreciated.

Hi and welcome to the Meltano Slack community.

What you are looking for is the flattening settings.
The default variant of the BigQuery loader does not seem to have any configuration that would allow for that.
The alternative variant does have flattening options that you can try though ... <https://hub.meltano.com/loaders/target-bigquery--jmriego/>

If you feel adventurous, you could try the custom BigQuery loader that is built using the Meltano SDK, but this is not published on the Meltano Hub yet. <https://github.com/z3z1ma/target-bigquery>

There is an open issue for the SDK-based target to be added to the Meltano Hub ... <https://github.com/meltano/hub/issues/625>