Hey! Just discovered Meltano & Singer and I'm ...
# singer-targets
j
Hey! Just discovered Meltano & Singer and I'm trying to glue together a MySQL DB and BigQuery. I've got the basic pipeline working but the target I'm using (https://github.com/z3z1ma/target-bigquery) doesn't seem to be creating a partitioned table. Just wondered if anyone had any insight? I've checked the source and it looks like it should partition the data by default:
Copy code
"time_partitioning": TimePartitioning(
                type_=TimePartitioningType.MONTH, field="_sdc_batched_at"
            ),
My config:
Copy code
- name: target-bigquery
    variant: z3z1ma
    pip_url: git+<https://github.com/z3z1ma/target-bigquery.git>
    config:
      dataset: <redacted>
      project: <redacted>
      overwrite: true
      partition_granularity: day
      denormalized: true