Rafael Rotter
05/09/2025, 2:41 PMtarget-bigqeury
(z3z1ma) to receive data from MongoDB into BigQuery.
I managed to send some collections to the target (not all), but some questions arose. If you could help me when you can, please, I would appreciate it:
1. How can I specify in target-bigquery
some tables in BigQuery that should be partitioned by field X and clustered by Y, Z?
2. Why are two tables created in BigQuery: one with the execution time suffix, with data, and another without suffix and without data? Is a new table created with each load? (attached file)
3. I would like to confirm: normally there is no change in the MongoDB schema, but it can occur in case of an update. I am using denormalized: true. In case of a change, this can impact the load, correct?
4. The last error I got was "`ParseError: null is not allowed to be used as an element in a repeated field at processo.prioridade[0]`". Is it possible to handle this in stream-maps?
Thanks!Edgar Ramírez (Arch.dev)
05/09/2025, 6:08 PMRafael Rotter
05/09/2025, 6:36 PMEdgar Ramírez (Arch.dev)
05/09/2025, 7:33 PM