Will Musgrave
06/13/2024, 3:39 PMtap-mongodb
(transferwise variant) and I'd like to try to reduce the number of rows that I load in one operation. Instead of loading 100000 rows, is there a way I can load fewer rows?
time=2024-06-13 12:32:32 name=target_postgres level=INFO message=Loading 100000 rows into 'tap_mongodb."*****"'
Reuben (Matatika)
06/13/2024, 4:11 PMtarget-posgres
are you using?Will Musgrave
06/13/2024, 5:05 PMWill Musgrave
06/13/2024, 5:06 PMWill Musgrave
06/13/2024, 5:06 PMWill Musgrave
06/13/2024, 5:06 PMReuben (Matatika)
06/13/2024, 5:08 PMmeltanolabs
, but they both have a batch_size_rows
setting as you have seen (although Meltano's default defers to the SDK default of 10000).