Is this setting only for DB to DB in snowflake or ...
# troubleshooting
s
Is this setting only for DB to DB in snowflake or it will work for API to DB syncs
Copy code
batch_size_rows: 150000
              batch_config:
                batch_size: 150000
                encoding:
                  format: jsonl
                  compression: gzip
                storage:
                  root: ""
I don't see this happening for API calls, as the data I pull is below 10000 when I see target it is still loading data inbetween the batch size , So I was wondering if I am doing something wrong .