Hey folks! Does anyone know the batch size param for MySQL? We added target-mysql but batch_size parameter isn't working with target-mysql

- name: target-mysql
    variant: thkwag
    pip_url: thk-target-mysql
    config:
      sqlalchemy_url: ${TARGET_MYSQL_SQLALCHEMY_URL}
      batch_size: 1000

We added target-mysql but batch_size parameter isn't working with target-mysql

I dont see that setting listed on the hub https://hub.meltano.com/loaders/target-mysql#settings. Is that a supported setting?

From a different thread: last question: since we don't have a batch size, what happens on runs with millions of rows -- will it just all load at once at the end? could that crash the loader?

The SDK handles gracefully flushing batches of records to the database. It flushes records after it hits one of a few indicators: a batch records count, a time limit in minutes is reached, if the schema changes, etc. We'd have to look into these implementations more to make sure they arent overriding the default behavior though.