Kevin Phan
12/17/2024, 10:28 PM2024-12-17T22:22:00.910855Z [error ] The extractor generated a message exceeding the message size limit of 5.0MiB (half the buffer size of 10.0MiB).
2024-12-17T22:22:00.911147Z [error ] To let this message be processed, increase the 'elt.buffer_size' setting to at least double the size of the largest expected message, and try again.
2024-12-17T22:22:00.911327Z [error ] To learn more, visit <https://docs.meltano.com/reference/settings#eltbuffer_size>
2024-12-17T22:22:00.934366Z [error ] Output line length limit exceeded
2024-12-17T22:22:00.934764Z [error ] Block run completed.
if i set an env var MELTANO_ELT_BUFFER_SIZE
in my cluster to 100mib, does meltano automatically grab that value?Reuben (Matatika)
12/17/2024, 10:59 PMv3.6.0
bumped this to 100MiB: https://github.com/meltano/meltano/pull/8917