Andy Carter
06/01/2023, 1:31 PMMELTANO_ELT_BUFFER_SIZE
be set as a plugin level using env:
key within meltano.yml
like below? I've tried it, but it doesn't seem to have the desired effect. Does it have to be a top level env var and therfore applied to all plugins?
- name: tap-spreadsheets-anywhere
pip_url: git+<https://github.com/acarter24/tap-spreadsheets-anywhere.git>
env:
MELTANO_ELT_BUFFER_SIZE: '52428800' # some csv files from Dynamics contain very large fields
config:
tables: []
https://docs.meltano.com/reference/settings#eltbuffer_size