I'm running a pipeline with `tap-singer-jsonl -&gt...
# troubleshooting
i
I'm running a pipeline with
tap-singer-jsonl -> target-redshift
and although I have the S3 State Backend configured it doesn't seem to be used. Every run of the pipeline results in all of the files in the S3 bucket being read. Anyone else encountered this?
i
Thanks @edgar_ramirez_mondragon I'll dig around and see if I can find another extractor that can handle both state and jsonl.
Looks like I can use
tap-spreadsheets-anywhere
- the caveat being that I can't seem to use any environment variables to modify the config for different source environments.