emcp
03/05/2022, 8:54 AMValueError: Separator is not found, and chunk exceed the limit
? I am guessing my data came back in some unexpected way and I didn’t handle it correctly for the singer spec?
``````emcp
03/05/2022, 8:54 AM2022-03-05T08:39:59.377822Z [info ] time=2022-03-05 09:39:59 name=tap-ibkr level=INFO message=parentStream None cmd_type=extractor job_id=ibkr-to-postgres-tickers name=tap-ibkr-tickers run_id=eabaef06-7204-42c1-9a93-7ea4158edcde stdio=stderr
2022-03-05T08:39:59.378156Z [info ] time=2022-03-05 09:39:59 name=tap-ibkr level=INFO message=schema {'type': 'object', 'properties': {'symbol': {'type': ['string', 'null']}, 'sec_type': {'type': ['string', 'null']}, 'primary_exchange': {'type': ['string', 'null']}, 'exchange': {'type': ['string', 'null']}, 'currency': {'type': ['string', 'null']}, 'contract_id': {'type': ['integer', 'null']}, 'query_start_time': {'type': ['string', 'null'], 'format': 'date-time'}}} cmd_type=extractor job_id=ibkr-to-postgres-tickers name=tap-ibkr-tickers run_id=eabaef06-7204-42c1-9a93-7ea4158edcde stdio=stderr
2022-03-05T08:40:01.230541Z [error ] Separator is not found, and chunk exceed the limit
Traceback (most recent call last):
File "/usr/lib/python3.8/asyncio/streams.py", line 540, in readline
line = await self.readuntil(sep)
File "/usr/lib/python3.8/asyncio/streams.py", line 618, in readuntil
raise exceptions.LimitOverrunError(
asyncio.exceptions.LimitOverrunError: Separator is not found, and chunk exceed the limit
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/meltano/core/logging/output_logger.py", line 127, in redirect_logging
yield
File "/usr/local/lib/python3.8/dist-packages/meltano/cli/elt.py", line 231, in _redirect_output
yield
File "/usr/local/lib/python3.8/dist-packages/meltano/cli/elt.py", line 243, in _run_elt
await _run_extract_load(log, elt_context, output_logger)
File "/usr/local/lib/python3.8/dist-packages/meltano/cli/elt.py", line 304, in _run_extract_load
await singer_runner.run(
File "/usr/local/lib/python3.8/dist-packages/meltano/core/runner/singer.py", line 224, in run
await self.invoke(
File "/usr/local/lib/python3.8/dist-packages/meltano/core/runner/singer.py", line 152, in invoke
raise failed_future.exception()
File "/usr/local/lib/python3.8/dist-packages/meltano/core/logging/utils.py", line 160, in capture_subprocess_output
line = await reader.readline()
File "/usr/lib/python3.8/asyncio/streams.py", line 549, in readline
raise ValueError(e.args[0])
ValueError: Separator is not found, and chunk exceed the limit