Hello guys, How's it going? I hope all is well on ...
# troubleshooting
a
Hello guys, How's it going? I hope all is well on your end. It's my first time using meltano, and also my first time on this slack channel! and I'm trying to connect to an oracle database. I'm currently having an issue but I'm not sure why. I get: "Separator is found, but chunk is longer than limit". Separator is found, but chunk is longer than limit ╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮ │ /usr/lib/python3.10/asyncio/streams.py:524 in readline │ │ │ │ 521 │ │ sep = b'\n' │ │ 522 │ │ seplen = len(sep) │ │ 523 │ │ try: │ │ ❱ 524 │ │ │ line = await self.readuntil(sep) │ │ 525 │ │ except exceptions.IncompleteReadError as e: │ │ 526 │ │ │ return e.partial │ │ 527 │ │ except exceptions.LimitOverrunError as e: │ │ │ │ /usr/lib/python3.10/asyncio/streams.py:619 in readuntil │ │ │ │ 616 │ │ │ await self._wait_for_data('readuntil') │ │ 617 │ │ │ │ 618 │ │ if isep > self._limit: │ │ ❱ 619 │ │ │ raise exceptions.LimitOverrunError( │ │ 620 │ │ │ │ 'Separator is found, but chunk is longer than limit', isep) │ │ 621 │ │ │ │ 622 │ │ chunk = self._buffer[:isep + seplen] │ ╰──────────────────────────────────────────────────────────────────────────────────────────────────╯ I'd appreciate any sort of feedback and support. Thank you in advance!
v
The exception is more than what you copied here so we can't see the issue (I think?) could you paste the full output, snippets in slack work well
🙏 1
Welcome!
a
My Apologies Dereck, I didn't get what you meant. Shall I paste the whole debug output in this channel?
Untitled
v
This smells like https://docs.meltano.com/reference/settings/#eltbuffer_size Could you try making this 1gb and seeing if it fixes you
a
Thank you for your reply, I’ll try that asap
1
It did not work unfortunately after setting it to 1GB:
Copy code
meltano config meltano set elt.buffer_size 1073741824
v
Can you share your meltano.yml? What I'd do from here is see if the tap runs successfully independent of meltano as this smells like a meltano issue (rare to see this so I'm skeptical) to do that you could run the tap venv directly but I'd start with just meltano invoke tap-name > out . Just to see if it works
a
Sure could you please give me 5 minutes ?
version: 1 default_environment: dev project_id: environments: - name: dev - name: staging - name: prod plugins: extractors: - name: tap-postgres variant: meltanolabs pip_url: git+https://github.com/MeltanoLabs/tap-postgres.git config: database: test user: test host: localhost port: 5432 - name: tap-oracle variant: s7clarke10 pip_url: git+https://github.com/s7clarke10/pipelinewise-tap-oracle.git config: user: test service_name: test port: 1521 ora_python_driver_type: thin host: localhost default_replication_method: FULL_TABLE elt: buffer_size: 1073741824