I'm running into an issue where meltano runs for a...
# troubleshooting
k
I'm running into an issue where meltano runs for around 3 hours and then just suddenly dies with the message:
Run invocation could not be completed as block failed: Extractor failed
. I'm running a fairly simple
tap-postgres
to
target-postgres
pipeline and I see data in my destination but it always fails around 3 hours with that same message
```2023-02-23T193613.290597Z [error ] Extractor failed 2023-02-23T193613.291923Z [error ] Block run completed. block_type=ExtractLoadBlocks err=RunnerError('Extractor failed') exit_codes={<PluginType.EXTRACTORS: 'extractors'>: 1} set_number=0 success=False 2023-02-23T193615.559793Z [debug ] Need help fixing this problem? Visit http://melta.no/ for troubleshooting steps, or to join our friendly Slack community. Run invocation could not be completed as block failed: Extractor failed Traceback (most recent call last): File "/home/ec2-user/.local/pipx/venvs/meltano/lib/python3.9/site-packages/meltano/cli/run.py", line 159, in _run_blocks await blk.run() File "/home/ec2-user/.local/pipx/venvs/meltano/lib/python3.9/site-packages/meltano/core/block/extract_load.py", line 438, in run await self.run_with_job() File "/home/ec2-user/.local/pipx/venvs/meltano/lib/python3.9/site-packages/meltano/core/block/extract_load.py", line 464, in run_with_job await self.execute() File "/home/ec2-user/.local/pipx/venvs/meltano/lib/python3.9/site-packages/meltano/core/block/extract_load.py", line 430, in execute await manager.run() File "/home/ec2-user/.local/pipx/venvs/meltano/lib/python3.9/site-packages/meltano/core/block/extract_load.py", line 629, in run _check_exit_codes( File "/home/ec2-user/.local/pipx/venvs/meltano/lib/python3.9/site-packages/meltano/core/block/extract_load.py", line 778, in _check_exit_codes raise RunnerError("Extractor failed", {PluginType.EXTRACTORS: producer_code}) meltano.core.runner.RunnerError: Extractor failed The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/ec2-user/.local/pipx/venvs/meltano/lib/python3.9/site-packages/meltano/cli/__init__.py", line 87, in _run_cli cli(obj={"project": None}) File "/home/ec2-user/.local/pipx/venvs/meltano/lib/python3.9/site-packages/click/core.py", line 1130, in call return self.main(*args, **kwargs) File "/home/ec2-user/.local/pipx/venvs/meltano/lib/python3.9/site-packages/meltano/cli/cli.py", line 43, in main return super().main(*args, windows_expand_args=False, **kwargs) File "/home/ec2-user/.local/pipx/venvs/meltano/lib/python3.9/site-packages/click/core.py", line 1055, in main rv = self.invoke(ctx) File "/home/ec2-user/.local/pipx/venvs/meltano/lib/python3.9/site-packages/meltano/cli/utils.py", line 645, in invoke super().invoke(ctx) File "/home/ec2-user/.local/pipx/venvs/meltano/lib/python3.9/site-packages/click/core.py", line 1657, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/home/ec2-user/.local/pipx/venvs/meltano/lib/python3.9/site-packages/meltano/cli/utils.py", line 691, in invoke super().invoke(ctx) File "/home/ec2-user/.local/pipx/venvs/meltano/lib/python3.9/site-packages/click/core.py", line 1404, in invoke return ctx.invoke(self.callback, **ctx.params) File "/home/ec2-user/.local/pipx/venvs/meltano/lib/python3.9/site-packages/click/core.py", line 760, in invoke return __callback(*args, **kwargs) File "/home/ec2-user/.local/pipx/venvs/meltano/lib/python3.9/site-packages/meltano/cli/params.py", line 27, in decorate return func(*args, **kwargs) File "/home/ec2-user/.local/pipx/venvs/meltano/lib/python3.9/site-packages/meltano/cli/params.py", line 76, in decorate func(project, *args, **kwargs) File "/home/ec2-user/.local/pipx/venvs/meltano/lib/python3.9/site-packages/click/decorators.py", line 26, in new_func return f(get_current_context(), *args, **kwargs) File "/home/ec2-user/.local/pipx/venvs/meltano/lib/python3.9/site-packages/meltano/core/utils/__init__.py", line 86, in wrapper return asyncio.run(func(*args, **kwargs)) File "/usr/local/lib/python3.9/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.9/asyncio/base_events.py", line 642, in run_until_complete retur…