Hi, I’ve encountered the following error that my l...
# troubleshooting
o
Hi, I’ve encountered the following error that my loader is failing although it seems to finish successfully.
Copy code
meltano               | elt       | Loading failed (-11)
I was running
meltano elt
and the meltano version is v1.88.0 with python 3.7 Can you please advise here?
r
Can you dump output with
--log-level debug
?
o
Sure, running it now
Got the following ```meltano | elt | DEBUG Deleted configuration at /project/.meltano/run/elt/elt_salesforce-critical-separate_sfcsv2_2_main/1b4e36ed-c00c-4a30-a6fe-328058a57130/target.39f28fe0-b071-434d-8a71-cfa5089cd045.config.json meltano | elt | DEBUG Deleted configuration at /project/.meltano/run/elt/elt_salesforce-critical-separate_sfcsv2_2_main/1b4e36ed-c00c-4a30-a6fe-328058a57130/tap.1f2ccb75-b441-418b-b72d-d9a65a6995a4.config.json meltano | elt | ERROR Loading failed (-11): INFO State: {'bookmarks': {'pse__Schedule__c': {'version': 1627201313925, 'SystemModstamp': '2022-09-20T171751.000000Z'}, 'CaseComment': {'version': 1627201313711, 'SystemModstamp': '2022-09-20T191824.000000Z'}, 'Case': {'version': 1627201313962, 'SystemModstamp': '2022-09-20T192501.000000Z'}, 'AccountContactRelation': {'version': 1641625192566, 'SystemModstamp': '2022-09-20T184745.000000Z'}, 'SBQQ__DiscountTier__c': {'version': 1627201313825, 'SystemModstamp': '2022-05-04T030152.000000Z'}, 'TAM_Comments__c': {'version': 1640621582447, 'SystemModstamp': '2022-09-20T083822.000000Z'}, 'Agent_Status__c': {'version': 1640621582301, 'SystemModstamp': '2022-09-20T190021.000000Z'}, 'Projects__c': {'version': 1627201313846, 'SystemModstamp': '2016-09-09T185907.000000Z'}}} meltano | elt | DEBUG ELT could not be completed: Loader failed Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/meltano/cli/elt.py", line 242, in _run_elt await _run_extract_load(elt_context, output_logger) File "/usr/local/lib/python3.7/site-packages/meltano/cli/elt.py", line 289, in _run_extract_load loader_out=loader_out_writer, File "/usr/local/lib/python3.7/site-packages/meltano/core/runner/singer.py", line 230, in run loader_out=loader_out, File "/usr/local/lib/python3.7/site-packages/meltano/core/runner/singer.py", line 206, in invoke raise RunnerError("Loader failed", {PluginType.LOADERS: target_code}) meltano.core.runner.RunnerError: Loader failed The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/meltano/cli/elt.py", line 230, in _redirect_output yield File "/usr/local/lib/python3.7/site-packages/meltano/cli/elt.py", line 251, in _run_elt raise CliError(f"ELT could not be completed: {err}") from err meltano.cli.utils.CliError: ELT could not be completed: Loader failed meltano | elt | ELT could not be completed: Loader failed [2022-09-20 195722,320] [1|MainThread|meltano.cli.utils] [DEBUG] ELT could not be completed: Loader failed Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/meltano/cli/elt.py", line 242, in _run_elt await _run_extract_load(elt_context, output_logger) File "/usr/local/lib/python3.7/site-packages/meltano/cli/elt.py", line 289, in _run_extract_load loader_out=loader_out_writer, File "/usr/local/lib/python3.7/site-packages/meltano/core/runner/singer.py", line 230, in run loader_out=loader_out, File "/usr/local/lib/python3.7/site-packages/meltano/core/runner/singer.py", line 206, in invoke raise RunnerError("Loader failed", {PluginType.LOADERS: target_code}) meltano.core.runner.RunnerError: Loader failed The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/meltano/cli/__init__.py", line 45, in main cli(obj={"project": None}) File "/usr/local/lib/python3.7/site-packages/click/core.py", line 829, in call return self.main(*args, **kwargs) File "/usr/local/lib/python3.7/site-packages/click/core.py", line 782, in main rv = self.invoke(ctx) File "/usr/local/lib/python3.7/site-packages/click/core.py", line 1259, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) Fil…
r
Hmm... I don't see much to go off here apart from that
-11
. Given it's a return code, this SO answer seems to indicate it could be related to a segmentation fault. What target are you using?
o
We’ve built a custom target that pushes parquet files to s3
r
Have you set up any logging in the target?
o
Yep
Also I see the last line of log
But it still says that the loader is failing