Hi all! I'm running a job and getting the below er...
# troubleshooting
t
Hi all! I'm running a job and getting the below error, not sure what's happening and the logs aren't very helpful. The extractor is
tap-postgres
and loader
target-bigquery
. Meltano version
2.7.1
. The job was working fine but after a backfill it's now failing and not sure what's happening. Any help would be appreciated
Copy code
Traceback (most recent call last): 
File "/project/.meltano/loaders/target-bigquery/venv/bin/target-bigquery", line 8, in <module> 
     sys.exit(main())           
File "/project/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/__init__.py", line 55, in main 
     tables = json.load(f)      
File "/pyenv/versions/3.8.15/lib/python3.8/json/__init__.py", line 293, in load
     return loads(fp.read(),    
File "/pyenv/versions/3.8.15/lib/python3.8/json/__init__.py", line 357, in loads 
     return _default_decoder.decode(s) 
File "/pyenv/versions/3.8.15/lib/python3.8/json/decoder.py", line 337, in decode 
      obj, end = self.raw_decode(s, idx=_w(s, 0).end()) 
File "/pyenv/versions/3.8.15/lib/python3.8/json/decoder.py", line 353, in raw_decode 
     obj, end = self.scan_once(s, idx) 
json.decoder.JSONDecodeError: Expecting ',' delimiter: line 36 column 1 (char 985) 
2023-04-13T14:21:40.056770Z [error    ] Loader failed
```╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮ │ /pyenv/versions/cgf-meltano/lib/python3.8/site-packages/meltano/core/logging/output_logger.py:20 │ │ 1 in redirect_logging │ │ │ │ 198 │ │ │ *ignore_errors, │ │ 199 │ │ ) │ │ 200 │ │ try: │ │ ❱ 201 │ │ │ yield │ │ 202 │ │ except ignored_errors: # noqa: WPS329 │ │ 203 │ │ │ raise │ │ 204 │ │ except Exception as err: │ │ │ │ ╭────────────────────────────────────────── locals ───────────────────────────────────────────╮ │ │ │ err = RunnerError('Loader failed') │ │ │ │ ignore_errors = () │ │ │ │ ignored_errors = (<class 'KeyboardInterrupt'>, <class 'asyncio.exceptions.CancelledError'>) │ │ │ │ logger = <RootLogger root (INFO)> │ │ │ │ self = <meltano.core.logging.output_logger.Out object at 0x7fe5b1331640> │ │ │ ╰─────────────────────────────────────────────────────────────────────────────────────────────╯ │ │ │ │ /pyenv/versions/cgf-…
p
It looks like there might be something wrong with your
table_config
config. The traceback is saying that loading your JSON in https://github.com/adswerve/target-bigquery/blob/9f6d29edc44ac89b1bf493f94b2893e8b9816b06/target_bigquery/__init__.py#L55 is failing because a delimiter is missing. Can you run
meltano config target-bigquery
to view the config?
t
ahh let me check that
You saved my day Pat, thank you! I had missed a curly bracket in the config