Hi Team, New to Meltano, Requesting for a help to ...
# troubleshooting
s
Hi Team, New to Meltano, Requesting for a help to understand this error "[error ] Block run completed. block_type=ExtractLoadBlocks err=RunnerError('Loader failed') exit_codes={<PluginType.LOADERS: 'loaders'>: 1} set_number=0 success=False" and how do we troubleshoot with Meltano error's ?
Copy code
meltano run tap-postgres target-bigquery
gets me to the above error., for pg i am able to check my config using '''meltano config target-postgres test'''
but for target-bigquery how do we test if my connection is right ? and the connector is able to communicate with my BQ access . ?
@here ^^
w
I haven't used bigquery before with meltano - but I would try meltano invoke with your big query connection
so something like
Copy code
meltano invoke --log-level=debug target-bigquery
e
Yeah, a good general of debugging pipelines is to: 1. Direct the tap output to a file, e.g.
meltano invoke my-tap > singer.jsonl
2. Pass the contents of the file to the target,
cat singer.jsonl | meltano invoke my-target
3. Inspect the contents of
singer.jsonl
if the above fails