Hey community, I'm using meltano 1.77 and I'm trying to run tap-shopify to write data in bigquery (using target-bigquery from adswerve). And I get the following error: ```tap-shopify | INFO --> 200 OK 311990b tap-shopify | INFO METRIC: {"type": "timer", "metric": "http_request_duration", "value": 4.836130142211914, "tags": {"endpoint": "abandoned_checkouts", "status": "succeeded"}} target-bigquery | CRITICAL 'RECORD' target-bigquery | CRITICAL ['Traceback (most recent call last):\n', ' File "/home/delson/repos/insider-data-pipelines/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/__init__.py", line 103, in main\n for state in state_iterator:\n', ' File "/home/delson/repos/insider-data-pipelines/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/process.py", line 54, in process\n for s in handler.handle_record_message(msg):\n', ' File "/home/delson/repos/insider-data-pipelines/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/processhandler.py", line 171, in handle_record_message\n nr = format_record_to_schema(nr, self.bq_schema_dicts[stream])\n', ' File "/home/delson/repos/insider-data-pipelines/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/schema.py", line 343, in format_record_to_schema\n record[k] = format_record_to_schema(record[k], bq_schema[k]["fields"])\n', ' File "/home/delson/repos/insider-data-pipelines/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/schema.py", line 329, in format_record_to_schema\n r = format_record_to_schema(r, bq_schema)\n', ' File "/home/delson/repos/insider-data-pipelines/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/schema.py", line 346, in format_record_to_schema\n record[k] = [conversion_dict[bq_schema[k]["type"]](vi) for vi in v]\n', ' File "/home/delson/repos/insider-data-pipelines/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/schema.py", line 346, in <listcomp>\n record[k] = [conversion_dict[bq_schema[k]["type"]](vi) for vi in v]\n', "KeyError: 'RECORD'\n"] meltano | Loading failed (2): CRITICAL ['Traceback (most recent call last):\n', ' File "/home/delson/repos/insider-data-pipelines/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/__init__.py", line 103, in main\n for state in state_iterator:\n', ' File "/home/delson/repos/insider-data-pipelines/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/process.py", line 54, in process\n for s in handler.handle_record_message(msg):\n', ' File "/home/delson/repos/insider-data-pipelines/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/processhandler.py", line 171, in handle_record_message\n nr = format_record_to_schema(nr, self.bq_schema_dicts[stream])\n', ' File "/home/delson/repos/insider-data-pipelines/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/schema.py", line 343, in format_record_to_schema\n record[k] = format_record_to_schema(record[k], bq_schema[k]["fields"])\n', ' File "/home/delson/repos/insider-data-pipelines/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/schema.py", line 329, in format_record_to_schema\n r = format_record_to_schema(r, bq_schema)\n', ' File "/home/delson/repos/insider-data-pipelines/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/schema.py", line 346, in format_record_to_schema\n record[k] = [conversion_dict[bq_schema[k]["type"]](vi) for vi in v]\n', ' File "/home/delson/repos/insider-data-pipelines/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/schema.py", line 346, in <listcomp>\n record[k] = [conversion_dict[bq_schema[k]["type"]](vi) for vi in v]…

You might give the pipelinewise variant of target-bigquery a try.

This sounds like the target may be receiving an invalid

SCHEMA

or

RECORD

message from the tap. Can you run in again debug mode (with

meltano --log-level=debug elt …

) and share the

SCHEMA

and

RECORD

messages that are output by the tap just before this error came up? You’ll find those tap output lines prefixed with

tap-shopify (out)

I've been trying to solve the same issue for the past month. I'm stuck on remapping the schema. @douwe_maan @delson_barros Did you find any solutions?