https://linen.dev logo
#plugins-general
Title
# plugins-general
c

charles_hack

02/09/2022, 9:36 PM
hey all, another noob to Meltano here - running into an error when using
tap-hellobaton
target-bigquery
. has anyone seen this before? I followed instructions exactly as in the READMEs for both the tap and target. 😕 ```2022-02-09T213319.248121Z [info ] INFO activity schema: {'properties': {'id': {'type': 'integer'}, '_self': {'type': 'string'}, 'type': {'type': ['string', 'null']}, 'group': {'type': 'string'}, 'parent': {'type': ['string', 'null']}, 'child': {'type': ['string', 'null']}, 'actor': {'type': ['string', 'null']}, 'project': {'type': 'string'}, 'parent_type': {'type': ['string', 'null']}, 'child_type': {'type': ['string', 'null']}, 'meta': {'type': ['object', 'null']}, 'created': {'format': 'date-time', 'type': 'string'}, 'modified': {'format': 'date-time', 'type': 'string'}}} cmd_type=loader job_id=2022-02-09T213315--tap-hellobaton--target-bigquery name=target-bigquery run_id=6bffdd0c-cd23-4d24-8716-8ff330f4691f stdio=stderr 2022-02-09T213319.758702Z [info ] time=2022-02-09 163319 name=tap-hellobaton level=INFO message=INFO METRIC: {'type': 'timer', 'metric': 'http_request_duration', 'value': 1.049385, 'tags': {'endpoint': '/activity/', 'http_status_code': 200, 'status': 'succeeded'}} cmd_type=extractor job_id=2022-02-09T213315--tap-hellobaton--target-bigquery name=tap-hellobaton run_id=6bffdd0c-cd23-4d24-8716-8ff330f4691f stdio=stderr 2022-02-09T213319.759769Z [info ] CRITICAL 'RECORD' cmd_type=loader job_id=2022-02-09T213315--tap-hellobaton--target-bigquery name=target-bigquery run_id=6bffdd0c-cd23-4d24-8716-8ff330f4691f stdio=stderr 2022-02-09T213319.761067Z [info ] CRITICAL ['Traceback (most recent call last):\n', ' File "/Users/chack/Documents/engineering/meltano-projects/baton/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/__init__.py", line 129, in main\n for state in state_iterator:\n', ' File "/Users/chack/Documents/engineering/meltano-projects/baton/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/process.py", line 54, in process\n for s in handler.handle_record_message(msg):\n', ' File "/Users/chack/Documents/engineering/meltano-projects/baton/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/processhandler.py", line 179, in handle_record_message\n nr = format_record_to_schema(nr, self.bq_schema_dicts[stream])\n', ' File "/Users/chack/Documents/engineering/meltano-projects/baton/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/schema.py", line 359, in format_record_to_schema\n record[k] = conversion_dict[bq_schema[k]["type"]](v)\n', "KeyError: 'RECORD'\n"] cmd_type=loader job_id=2022-02-09T213315--tap-hellobaton--target-bigquery name=target-bigquery run_id=6bffdd0c-cd23-4d24-8716-8ff330f4691f stdio=stderr 2022-02-09T213319.837095Z [error ] Loading failed code=2 job_id=2022-02-09T213315--tap-hellobaton--target-bigquery message=CRITICAL ['Traceback (most recent call last):\n', ' File "/Users/chack/Documents/engineering/meltano-projects/baton/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/__init__.py", line 129, in main\n for state in state_iterator:\n', ' File "/Users/chack/Documents/engineering/meltano-projects/baton/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/process.py", line 54, in process\n for s in handler.handle_record_message(msg):\n', ' File "/Users/chack/Documents/engineering/meltano-projects/baton/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/processhandler.py", line 179, in handle_record_message\n nr = format_record_to_schema(nr, self.bq_schema_dicts[stream])\n', ' File "/Users/chack/Documents/engineering/meltano-projects/baton/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/schema.py", line 359, in format_record_to_schema\…