Hi team, I’m trying to get started with Meltano fr...
# troubleshooting
g
Hi team, I’m trying to get started with Meltano from playing with
tap-bigquery
and
target-bigquery
. When running
meltano --environment=dev run tap-bigquery target-bigquery
, I got error messages shown
Invalid table ID
. The detail error messages are listed as follows. ```2022-08-24T091518.251870Z [info ] ERROR failed to load table t_gdw_bq.nyc_taxi_trips.yellow_2022_sample_suffix_a084084d32814c1f9df0b944764d43d1 from file: 400 POST https://bigquery.googleapis.com/upload/bigquery/v2/projects/<GCP_PROJECT_ID>/jobs?uploadType=resumable: Invalid table ID "t_gdw_bq.nyc_taxi_trips.yellow_2022_sample_suffix_a084084d32814c1f9df0b944764d43d1". cmd_type=elb consumer=True name=target-bigquery producer=False stdio=stderr string_id=target-bigquery 2022-08-24T091518.252402Z [info ] CRITICAL 400 POST https://bigquery.googleapis.com/upload/bigquery/v2/projects/<GCP_PROJECT_ID>/jobs?uploadType=resumable: Invalid table ID "t_gdw_bq.nyc_taxi_trips.yellow_2022_sample_suffix_a084084d32814c1f9df0b944764d43d1". cmd_type=elb consumer=True name=target-bigquery producer=False stdio=stderr string_id=target-bigquery 2022-08-24T091518.257642Z [info ] CRITICAL ['Traceback (most recent call last):\n', ' File "/Users/tsungchih/Documents/projects/meltano/getting-started/.meltano/loaders/target-bigquery/venv/lib/python3.9/site-packages/google/cloud/bigquery/client.py", line 2423, in load_table_from_file\n response = self._do_resumable_upload(\n', ' File "/Users/tsungchih/Documents/projects/meltano/getting-started/.meltano/loaders/target-bigquery/venv/lib/python3.9/site-packages/google/cloud/bigquery/client.py", line 2808, in _do_resumable_upload\n upload, transport = self._initiate_resumable_upload(\n', ' File "/Users/tsungchih/Documents/projects/meltano/getting-started/.meltano/loaders/target-bigquery/venv/lib/python3.9/site-packages/google/cloud/bigquery/client.py", line 2872, in _initiate_resumable_upload\n upload.initiate(\n', ' File "/Users/tsungchih/Documents/projects/meltano/getting-started/.meltano/loaders/target-bigquery/venv/lib/python3.9/site-packages/google/resumable_media/requests/upload.py", line 420, in initiate\n return _request_helpers.wait_and_retry(\n', ' File "/Users/tsungchih/Documents/projects/meltano/getting-started/.meltano/loaders/target-bigquery/venv/lib/python3.9/site-packages/google/resumable_media/requests/_request_helpers.py", line 148, in wait_and_retry\n response = func()\n', ' File "/Users/tsungchih/Documents/projects/meltano/getting-started/.meltano/loaders/target-bigquery/venv/lib/python3.9/site-packages/google/resumable_media/requests/upload.py", line 416, in retriable_request\n self._process_initiate_response(result)\n', ' File "/Users/tsungchih/Documents/projects/meltano/getting-started/.meltano/loaders/target-bigquery/venv/lib/python3.9/site-packages/google/resumable_media/_upload.py", line 509, in _process_initiate_response\n _helpers.require_status_code(\n', ' File "/Users/tsungchih/Documents/projects/meltano/getting-started/.meltano/loaders/target-bigquery/venv/lib/python3.9/site-packages/google/resumable_media/_helpers.py", line 105, in require_status_code\n raise common.InvalidResponse(\n', "google.resumable_media.common.InvalidResponse: ('Request failed with status code', 400, 'Expected one of', <HTTPStatus.OK: 200>, <HTTPStatus.CREATED: 201>)\n", '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/Users/tsungchih/Documents/projects/meltano/getting-started/.meltano/loaders/target-bigquery/venv/lib/python3.9/site-packages/target_bigquery/__init__.py", line 129, in main\n for state in state_iterator:\n', ' File "/Users/tsungchih/Documents/projects/meltano/getting-started/.meltano/loaders/target-bigquery/venv/lib/python3.9/site-packages/target_bigquery/process.py", line 77, in process\n for s in handler.on_stream_end():\n', ' File "/Users/tsungchih/Doc…
j
Not 100% but just looking at the logs. The logs show the table trying to be created as: `t_gdw_`bq.nyc_taxi_trips.yellow_2022_sample_suffix_a084084d32814c1f9df0b944764d43d1"`.\n`' Where you table prefix is just
gdw_
g
Thank you for the quick reply. I’ve tried to unset
table_prefix
and
table_suffix
. The error messages remained the same.