Hey, I am using

tap-bigquery

(

anelendata

variant). Loading to any target fails with error message

Extraction failed

and the code is

-11

. Even though it fails, everything is stored in a target (tested with target-jsonl and target-redshift). Apparently it tries to update the state when the run is completed, but fails. Has someone faced anything similar? The command I execute:

meltano el tap-bigquery-ga4 target-jsonl --catalog catalog.json

These are the last logs:

2023-10-25T04:47:31.105453Z [info     ] INFO METRIC: {"type": "counter", "metric": "record_count", "value": 21, "tags": {"endpoint": "events"}} cmd_type=extractor name=tap-bigquery-ga4 run_id=2165e519-b6b8-49a7-b51e-147b44c7c326 state_id=2023-10-25T044725--tap-bigquery-ga4--target-jsonl stdio=stderr
2023-10-25T04:47:31.105673Z [info     ] INFO Syncing stream:events     cmd_type=extractor name=tap-bigquery-ga4 run_id=2165e519-b6b8-49a7-b51e-147b44c7c326 state_id=2023-10-25T044725--tap-bigquery-ga4--target-jsonl stdio=stderr
2023-10-25T04:47:31.253967Z [info     ] Incremental state has been updated at 2023-10-25 04:47:31.253889.
2023-10-25T04:47:31.255243Z [error    ] Extraction failed              code=-11 message=INFO Syncing stream:events name=meltano run_id=2165e519-b6b8-49a7-b51e-147b44c7c326 state_id=2023-10-25T044725--tap-bigquery-ga4--target-jsonl
2023-10-25T04:47:31.255653Z [info     ] ELT could not be completed: Extractor failed. cmd_type=elt name=meltano run_id=2165e519-b6b8-49a7-b51e-147b44c7c326 state_id=2023-10-25T044725--tap-bigquery-ga4--target-jsonl stdio=stderr
2023-10-25T04:47:31.255750Z [info     ] For more detailed log messages re-run the command using 'meltano --log-level=debug ...' CLI flag. cmd_type=elt name=meltano run_id=2165e519-b6b8-49a7-b51e-147b44c7c326 state_id=2023-10-25T044725--tap-bigquery-ga4--target-jsonl stdio=stderr

With the debug cmd I get more info when exactly it happens, but still cannot understand the root cause:

2023-10-25T04:25:43.836882Z [info     ] INFO Syncing stream:events     cmd_type=extractor name=tap-bigquery-ga4 run_id=2b7da2ef-2fdf-4215-815c-2035d0a14a04 state_id=2023-10-25T042538--tap-bigquery-ga4--target-jsonl stdio=stderr
2023-10-25T04:25:43.930337Z [debug    ] {"currently_syncing": "events", "bookmarks": {"events": {"last_update": "2023-10-17T23:59:57.928543"}}} cmd_type=loader name=target-jsonl (out) run_id=2b7da2ef-2fdf-4215-815c-2035d0a14a04 state_id=2023-10-25T042538--tap-bigquery-ga4--target-jsonl stdio=stdout
2023-10-25T04:25:43.935377Z [debug    ] Added to state 2023-10-25T042538--tap-bigquery-ga4--target-jsonl state payload {'singer_state': {'currently_syncing': 'events', 'bookmarks': {'events': {'last_update': '2023-10-17T23:59:57.928543'}}}}
2023-10-25T04:25:43.948013Z [info     ] Incremental state has been updated at 2023-10-25 04:25:43.947909.
2023-10-25T04:25:43.948070Z [debug    ] Incremental state: {'currently_syncing': 'events', 'bookmarks': {'events': {'last_update': '2023-10-17T23:59:57.928543'}}}
2023-10-25T04:25:43.948677Z [debug    ] Deleted configuration at .meltano/run/elt/2023-10-25T042538--tap-bigquery-ga4--target-jsonl/2b7da2ef-2fdf-4215-815c-2035d0a14a04/target.74d2e2d9-e41c-4e45-a3ac-ec8dac798b10.config.json
2023-10-25T04:25:43.948919Z [debug    ] Deleted configuration at .meltano/run/elt/2023-10-25T042538--tap-bigquery-ga4--target-jsonl/2b7da2ef-2fdf-4215-815c-2035d0a14a04/tap.032b8b06-1bb0-4997-a01e-a7e4df36cdf5.config.json
2023-10-25T04:25:43.948960Z [error    ] Extraction failed              code=-11 message=INFO Syncing stream:events name=meltano run_id=2b7da2ef-2fdf-4215-815c-2035d0a14a04 state_id=2023-10-25T042538--tap-bigquery-ga4--target-jsonl
2023-10-25T04:25:44.049093Z [debug    ] ELT could not be completed: Extractor failed.