Hello everyone, I'm using a custom tap `tap-odoo` ...
# troubleshooting
s
Hello everyone, I'm using a custom tap
tap-odoo
I noticed that one of the streams had not loaded a record (it has loaded all the previous ones for the same
ID
but not this) .The records that was missing has the
write_date = '2024-11-15'
while the state for that stream looks like:
Copy code
"stock_move": {
				"replication_key": "write_date",
				"replication_key_value": "2024-11-20 07:24:21",
				"replication_key_signpost": "2024-11-20T07:08:40.972393+00:00",
				"starting_replication_value": "2024-11-01 00:00:00",
				"progress_markers": {
					"Note": "Progress is not resumable if interrupted.",
					"replication_key": "write_date",
					"replication_key_value": "2024-11-20 07:22:05"
				}
			},
1. How do I investigate why this record was not loaded in the first place (reasons it might have gotten missed) 2. I reran the stream by manually setting state for this stream
Copy code
replication_key_value = '2024-11-01 00:00:00"
and still that record is missing. Why did it get missed again? P.S. this is an incremental sync stream, with
primary_key = ID
a
What target are you using? Can you try running the tap to something simple like
target-jsonl
and determine whether the issue is with your tap or target?
s
I'm using
target-bigquery
. Interesting suggestion though. Let me run that
a
Or you can run
meltano invoke tap-odoo > out.json
if you don't have
target-jsonl
added. Basically try to isolate the issue to your tap or target
s
Invoke wouldn't load any data right? The connection (Tap-odoo to target bigquery) runs jusr fine, only this record is skipped
a
invoke will print tap output to screen
s
oh ok