Shubham Kawade
11/20/2024, 7:53 AMtap-odoo
I noticed that one of the streams had not loaded a record (it has loaded all the previous ones for the same ID
but not this) .The records that was missing has the write_date = '2024-11-15'
while the state for that stream looks like:
"stock_move": {
"replication_key": "write_date",
"replication_key_value": "2024-11-20 07:24:21",
"replication_key_signpost": "2024-11-20T07:08:40.972393+00:00",
"starting_replication_value": "2024-11-01 00:00:00",
"progress_markers": {
"Note": "Progress is not resumable if interrupted.",
"replication_key": "write_date",
"replication_key_value": "2024-11-20 07:22:05"
}
},
1. How do I investigate why this record was not loaded in the first place (reasons it might have gotten missed)
2. I reran the stream by manually setting state for this stream
replication_key_value = '2024-11-01 00:00:00"
and still that record is missing. Why did it get missed again?
P.S. this is an incremental sync stream, with primary_key = ID
Andy Carter
11/20/2024, 8:21 AMtarget-jsonl
and determine whether the issue is with your tap or target?Shubham Kawade
11/20/2024, 8:42 AMtarget-bigquery
. Interesting suggestion though. Let me run thatAndy Carter
11/20/2024, 8:45 AMmeltano invoke tap-odoo > out.json
if you don't have target-jsonl
added. Basically try to isolate the issue to your tap or targetShubham Kawade
11/20/2024, 8:47 AMAndy Carter
11/20/2024, 8:47 AMShubham Kawade
11/20/2024, 8:48 AM