visch
05/15/2025, 4:03 PMnull
yaml
metadata:
"*":
replication-method: INCREMENTAL
replication-key: modified_date
example_stream:
key-properties: [key_id]
replication-method: FULL_TABLE
replication-key: null
I remember having this question and issues around it with stream maps, and it was solved with a _NULL_
value or something in stream maps, but I'm not sure if we have a way to do this in metadata.
Right now what happens is the replication-key
stays set to modified_date
for the example_stream
instead of being NULL
Which is an issue for us as the SDK still trys to pull information for State sign posts for FULL_TABLE syncsvisch
05/15/2025, 4:08 PMreplication-key
to "" works (probably gets caught as non_truthy in the sdk so we're good 🤷 )visch
05/15/2025, 4:11 PMmodified_date
not existing in the schema a fix is to set replication-key
to anything that Python truthyness recognizes as falseEdgar RamÃrez (Arch.dev)
05/15/2025, 11:53 PMEdgar RamÃrez (Arch.dev)
05/16/2025, 3:57 PMvisch
05/19/2025, 1:45 PM