Have a target-mssql, I want to know the number of rows in the source stream to do a check that the data is close to accurate.
In tap-oracle the catalog has a row-count populated for each stream. I'd like to get the data and use it to see whether my target has received those records properly.
There's issues around your row-count from your catalog being out of sync with the new data in your tap so need to be careful about not saying source.rowcount == target.rowcount but if target.rowcount is 50% of source.rowcount I"d like to throw an error and not continue
Closest writeup on this I can find is
https://www.stitchdata.com/docs/replication/deleted-record-handling#full-table and the metadata columns in a target like
https://github.com/transferwise/pipelinewise-target-postgres