Quick question, I have a custom tap that pulls balance data from talos. i have it as incremental based on an updated at field from the API itself. When i do the incremental run to snowflake, /i am seeing

2025-04-29T19:27:10.966335Z [info     ] time=2025-04-29 15:27:10 name=target_snowflake level=INFO message=Loading into talos_meltano_dev."BALANCES": {"inserts": 0, "updates": 8005, "size_bytes": 115101} cmd_type=elb consumer=True job_name=dev:tap-talos-to-target-snowflake-talos name=target-snowflake-talos producer=False run_id=a49d7e97-c5f6-4f9c-8c97-f7e60c7f9d66 stdio=stderr string_id=target-snowflake-talos

the inserts is 0 which is correct because nothing changed from the last run but i see updates is 8005 = number of rows. It is updating the

sdc batched at

and other sdc metadata fields. My question is, does meltano automatically updates these metadata columns regardless of whether a record changes or needs to be updated? Techically if it is incremental and no data is changed in the record, then it shouldn't touch it right?

Hi @Kevin Phan 👋 So, the spec used by Meltano extractors and loaders work with "at least once" expectation, so it's expected that the same record could be extracted even if it wasn't updated, and the connector doesn't have visibility into whether it actually changed from previous runs. Does that make sense?