I'm trying to use

INCREMENTAL

for

replication-method

This is what I have in my

meltano.yml

file:

loaders:
  - name: target-iceberg
    ...
    metadata:
      '*':
        replication-method: INCREMENTAL
        replication-key: id # <- that is not timestamp. it is integer

I'm using

tap-csv

and the configurations are as mentioned below:

extractors:
  - name: tap-csv
    ...
    config:
      csv_files_definition: extract/example_csv_files_def.json

It is appending the data every time I run the ingestion. What am I missing here?

The replication method is a property of the extractor and that tap unfortunately doesn't support incremental replication at the moment: https://github.com/MeltanoLabs/tap-csv?tab=readme-ov-file#capabilities.

Thank you for confirming, @Edgar Ramírez (Arch.dev)