Hi all. I'm encountering an issue with incremental data fetching using the tap-oracle extractor in Meltano. I'm trying to perform incremental extraction based on a date column in the Oracle table. However, every time I run the extractor with this configuration, it retrieves all records instead of only new or updated ones. It worked as expected when I switched the incremental key to an ID column with a numeric data type. Below is my meltano.yml configuration. Any help or suggestions would be greatly appreciated! Thanks. version: 1 default_environment: dev project_id: 4aa1-8578-699510331f14 environments: - name: dev - name: staging - name: prod plugins: extractors: - name: tap-oracle variant: s7clarke10 pip_url: git+https://github.com/s7clarke10/pipelinewise-tap-oracle.git config: service_name: host: user: port: 1521 ora_python_driver_type: thick cursor_array_size: 1000 use_singer_decimal: true use_ora_rowscn: false select: - VOLUME.* metadata: VOLUME: replication-method: INCREMENTAL replication-key: INSERT_DATE replication_key_sql_datetype: DATE loaders: - name: target-jsonl variant: andyh1203 pip_url: target-jsonl config: destination_path: /home/user/meltano_projects/json do_timestamp_file: false

Right! It's a safety feature: https://sdk.meltano.com/en/v0.35.0/implementation/at_least_once.html.