Hello team, i have a problem in replication tap-postgres, i had configure LOG_BASED replication, and replication key for _sdc_lsn, but i dont see the new row inserte and update replicate when i run my metalno config pos tap-postgres:

metadata:
      "*":
        replication_method: LOG_BASED
        replication_key: _sdc_lsn

in the log there are is warning:

INFO     | tap-postgres         | One or more LOG_BASED catalog entries were modified ......................... to allow nullability and include _sdc columns. See README for further information

i had check replication in postgres, and exists changes in slot SELECT * FROM pg_logical_slot_peek_changes('tappostgres', null, null);

I think that's just a notice message, according to https://github.com/MeltanoLabs/tap-postgres/?tab=readme-ov-file#implementation-details. But maybe @visch can say more 🙂

The readme is good, I don't really undertand your problem @Carlos Favacho can you show what you're running (commands ie you full run command), what you expect to happen, and your meltano.yml

Hello @visch run this command

meltano el tap-postgres target-s3

my meltno.yaml

version: 1
default_environment: dev
project_id: 533c4732-50db-42b0-87b3-7ce0a27e89c7
environments:
- name: dev
- name: staging
- name: prod
plugins:
  extractors:
  - name: tap-postgres
    variant: meltanolabs
    pip_url: git+<https://github.com/MeltanoLabs/tap-postgres.git>
    capabilities:
    - properties
    - catalog
    - discover
    - state
    - about
    - stream-maps
    - activate-version
    - batch
    - test
    - log-based
    - schema-flattening
    catalog: tap-postgres.catalog-log.json
    config:
      debug_lsn: true
    metadata:
      "*":
        replication_method: LOG_BASED
        replication_key: _sdc_lsn       
  loaders:
  - name: target-s3
    variant: crowemi
    pip_url: git+<https://github.com/crowemi/target-s3.git>
    config:
      format:
        format_type: parquet

i expect that update record is replicated CDC is active in postgres with wal2jon

2024-07-31T17:06:41.719970Z [info     ] 2024-07-31 14:06:41,719 | INFO     | singer_sdk.metrics   | METRIC: {"type": "counter", "metric": "record_count", "value": 0, "tags": {"stream": "xxxxxxxxxx-customer_metadata", "context": {}}} cmd_type=extractor name=tap-postgres run_id=2b64d88b-a6cb-410e-986e-5610a0b9038f state_id=2024-07-31T170623--tap-postgres--target-jsonl stdio=stderr