Hi, i’m following Meltano Guide &gt; <Getting Star...
# troubleshooting
h
Hi, i’m following Meltano Guide > Getting Started Choose How to Replicate Each Entity> I’m using tap-postgres (variant: transferwise), for some reason, the replication metadata is not configured in the “stream metadata” for each table, even though I have added them into the extractor’s metadata extra. (thread)
Copy code
Exception: Unrecognized replication_method None cmd_type=elb consumer=False name=tap-postgres producer=True stdio=stderr string_id=tap-postgres
meltano.yml
Copy code
version: 1
default_environment: dev
project_id: 315e0007-52ae-4f27-9ce3-2e2742e00123
plugins:
  extractors:
  - name: tap-postgres
    variant: transferwise
    pip_url: pipelinewise-tap-postgres
  loaders:
  - name: target-postgres
    variant: transferwise
    pip_url: pipelinewise-target-postgres
environments:
- name: dev
  config:
    plugins:
      extractors:
      - name: tap-postgres
        config:
          host: localhost
          user: foo
          dbname: foo
          filter_schemas: public
        select:
        - public-orders.*
        - public-line_items.*
        metadata:
          '*':
            replication-method: INCREMENTAL
            replication-key: updated_at
      loaders:
      - name: target-postgres
        config:
          user: bar
          host: localhost
          dname: bar
          default_target_schema: public
- name: staging
- name: prod
- name: uat
what’s the correct way to setup replication configs?
or is there a way to debug to figure out why the metadata are not picked up?
t
Try putting the metadata element in the top-level plugin definition, i.e. not under an environment
There's an open bug with metadata not being picked up in inherited plugin definitions... it seems possible that the same general problem could exist with environments
h
ah okay, will try it out!