Hey guys! trying make a PostgreSQL extraction work with an incremental key, does anyone know what entity_id I need to pass into the config to make it work or how it will be used down the pipeline? thanks a bunch for reading in advance.

Hi Albert!

some_entity_id

should be the name of the stream, which for tap-postgres corresponds to a schema + table name, e.g. `public-users`:

extractors:
  - name: tap-postgres
    metadata:
      public-users:
        replication-method: INCREMENTAL
        replication-key: updated  # or whatever column is used to incrementally extract data from the source table

Hi Edgar, really appreciate the response- just to clarify your example, the id is always a concatentation of postgres schema name and table name by a '-' ? and to follow up where can I find information on how other taps entity id's are formatted?

the id is always a concatentation of postgres schema name and table name by a '-' ?

Yeah, all postgres taps use that pattern.

where can I find information on how other taps entity id's are formatted?

meltano select <your tap> --list --all

should give you the detailed list of entities and columns in your tap. https://docs.meltano.com/reference/command-line-interface/#select

Thanks so much Edgar, your help really means a lot to me!

No problem, happy to help 😁