Hello, I am wanting to define several tap-postgres...
# best-practices
j
Hello, I am wanting to define several tap-postgres-meltanolabs taps that inherit off the base tap. I am wanting to define the overall tables selected in the base tap, and then select/exclude some tables in the inherited taps where permissions are different or tables don’t exist. I am trying to avoid duplicating the entire select multiple times so that models aren’t missed when new tables are added to all postgres databases. Is this possible? eg.
Copy code
extractors:
  - name: tap-postgres
    variant: meltanolabs
    pip_url: meltanolabs-tap-postgres
    select:
      - table_1.*
      - table_2.*
      - table_3.*
      - table_4.*
      - table_5.*
      - table_6.*

  - name: tap-postgres_inherited_1
    inherit_from: tap-postgres
    select:
      - '!table_2.*'
      - table_7.*

  - name: tap-postgres_inherited_2
    inherit_from: tap-postgres
    select:
      - table_8.*
1
v
depdning on how many of these you're doing you could consider using one tap and using select filters https://docs.meltano.com/concepts/plugins/#select_filter-extra
🙌 1
j
Thank you, i think that solves the issue perfectly.
👌 1