Hi all, tap-postgres is excluding one of my fields...
# troubleshooting
c
Hi all, tap-postgres is excluding one of my fields because it's a domain type - really it's just a string (
text
) with some constraints provided by the domain, but I think this bug is https://github.com/singer-io/tap-postgres/issues/97 surfacing on me. Is there any way to override the schema that tap-postgres thinks it should be using? I tried this but it was kind of a shot in the dark, I can't find much documentation:
Copy code
plugins:
  extractors:
    - name: tap-postgres-example
      schema:
        "public-tablename":
          fieldname:
            type: ["string", "null"]
            format: string
a
Hi, @charlie_offenbacher. I think you are on the right path but you may need to fully declare that stream's schema - as I believe property omissions will be treated as removals. Are you having any initial luck with this approach?
c
Thanks for the response @aaronsteers! My change seemed to have no effect, I'm not I'm in the right place in the config schema? Is there any way to generate the discovered schema from meltano? The main command I've been using so far is
meltano select --list tap-postgres-example --all
but that just shows select / exclude, not sure if there are any other good commands I might use
e
I think you want
meltano invoke --dump=catalog tap-postgres-example
(docs)
c
thanks!