https://linen.dev logo
Join Slack
Powered by
<https://meltano.slack.com/archives/C013EKWA2Q1/p1...
# troubleshooting
v
https://meltano.slack.com/archives/C013EKWA2Q1/p1655406337704899?thread_ts=1645058913.710719&amp;cid=C013EKWA2Q1 @chris_stout What's your end goal here? You want one replication key for everything?
c
thanks @visch - my indention on the metadata was off in the yml 😆 😭
yep, that's exactly what I wanted. On the postgres tap, I had to indent it under the config. When I had it at the same level, it wasn't picking it up. e.g.,
Copy code
- name: dev
  config:
    plugins:
      extractors:
      - name: tap-postgres
        config:
          host: 
          port: 5433
          user: 
          dbname: 
          default_replication_method: INCREMENTAL
          metadata:
            public-*:
              replication-key: created_date
        select:
        - public-cgf_fps_request.*
v
😄 glob syntax is beautiful
c
indeed, the exclude selectors ended up being really useful as well as the wildcard. I have two tables that don't fit the pattern because they are for versioning/migrations. It is so nice I won't have to specify all the tables explicitly. Now I just need to figure out some of the data type conversion issues with jsonb. I can bring them over as strings and convert in dbt, but I'm hoping I can figure out how to bring them over directly to JSON.
v
Opened a new thread for the blob stuff https://meltano.slack.com/archives/C01UW1W4D5Y/p1655410067344729 Good luck with your project! 😄
Open in Slack
PreviousNext
Powered by