I need to pull the same info from two different se...
# best-practices
t
I need to pull the same info from two different servers using the rest tap. The streams and info pulled will be exactly the same. I looked and it doesn't seem that the tap supports multiple base URLs (
api_url
) but I wanted to check here. Otherwise I'll have to have two almost identical .meltano.yml files
1
I created a base extractor then inherited from that:
Copy code
plugins:
  extractors:
  - name: bequant
    inherit_from: tap-rest-api-msdk
    variant: widen
    pip_url: tap-rest-api-msdk
    config:
      streams:
      - name: subscribers
        path: /subscribers
        primary_keys:
          - subcriberId
        schema:
          properties:
            subscriberIp:
              type: string
            subscriberId:
              type: string
            subscriberGroups:
              type: array
              items:
                type: string
    pagination_request_style: single_page_paginator
    pagination_response_style: single_page_paginator
    load_schema: raw_uisp
Copy code
plugins:
  extractors:
  - name: bq_voon
    inherit_from: bequant
    config:
      api_url: <https://pol.voon.utbb.net:3443/api/v1>
      auth_method: basic
      username: api
      password: ${BQ_VOON_PASS}
👍 2