andrew_sayers
01/03/2024, 10:22 PMtap-rest-api-msdk
, we have been working on connecting a tap to our Gainsight instance (not PX). Specifically the company end point: https://support.gainsight.com/SFDC_Edition/API_and_Developer_Docs/Company_API/Company_API_Documentation#Read_API
We have installed and created the base definition:
plugins:
extractors:
- name: tap-rest-api-msdk
variant: widen
pip_url: tap-rest-api-msdk
executable: tap-rest-api-msdk
capabilities:
- state
- catalog
- discover
- name: tap-gainsight
inherit_from: tap-rest-api-msdk
config:
api_url: "https://ourdomain.com/v1/data/objects/query"
auth_method: api_key
api_keys:
Accesskey: ${Token}
---- New Environment meltano.yml ----
environments:
• name: main
config:
plugins:
extractors:
- name: tap-gainsight
config:
streams:
- name: Company
path: "/Company"
#records_path: "$data.records.[*]"
start_date: "2020-06-01T000000Z"
schema:
properties:
Gsid: {type: string}
CreatedDate: {type: string, format: date-time}
headers:
Content-Type: application/json
Accesskey: ${token}
params:
select: ["Gsid", "CreatedDate"]
where:
conditions:
- name: "CreatedDate"
alias: "A"
value: "01-01-2023"
operator: "GTE"
expression: "A"
orderBy:
CreatedDate: "asc"
Gsid: "desc"
limit: 5
primary_keys:
- "Gsid"
Each time we execute a test on the tap, we are returned with:
"Need help fixing this problem? Visit http://melta.no/ for troubleshooting steps, or to
join our friendly Slack community.
Plugin configuration is invalid
singer_sdk.exceptions.RetriableAPIError: 500 Server Error: for path: /v1/data/objects/query/Company"
---
I am certain I am configuring the params wrong in the prod.meltano.yml, but am having trouble debugging. I was able to connect via a python script and hit the company endpoint successfully and return a dataframe, just need to determine how to configure into a stream via the tap...
any help/direction is immensely appreciated!