Hi Peeps, I’ve built my own tap using the Meltano SDK, but I’m have a couple of issues. It’s a simple tap, grabbing data from Thinkific’s API. At the moment, I’ve only configured four streams as they’re the only four I currently need. 1. I have set one of the steams up to be incremental and specified a replication key, but when I run the tap it give me the following error:

WARNING Property 'created_at' was present in the 'enrollments' stream but not found in catalog schema. Ignoring. Although in the catalog.json 'created_at' is present

. I’m not sure what I’m doing incorrectly. 2. The second issue is related to the first one, even though I have the streams configured for incremental replication, when I run the tap I’m getting all the data not only the new information. This might have to do with the fact I’m sending the data to a CSV target (for testing purposes) or I’m not specifying the --state flag correctly. Any assistance on the two issue above would be greatly appreciated.

1. Seems like the API response doesn't have a created_at property. Try running the API on the enrollments stream in Postman or something similar to see the data and if the results are actually what you expect 2. You're using incremental streams on the created_at property? If so you should really go for updated_at if possible. To the point I"d look into how the state is getting send to the API and verify the HTTP request is setup to be exactly what you'd expect

Adding to @visch’s suggestions, you can also make sure the JSONPath you're using actually extracts the data from the response: https://sdk.meltano.com/en/latest/dev_guide.html#restful-jsonpaths