c_p
10/19/2023, 4:33 PMendtime
? Not sure if possible in the first place. In my use case, I'd like to leave it "running forever".
Any help appreciated 🙏
https://hub.meltano.com/extractors/tap-rest-api-msdkc_p
10/19/2023, 4:35 PMAndy Carter
10/19/2023, 5:56 PMendtime
would get passed to the API in question, it would depend on how thisAPI handles having no endtime
passed. In general I would think not providing an endtime
parameter would include everything up until today (or possible including).
Can you try it and see?Andy Carter
10/19/2023, 5:57 PMc_p
10/23/2023, 10:48 AMwould get passed to the API in question, it would depend on how thisAPI handles having noyeah, that totally makes sense. I thought for a second it's part of the tap configuration, but it's actual API specificationpassed.endtime
c_p
10/23/2023, 10:49 AMNot sure what you mean by 'running forever'?What I meant is basically this functionality, that I now realised it's built into the tap by default "The intend for this parameter is to continue incrementally processing from a previous stat" using
source_search_field
and `source_search_query`https://hub.meltano.com/extractors/tap-rest-api-msdk/#source_search_field-setting
Sorry, didn't phrase it too clearly in my initial message 😄