Hi everyone! [Meltano/Singer newbie here] Has any...
# plugins-general
c
Hi everyone! [Meltano/Singer newbie here] Has anyone had any experience with the REST API plugin without an actual
endtime
? Not sure if possible in the first place. In my use case, I'd like to leave it "running forever". Any help appreciated 🙏 https://hub.meltano.com/extractors/tap-rest-api-msdk
message has been deleted
a
I think the
endtime
would get passed to the API in question, it would depend on how thisAPI handles having no
endtime
passed. In general I would think not providing an
endtime
parameter would include everything up until today (or possible including). Can you try it and see?
Not sure what you mean by 'running forever'? If you always wanted fresh data, you'd need to run your tap at least once a day, probably with no end date passed.
c
Thanks for your reply!
would get passed to the API in question, it would depend on how thisAPI handles having no
endtime
passed.
yeah, that totally makes sense. I thought for a second it's part of the tap configuration, but it's actual API specification
Not sure what you mean by 'running forever'?
What I meant is basically this functionality, that I now realised it's built into the tap by default "The intend for this parameter is to continue incrementally processing from a previous stat" using
source_search_field
and `source_search_query`https://hub.meltano.com/extractors/tap-rest-api-msdk/#source_search_field-setting Sorry, didn't phrase it too clearly in my initial message 😄