Has anyone created a tap with incremental data and...
# singer-tap-development
p
Has anyone created a tap with incremental data and pagination involved? if yes please share relevant resources
s
https://sdk.meltano.com/en/latest/porting.html Pagination has a bit of info here Are you using the sdk or a legacy singer tap?
p
using meltano SDK, I am developing tap for woo commerce. It has multiple parameters and pages as well.
s
To get pagination, use the
next_page_token_jsonpath
variable. It is taken under the hood by the sdk and piped into the
get_url_params
function (which is in client and you can override if needs be). That adds your pagination token with the right parameter at the end of your query to automatically run your next one
Makes sense?