Question on pagination with the RESTStream. If the response from the API returns a

count

of the records returned, and the request parameters include the

limit

of records to return and the number of records to

skip

, does that offer enough information to use the pagination functionality in RESTStream?

Yup, and I think you can even do without getting

limit

from the url params. In a bit of pseudocode

skip = 0

loop
    response = make_request(skip)
    process(response)
    if response.count > 0
        skip += count
    else
        break
end

Basically, while the API returns at least one record, you continue paginating. So you could even do without the

count

in the response and simply count (

len(...)

) the number of records in the response

Thanks @edgar_ramirez_mondragon - Do you know what that might look like using

RESTStream

?

Sure, perhaps something like https://github.com/edgarrmondragon/tap-readthedocs/blob/31d8d2f677f1063f9c29408965d8b2da123f5daa/tap_readthedocs/client.py#L61-L78

Thank you!