Hi all, when using the

tap-rest-api-mdsk

extractor i am trying to configure pagination but I'm having problems with getting the first page. The first available offset on the fetched API is 0 but the tap is looking for offset 1 only after configuring the pagination params:

next_page_token_path: $
 pagination_request_style: offset_paginator
 pagination_response_style: style1
 pagination_page_size: 100
 pagination_total_limit_param: totalCount
 store_raw_json_message: false
 backoff_type: header
 backoff_param: ratelimit-reset

If i take them out and GET just the first page, it returns the page 0 data. Anyonde can help? Any clue? How to print the fetched URL?

How to print the fetched URL?

Other than debugging, I don't think there's a way to print it. We avoid that upstream in singer-sdk to prevent secrets from being leaked. The

1

value seems to be hardcoded here: https://github.com/Widen/tap-rest-api-msdk/blob/4f87c1adae00446388ebbe418c70b87c231856dc/tap_rest_api_msdk/streams.py#L306. It's probably worth an issue in the repo to make it configurable.

Thanks @Edgar Ramírez (Arch.dev), i changed the value to 0 and it worked

.meltano/extractors/tap-rest-api-msdk/venv/lib/python3.11/site-packages/tap_rest_api_msdk/streams.py

Thanks for filing an issue in the repo! I sent a draft PR: https://github.com/Widen/tap-rest-api-msdk/pull/43#issuecomment-2015334366 Let me know if that works 🙂

It worked thank @Edgar Ramírez (Arch.dev).