Hi, I'm trying to use tap-github to sync releases ...
# troubleshootings
scott_dietrich
02/28/2023, 11:16 PMHi, I'm trying to use tap-github to sync releases and I'm encountering this error:
singer_sdk.exceptions.FatalAPIError: 422 Client Error: b'{"message":"Only the first 10000 results are available.","documentation_url":"<https://docs.github.com/rest/reference/repos#list-releases>"}'a
aaron_phethean
03/01/2023, 7:21 AMSounds like that stream needs paging support. Which repo are you syncing? Would be good to see the example.
s
scott_dietrich
03/01/2023, 1:53 PMIt is a private repo. I can try to repro the issue on a public repo if that would be helpful.
scott_dietrich
03/01/2023, 2:11 PMRepositoryStream sets a MAX_RESULTS_LIMIT (https://github.com/MeltanoLabs/tap-github/blob/8c3a82464c392b9656bbe384cc1dfe0ca3362392/tap_github/repository_streams.py#L26) which I think would fix my issue, but I don't see how to set this for ReleasesStream from the config.
scott_dietrich
03/01/2023, 4:46 PMFYI, forking the repo and setting MAX_RESULTS_LIMIT = 10000 in ReleasesStream fixes the issue.
a
aaron_phethean
03/01/2023, 4:49 PMCool. I'm confident an issue on the tap-github repo and a PR would be very welcome!