While using the tap-gitlab, I am wondering if I ne...
# troubleshooting
c
While using the tap-gitlab, I am wondering if I need to set some sort of results per page or? On one instance of gitlab - I get 70 projects, from the old server it seems to cap out at 51, though I have hundreds of Projects in the Group? THoughts? Thanks.
Seems that the State is saved and changing the tap settings for date are ignored? Just wondering if there is a way to make it so the process observes the start_date in the config.
Ok I ran it in the cli with --full-refresh. So at least I got 100 records. Where are the rest? Looking at the doc's I don't see a pagination setting.
k
Just to check - are you using the
meltano
variant of
tap-gitlab
? If so, it looks like there is an open merge request to fix the issue you are describing, assigned to @aaronsteers 🙂 It is also worth noting that a new
tap-gitlab
(built on the SDK) exists in MeltanoLabs, though it doesn't look like a Project stream has been implemented yet 🤔
p
to chime in here, we moved the tap-gitlab from the meltano namespace to MeltanoLabs so that it can be ported over to the SDK and maintained by the community going forward but right now its just a mirror of the meltano version. If any of the pending MRs in the meltano variant get merged I can get those changes to MeltanoLabs but all future changes should be PRs in github
k
Oh yeh, you are right! Sorry, I was looking
tap-github
in MeltanoLabs in stead (higher up the list, and which is built on the SDK) 🤦‍♂️ Thanks for the correction @pat_nadolny 🙏