I installed meltano and found the introduction docs to be very well written. In 15 mins I was able to run

meltano elt tap-gitlab target-jsonl --job_id=gitlab-to-jsonl

. All the things in the intro makes sense to me. One thing I am curious about is how do I make gitlab tap to produce all the different datasets listed at https://meltano.com/plugins/extractors/gitlab.html#gitlab-setup. When I ran my setup for the first time. I only got https://share.getcloudapp.com/xQuDgzLy 4 files. The question I want to answer in my demo meltano project is how long does it take for engineers to merge a pr after they create on. This is something that will help me make my team more efficient 🙂

@nehil_jain Can you run

meltano config tap-gitlab

and share the values of

projects

and

groups

? It sounds like your

groups

setting is set correctly, but

projects

is not. Have you perhaps only included the

project

path, instead of the full

group/project

path?

I know what's going on: you've found a bug! This check: https://gitlab.com/meltano/tap-gitlab/-/blob/master/tap_gitlab/__init__.py#L501 assumes that the values in

projects

are project IDs instead of project paths. The syncing mechanism for projects actually supports both, but because of this line, it's never getting called if a path rather than an ID is provided. You can fix this in your project by specifying the ID instead of the path. You can find the ID in your project's General settings on GitLab.com. I'll go ahead and create an issue and MR to fix this 🙂