Hello everyone, I'm starting to set up meltano for...
# getting-started
a
Hello everyone, I'm starting to set up meltano for our product, and I started by deciding to go through the documentation. So I did everything that is described here (https://docs.meltano.com/getting-started/part1), but I did not receive data from gitlab. If I'm not mistaken the problem is in the token. Maybe I'm using the wrong token? I received the token on this page by providing all permissions https://gitlab.com/-/profile/personal_access_tokens. Also, maybe I specified the wrong repository format?
s
Hey @alex_dimov, the repository key looks wrong. You just need to provide it as e.g ."repository: sbalnojan/meltano-lightdash".
a
Will this even work with a private project? How does meltano know the baseURL of this project?
s
I assume so. Meltano doesn't but the GitHub API should know it.
a
where i can get right project name?
s
The project name should be just org/repository
The doc for these inputs is here: https://github.com/MeltanoLabs/tap-github.
a
but i still can`t get any data 😞
message has been deleted
s
That looks interesting, is that a Github hosted Git repository or something else?
a
Oo, it seems I mixed up something and took it as a gitlab setup. My bad. I am so sorry
s
I see, oh well, happens! At least now you should be able to get it to work. (There is also a gitlab tap if you wanna try that one out)
https://github.com/MeltanoLabs/tap-gitlab docs & things are in there as well.
a
First I'll deal with github. In any case, 80% of the products I'm going to get data from don't have faucets and I'll need to create custom ones.
Something seems to be wrong again
When I increased the date - I got some data (but not much). But I would like to get the whole commit history
e
That seems like a bug in the
commits
stream. Reported to the maintainers here: https://github.com/MeltanoLabs/tap-github/issues/166
a
ahh, thanks
e
Though it could be interesting for the sdk to notice that and raise a more readable error :)
e
@eric_boucher agreed! the SDK could do a much better job of either 1) informing the user that the rk is missing from a record and some suggestions to fix it and/or even better 2) ensure the rk is automatically included, just like the pks