jan_soubusta
01/03/2023, 1:15 PMtap-github
to crawl both repo and org level entities.
Screenshot from meltano.yml below.
Executing:
meltano run tap-github target-postgres tap-github-org target-postgres --full-refresh
The second part fails with this error:
ValueError: This tap requires one and only one of the following path options: {'user_usernames', 'user_ids', 'organizations', 'searches', 'repositories'}.
As you can see in the screenshot, I tried to override the repositories
with empty array, but looks like it checks existence of keys and due to inheritance it finds both repositories
and organizations
keys in tap-github-org
.
Already discussed with @Sven Balnojan, who suggested to post it here and cc: @aaronsteers / @ken_paynejan_soubusta
01/03/2023, 1:26 PMjan_soubusta
01/03/2023, 1:27 PMselect
configuration, instead it crawls everything and finally fails on an entity, which I do not have access to (403).jan_soubusta
01/03/2023, 1:31 PMselect
section 🤦jan_soubusta
01/03/2023, 1:34 PMjan_soubusta
01/03/2023, 1:35 PM