Hello community, i am testing meltano extractor: t...
# troubleshooting
s
Hello community, i am testing meltano extractor: tap-facebook-pages. I set the pageID, the access TOKEN, and the date. When executing the loader target-jsonl i get the following error:
Run invocation could not be completed as block failed: Cannot start plugin tap-facebook-pages: Executable 'tap-facebook-pages' could not be found. Extractor 'tap-facebook-pages' may not have been installed yet using meltano install extractor tap-facebook-pages, or the executable name may be incorrect.
what am i doing wrong?
h
How did you add the tap? If you added it to meltano.yml manually, you need to run ‘meltano install’ before you run it. This installs the taps and targets in a separate environment inside the .meltano folder in your project.
s
Hi @Henning Holgersen thanks for answering. I use the meltano add extractor tap-facebook-pages. Also run the install command after that
p
Hey @sancara - Are you sure its installing properly? I tried to install it and im getting
ERROR: No matching distribution found for singer-sdk==0.1.6
. You can use the non-default variant
meltano add extractor tap-facebook-pages --variant voxmedia
. It looks like we should probably consider the voxmedia variant as default (I created an issue to look into that)
s
Hi @pat_nadolny thanks for answering. I try this solution and come back with news.
When i ran
meltano add extractor tap-facebook-pages --variant voxmedia
i get the following error “”" Installing extractor ‘tap-facebook-pages’... Extractor ‘tap-facebook-pages’ could not be installed: could not create the virtualenv for ‘extractors/tap-facebook-pages’ Need help fixing this problem? Visit http://melta.no/ for troubleshooting steps, or to join our friendly Slack community. Failed to install plugin(s)“”"
p
hmm have you been able to install any other plugins? Since maybe you already had the other tap-facebook-pages variant install, try running
meltano remove extractor tap-facebook-pages
first, then rerun the add command. If it fails again, would you mind sharing the full error log? I'm wondering if the virtualenv error is a red herring
s
I tried first with the start-guide using the gitHub extractor, then go through the facebook-pages. I ran the meltano remove, after that i add tap-facebook-pages --variant voxmedia. In the configuration --interactive i can’t pass the array of page and access token :F
p
that seems like good progress then! You can set array values just exclude the outer quotes in your input like
[{"a": "b"}, {"c": "d"}]
s
I already set the configuration with [{“id”:“id_numnber”, “access_token”:“token”}] but when i execute
meltano run tap-facebook-pages target-jsonl
i also having a problem i attach the full log
p
I havent used this tap in particular but looks like its failing on
singer_sdk.exceptions.FatalAPIError: 400 Client Error: Bad Request for path: /{page_id}: (#100) Tried accessing nonexisting field (general_manager) on node type (User)
.
@prratek_ramchandani I see that you're a maintainer on that tap, any idea what could be happening?
p
hey, i haven't seen that one before! my guess would be that you supplied a user ID instead of a page ID in your config because the tap shouldn't be attempting to fetch a field on a
User
node at any point
also worth pointing out that this tap is still very much under active development and also contains a number of workarounds (some in
main
and others in
develop
) that are targeted at specific edge cases we've noticed at our scale of data that may not be relevant to most users. for example, FB limits the number of posts you can get insights from using the
published_posts
endpoint so we have another stream that fetches insight for one post at a time, getting post IDs by querying a dimension table in our data warehouse and using that as a pseudo parent stream my guess is sometime next month we'll try to get this to a place where at least most streams are usable by other folks in the community with a proper readme
that said, all the page insights streams should work
s
Thanks people for all this help. I’m still working on this. But definitely the variant of voxmedia is installing without errors