https://linen.dev logo
Join Slack
Powered by
Hello Everyone I have been working on tap-google-a...
# troubleshooting
m
Hello Everyone I have been working on tap-google-analytics but when i am running the elt command, It's not able to find the catalog/schema for Google analytics. Does anybody know what was the reason?
v
try running with debug mode on, unfortunately the error gets hidden when the problem happens at discovery. So 
meltano --log-level=debug select tap-googleanalaytics --list
There's an issue open that was brought up in office hours about being more helpful for these errors. That will probably show a configuration issue or something
p
@monika_rajput what variant of tap-google-analytics are you working with?
m
@pat_nadolny meltano variant
@visch I tried it and gives this error. 
Traceback (most recent call last):
File "/home/ubuntu/.local/lib/python3.8/site-packages/meltano/cli/__init__.py", line 44, in main cli(obj={"project": None}) File "/usr/lib/python3/dist-packages/click/core.py", line 764, in call return self.main(*args, **kwargs) File "/usr/lib/python3/dist-packages/click/core.py", line 717, in main rv = self.invoke(ctx) File "/usr/lib/python3/dist-packages/click/core.py", line 1137, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/usr/lib/python3/dist-packages/click/core.py", line 956, in invoke return ctx.invoke(self.callback, **ctx.params) File "/usr/lib/python3/dist-packages/click/core.py", line 555, in invoke return callback(*args, **kwargs) File "/home/ubuntu/.local/lib/python3.8/site-packages/meltano/cli/params.py", line 23, in decorate return func(*args, **kwargs) File "/home/ubuntu/.local/lib/python3.8/site-packages/meltano/cli/params.py", line 56, in decorate func(project, *args, **kwargs) File "/home/ubuntu/.local/lib/python3.8/site-packages/meltano/core/utils/__init__.py", line 68, in wrapper return run_async(func(*args, **kwargs)) File "/home/ubuntu/.local/lib/python3.8/site-packages/meltano/core/utils/__init__.py", line 47, in run_async loop.run_until_complete(future) File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/home/ubuntu/.local/lib/python3.8/site-packages/meltano/cli/select.py", line 79, in select raise CliError(f"Cannot list the selected attributes: {err}") from err meltano.cli.utils.CliError: Cannot list the selected attributes: Catalog discovery failed: command ['/hometap-google-analytics', '--config', '/home/ubuntu/rm-projects/meltano-projects/dev-.meltano/run/tap-google-analytics/tap.98ae038e-3b20-4ede-82c5-6d3fdddeacf5.config.json', '--discover'] returned/ 1 The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.8/site-packages/meltano/cli/__init__.py", line 52, in main raise CliError(str(err)) from err meltano.cli.utils.CliError: Cannot list the selected attributes: Catalog discovery failed: command ['/home/ubuntu/rm-projects/meltano-projects/.meltano/extractors/tap-google-analytics/venv/bin/tap-google-analytics', '--config', '/home/ubuntu/rm-projects/.meltano/run/tap-google-analytics/tap.98ae038e-3b20-4ede-82c5-6d3fdddeacf5.config.json', '--discover'] returned 1
v
Scroll up farther I believe, the entire output would be helpful (minus env variable stuff). There's multiple exceptions
Need to get to the exception from the tap itself
m
@edward_ryan @tom_mcgrail
e
Hi @monika_rajput, please send a screenshot of the tap exception (at top of error message) along with a full text output of the error as a snippet
m
Yes 
CRITICAL Config is missing required keys: ['client_email', 'private_key']
Traceback (most recent call last): File "/home/ubuntu/rm-projects/meltano-projects/.meltano/extractors/tap-google-analytics/venv/bin/tap-google-analytics", line 8, in <module> sys.exit(main()) File "/home/ubuntu/rm-projects/meltano-projects//.meltano/extractors/tap-google-analytics/venv/lib/python3.8/site-packages/singer/utils.py", line 229, in wrapped return fnc(*args, **kwargs) File "/home/ubuntu/rm-projects/meltano-projectsr/.meltano/extractors/tap-google-analytics/venv/lib/python3.8/site-packages/tap_google_analytics/__init__.py", line 156, in main singer.utils.check_config(args.config, additional_config_keys) File "/home/ubuntu/rm-projects/meltano-projects//.meltano/extractors/tap-google-analytics/venv/lib/python3.8/site-packages/singer/utils.py", line 190, in check_config raise Exception("Config is missing required keys: {}".format(missing_keys)) Exception: Config is missing required keys: ['client_email', 'private_key'] [2021-10-25 103449,706] [775278|MainThread|root] [DEBUG] Deleted configuration at /home/ubuntu/rm-projects/meltano-projects/.meltano/run/tap-google-analytics/tap.abab35d2-1d92-4f0a-adf5-e5e2b0a0602f.config.json [2021-10-25 103449,707] [775278|MainThread|meltano.cli.utils] [DEBUG] Cannot list the selected attributes: Catalog discovery failed: command ['/home/ubuntu/rm-projects/meltano-projects/dev-ur/.meltano/extractors/tap-google-analytics/venv/bin/tap-google-analytics', '--config', '/home/ubuntu/rm-projects/meltano-projects//.meltano/run/tap-google-analytics/tap.abab35d2-1d92-4f0a-adf5-e5e2b0a0602f.config.json', '--discover'] returned 1 Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.8/site-packages/meltano/cli/select.py", line 60, in select await show(project, extractor, show_all=flags["all"]) File "/home/ubuntu/.local/lib/python3.8/site-packages/meltano/cli/select.py", line 97, in show list_all = await select_service.list_all(session) File "/home/ubuntu/.local/lib/python3.8/site-packages/meltano/core/select_service.py", line 55, in list_all catalog = await self.load_catalog(session) File "/home/ubuntu/.local/lib/python3.8/site-packages/meltano/core/select_service.py", line 48, in load_catalog catalog_json = await invoker.dump("catalog") File "/home/ubuntu/.local/lib/python3.8/site-packages/meltano/core/plugin_invoker.py", line 290, in dump async with self._invoke(): File "/home/ubuntu/.local/lib/python3.8/site-packages/async_generator/_util.py", line 34, in aenter return await self._agen.asend(None) File "/home/ubuntu/.local/lib/python3.8/site-packages/meltano/core/plugin_invoker.py", line 260, in _invoke async with self.plugin.trigger_hooks("invoke", self, args): File "/home/ubuntu/.local/lib/python3.8/site-packages/async_generator/_util.py", line 34, in aenter return await self._agen.asend(None) File "/home/ubuntu/.local/lib/python3.8/site-packages/meltano/core/behavior/hookable.py", line 87, in trigger_hooks await self.class.trigger(self, f"before_{hook_name}", *args, **kwargs) File "/home/ubuntu/.local/lib/python3.8/site-packages/meltano/core/behavior/hookable.py", line 115, in trigger raise err File "/home/ubuntu/.local/lib/python3.8/site-packages/meltano/core/behavior/hookable.py", line 107, in trigger await hook_func(target, *args, **kwargs) File "/home/ubuntu/.local/lib/python3.8/site-packages/meltano/core/plugin/singer/tap.py", line 251, in discover_catalog_hook await self.discover_catalog(plugin_invoker) File "/home/ubuntu/.local/lib/python3.8/site-packages/meltano/core/plugin/singer/tap.py", line 297, in discover_catalog await self.run_discovery(plugin_invoker, catalog_path) File "/home/ubuntu/.local/lib/python3.8/site-packages/meltano/core/plugin/singer/tap.py", line 357, in run_discovery raise PluginExecutionError(
had change the tap url and it's saying CRITICAL Config is missing required keys: ['client_email', 'private_key']
@edward_ryan @visch
e
Please check the config, it is incomplete
m
yes, i am checking
Open in Slack
PreviousNext
Powered by