Hi there We are working with < ofer kulka> to integrate Melt Meltano #plugins-general

Hi there ! We are working with <@U06BXHXA11D> to i...

umut_yalcinkaya

11/02/2020, 3:53 PM

Hi there ! We are working with @ofer_kulka to integrate Meltano extractors tap-facebook and tap-adwords. We had an exception error on

/api/v1/plugins/add [POST]

. Is there anyone else that use these extractors before ? Need to discuss it

douwe_maan

11/02/2020, 3:56 PM

Hi @umut_yalcinkaya! I've used both taps successfully. Happy to help you get to that point as well 🙂 Have you tried using the CLI instead of the UI, and adding the taps using

meltano add

? You'll likely get more insight into what went wrong that way.

umut_yalcinkaya

11/02/2020, 4:00 PM

Hi @douwe_maan, nice to hear it 🙂 Actually, deployed meltano on an ec2 instance within container. It's up and running. I've tried

meltano add extractor tap-facebook

and

meltano add extractor tap-adwords

douwe_maan

11/02/2020, 4:01 PM

What exception are you seeing?

umut_yalcinkaya

11/02/2020, 4:01 PM

Copy code

[2020-11-02 15:06:30,070] [20|MainThread|<http://meltano.api.app|meltano.api.app>] [ERROR] Exception on /api/v1/plugins/add [POST]
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 2447, in wsgi_app
    response = self.full_dispatch_request()
  File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1952, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/usr/local/lib/python3.6/site-packages/flask_restful/__init__.py", line 269, in error_router
    return original_handler(e)
  File "/usr/local/lib/python3.6/site-packages/flask_restful/__init__.py", line 269, in error_router
    return original_handler(e)
  File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1821, in handle_user_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/local/lib/python3.6/site-packages/flask/_compat.py", line 39, in reraise
    raise value
  File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1950, in full_dispatch_request
    rv = self.dispatch_request()
  File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1936, in dispatch_request
    return self.view_functions[rule.endpoint](**req.view_args)
  File "/usr/local/lib/python3.6/site-packages/meltano/api/security/auth.py", line 127, in decorated
    return f(*args, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/meltano/api/controllers/plugins.py", line 96, in add
    plugin = add_service.add(plugin_type, plugin_name, variant=variant)
  File "/usr/local/lib/python3.6/site-packages/meltano/core/project_add_service.py", line 37, in add
    return self.add_definition(plugin_def)
  File "/usr/local/lib/python3.6/site-packages/meltano/core/project_add_service.py", line 41, in add_definition
    return self.config_service.add_to_file(plugin)
  File "/usr/local/lib/python3.6/site-packages/meltano/core/config_service.py", line 61, in add_to_file
    raise PluginAlreadyAddedException(plugin)
meltano.core.config_service.PluginAlreadyAddedException
[2020-11-02 15:06:30,074] [20|MainThread|meltano.api] [INFO] Error: 500 Internal Server Error: The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application.

umut_yalcinkaya

11/02/2020, 4:02 PM

This is the docker logs that prompts me

umut_yalcinkaya

11/02/2020, 4:03 PM

I've already created an

.env

file and checked with

meltano config tap-facebook

douwe_maan

11/02/2020, 4:04 PM

When are you seeing this error show up? When you press the "Add to project" button in the UI for "Facebook Ads" or "Google Ads"?

ofer_kulka

11/02/2020, 4:06 PM

Hey Douwe! We see the error when we click the "test connection" button within those "Projects".

umut_yalcinkaya

11/02/2020, 4:07 PM

I've tried both of them. Error that I sent belong to facebook ads

douwe_maan

11/02/2020, 4:13 PM

Interesting, hitting the "Test Connection" button should result in a request to

POST /api/v1/orchestrations/extractors/<tap>/configuration/test

, not

/api/v1/plugins/add

, since the latter will fail if the tap was already added to the project, as you're seeing

douwe_maan

11/02/2020, 4:13 PM

On my side, it's behaving correctly, so I'm not sure why you're seeing this bug

douwe_maan

11/02/2020, 4:14 PM

Can you please create a new issue in https://gitlab.com/meltano/meltano/-/issues so that we can collect some more data to help us get to the bottom of this, like a screenshot of the Network tab in your browser's Web Inspector showing the requests?

Open in Slack

Previous Next