Hello everybody I am struggling to run `tap outbrain` Accord Meltano #plugins-dbt

Hello everybody, I am struggling to run `tap-outbr...

Ruddy Gunawan

12/02/2024, 11:36 PM

Hello everybody, I am struggling to run

tap-outbrain

. According to the documentation on meltano hub web page, I suppose to configure it with this command:

Copy code

meltano config tap-outbrain set --interactive

I set up everything, except access_token (since it's optional). But then, when I try to test it with this command:

Copy code

meltano config tap-outbrain test

I got this error message:

Copy code

Plugin configuration is invalid
Catalog discovery failed: command ['/app/meltano/outbrain-1/.meltano/extractors/tap-outbrain/venv/bin/tap-outbrain', '--config', '/app/meltano/outbrain-1/.meltano/run/tap-outbrain/tap.bed32650-3905-46c1-ae64-8172c5783a5f.config.json', '--discover'] returned 2 with stderr:
 usage: tap-outbrain [-h] -c CONFIG [-s STATE]
tap-outbrain: error: unrecognized arguments: --discover

This is the generated meltano.yml file after setting up the configuration (project id and username below are modified, everything else is just copy-pasted directly):

Copy code

version: 1
default_environment: dev
project_id: [generated project id here]
environments:
- name: dev
- name: staging
- name: prod
plugins:
  extractors:
  - name: tap-outbrain
    variant: dbt-labs
    pip_url: git+<https://github.com/dbt-labs/tap-outbrain.git>
    config:
      start_date: '2024-08-08'
      username: [i set my username via the above command earlier]

I wonder what went wrong. I use the same steps for

tap-taboola

and they worked normally, but struggling to get past this testing for

tap-outbrain

. Also, I need to change my Dockerfile to use python 3.8, can't use python 3.10 with

tap-outbrain

, otherwise will get some library issues.

Ruddy Gunawan

12/02/2024, 11:48 PM

I tried to change the meltano.yml configuration, for example, to be like this:

Copy code

version: 1
default_environment: dev
project_id: [generated project id here]
environments:
- name: dev
- name: staging
- name: prod
plugins:
  extractors:
  - name: tap-outbrain
    variant: dbt-labs
    pip_url: git+<https://github.com/dbt-labs/tap-outbrain.git>
    capabilities: []
    config:
      start_date: '2024-08-08'
      username: [i set my username via the above command earlier]
      password: [my password]
      account_id: [my account_id]

But, running the same test would give me this error:

Copy code

Plugin configuration is invalid
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: <https://api.outbrain.com/amplify/v0.1/login>

Edgar Ramírez (Arch.dev)

12/03/2024, 3:54 AM

Hi @Ruddy Gunawan! Can you try without the

discover

capability? i.e.

Copy code

plugins:
  extractors:
  - name: tap-outbrain
    variant: dbt-labs
    pip_url: git+<https://github.com/dbt-labs/tap-outbrain.git>
    capabilities:
    - state

It doesn't seem to support any other capability, https://github.com/dbt-labs/tap-outbrain/blob/03dc1ca21c9129c8edf47f89605cf802ea2fa9d9/tap_outbrain/__init__.py#L408-L411 so we might need to just update the Hub to reflect that: https://github.com/meltano/hub/blob/3664a5b17497bc4e27833dae05c28086d4c820c7/_data/meltano/extractors/tap-outbrain/dbt-labs.yml#L1-L4

20 Views

Open in Slack

Previous Next