Hello I m trying to use the `tap csv` to read the data When Meltano #getting-started

Hello, I'm trying to use the `tap-csv` to read the...

roberto_koren

09/28/2023, 1:33 PM

Hello, I'm trying to use the

tap-csv

to read the data. When testing the config I get the following error:

Copy code

2023-09-27T18:06:39.208653Z [debug    ] {"type": "RECORD", "stream": "INC", "record": {"id": "INC-2377", "summary": "Summarry", "creator": "MB", "creator_email": "mb@mail.mail", "created": "2023-09-27 12:45:10", "reporter": "MB", "assignee": "", "statuscategorychangedate": "2023-09-27 12:45:11", "updated": "2023-09-27 12:48:19", "resolutiondate": "", "resolution": "Some resolution", "priority": "P3", "status": "Ops Investigating", "impacted_series": "2594770", "impacted_clients": "Clients", "kb": "", "components": "Data Platform", "started_noticed_at": "2023-09-27 10:30:00", "product_affected": "Widgets", "escalToTS": "FALSE", "escalToEng": "FALSE", "TTE_TS": "", "TTE_ENG": "", "TTR": "", "NOMMF": "2", "LOMMF": "assignee, ticket_unassigned"}, "time_extracted": "2023-09-27T18:06:39.208653+00:00"}
2023-09-27T18:06:39.212166Z [debug    ] Deleted configuration at <path>\.meltano\run\tap-csv\tap.6174ed76-583d-4cc0-b0cd-050efe043b29.config.json
2023-09-27T18:06:39.212166Z [debug    ] Need help fixing this problem? Visit <http://melta.no/> for troubleshooting steps, or to
join our friendly Slack community.

Plugin configuration is invalid
{"type": "RECORD", "stream": "INC", "record": {"id": "INC-2377", "summary": "Summarry", "creator": "MB", "creator_email": "mb@mail.mail", "created": "2023-09-27 12:45:10", "reporter": "MB", "assignee": "", "statuscategorychangedate": "2023-09-27 12:45:11", "updated": "2023-09-27 12:48:19", "resolutiondate": "", "resolution": "Some resolution", "priority": "P3", "status": "Ops Investigating", "impacted_series": "2594770", "impacted_clients": "Clients", "kb": "", "components": "Data Platform", "started_noticed_at": "2023-09-27 10:30:00", "product_affected": "Widgets", "escalToTS": "FALSE", "escalToEng": "FALSE", "TTE_TS": "", "TTE_ENG": "", "TTR": "", "NOMMF": "2", "LOMMF": "assignee, ticket_unassigned"}, "time_extracted": "2023-09-27T18:06:39.208653+00:00"}

It's a extremely vague error so we're struggling to understand what the actual issue is. I can see that the first row of data was loaded as it's logged there. Are we missing something obvious? 😅

Andy Carter

09/28/2023, 1:54 PM

What

meltano

command are you running?

meltano run tap-csv target-jsonl

? Can you try in debug mode?

meltano --log-level=debug run ...

roberto_koren

09/28/2023, 1:56 PM

This is when testing the config as per the official docs on the Hub. The

meltano config tap-csv test

. Also that's with the debug mode enabled

Andy Carter

09/28/2023, 1:57 PM

Can you share

meltano.yml

roberto_koren

09/28/2023, 1:58 PM

Copy code

version: 1
default_environment: dev
project_id: 0dd04f26-df4b-4748-9d86-5e043114e7ee
environments:
- name: dev
  config:
    plugins:
      extractors:
      - name: tap-csv
        config:
          csv_files_definition: ./config/tap-csv-cfg.json
          flattening_enabled: false
- name: staging
- name: prod
plugins:
  extractors:
  - name: tap-csv
    variant: meltanolabs
    pip_url: git+<https://github.com/MeltanoLabs/tap-csv.git>

Andy Carter

09/28/2023, 4:34 PM

OK sorry I don't think I can help more here, I will leave to others more experienced 😞

6 Views

Open in Slack

Previous Next