Hello Team Am trying to load the mysql tables data...
# troubleshooting
a
Hello Team Am trying to load the mysql tables data to s3 bucket while running the cmd
meltano --log-level=error run tap-mysql target-s3-csv
am facing below error, my meltano version is
2.13.0
which is stable meltano version.?
Copy code
/home/akshay/Documents/meltano-demo/.venv/lib/python3.8/site-packages/meltano/core/block/extract_loa |
│ d.py:800 in _check_exit_codes                                                                    │
│                                                                                                  │
│   797 │   │   )                                                                                  │
│   798 │                                                                                          │
│   799 │   if producer_code:                                                                      │
│ ❱ 800 │   │   raise RunnerError("Extractor failed", {PluginType.EXTRACTORS: producer_code})      │
│   801 │                                                                                          │
│   802 │   if consumer_code:                                                                      │
│   803 │   │   raise RunnerError("Loader failed", {PluginType.LOADERS: consumer_code})            │
│                                                                                                  │
│ ╭──────── locals ─────────╮                                                                      │
│ │      consumer_code = 0  │                                                                      │
│ │ intermediate_codes = {} │                                                                      │
│ │      producer_code = 1  │                                                                      │
│ ╰─────────────────────────╯                                                                      │
╰──────────────────────────────────────────────────────────────────────────────────────────────────╯
RunnerError: Extractor failed

2023-01-17T16:38:43.572617Z [error    ] Block run completed.           block_type=ExtractLoadBlocks err=RunnerError('Extractor failed') exit_codes={<PluginType.EXTRACTORS: 'extractors'>: 1} set_number=0 success=False
Need help fixing this problem? Visit  for troubleshooting steps, or to
join our friendly Slack community.
Run invocation could not be completed as block failed: Extractor failed
Here is my meltano.yml file, my database name is : demo and it contains almost 10 tables also if i want to extract only single table (emp) then how should i do.?
Copy code
version: 1
default_environment: dev
project_id: d62c3ecd-8465-4519-83d0-dec53a441bf9
plugins:
  extractors:
  - name: tap-mysql
    namespace: tap_mysql
    variant: transferwise
    pip_url: pipelinewise-tap-mysql
    config:
      port: '3306'
      host: localhost
      user: akshay
      password: abcdemo
      database: demo
      filter_dbs: demo
      ssl: 'false'
    metadata:
      '*':
        replication-method: FULL_TABLE
    select:
    - '*.*'
  loaders:
  - name: target-s3-csv
    namespace: target_s3_csv
    variant: transferwise
    pip_url: git+<https://github.com/transferwise/pipelinewise-target-s3-csv.git>
    config:
      s3_bucket: dremio-s3-demo
      aws_access_key_id: access_key
      aws_secret_access_key: secret_key
      delimiter: ','
      temp_dir: meltano_test
environments:
- name: dev
- name: staging
- name: prod
Thanks! :)
c
Hi Akshay. The real error message is actually located all the way at the top of the big colourful (and scary looking) backtrace boxes. The big colourful backtrace boxes actually only provide backtraces from inside the meltano framework, but the problem happened in a sub-process (
RunnerError: Extractor failed
) and the log messages from that
extractor
subprocess (i.e. the
tap-mysql
extractor) are located above the meltano backtrace messages. Hopefully the log output from the extractor will say what went wrong with the
tap-mysql
extractor.