Hello Team, am new to Meltano am facing below issu...
# troubleshooting
a
Hello Team, am new to Meltano am facing below issue while adding mysql extractor using cmd
meltano add extractor tap-mysql
But unable to add it facing below issue.
Copy code
Installing extractor 'tap-mysql'...
Extractor 'tap-mysql' could not be installed: could not create the virtualenv for 'extractors/tap-mysql'

Need help fixing this problem? Visit <http://melta.no/> for troubleshooting steps, or to
join our friendly Slack community.

Failed to install plugin(s)
w
Hi @akshay_p. Sorry to hear you've encountered an issue with this. I've logged an issue to improve the error message for this sort of thing. In the meantime, to solve your issue in particular, could you please try running
python -m venv '.meltano/extractors/tap-mysql'
using the same Python environment/executable you used to run Meltano when you hit this error, from the root of your Meltano project directory. That command is what failed when Meltano tried to run it. If running it yourself produces an error message, that may help us figure out what has gone wrong here. If the command executes successfully, then please delete the directory at
.meltano/extractors/tap-mysql
, since only Meltano is supposed to manage such virtual environments, and doing it manually will result in missing packages, and other problems later on. Could you please also run
python -m pip -V
using the same Python environment/executable, and post the results here.
a
Hi @Will Da Silva (Arch) Thanks for reply, After exploring more Meltano doc i have tried exactly same approach as you suggest it work am using the venv created by the pycharm IDE that's why it gives me error. But now am trying to load the mysql tables to my s3 bucket am facing below error,
Copy code
Run invocation could not be completed as block failed: Extractor failed
Here is my .yml file, Here for security reason i have not mention the exact s3 creds, my database name is : demo and it contains almost 10 tables but if i want to extract only single table then how should i do. @Sven Balnojan @Will Da Silva (Arch) @visch @thomas_briggs
Copy code
version: 1
default_environment: dev
project_id: d62c3ecd-8465-4519-83d0-dec53a441bf9
plugins:
  extractors:
  - name: tap-mysql
    variant: transferwise
    pip_url: pipelinewise-tap-mysql
    config:
      port: "3306"
      host: "localhost"
      user: "akshay"
      password: "abc@123"
      database: "demo"
      filter_dbs: "demo"
      ssl: "false"

  loaders:
  - name: target-s3-csv
    variant: transferwise
    pip_url: git+<https://github.com/transferwise/pipelinewise-target-s3-csv.git>
    config:
      s3_bucket: "dremio-s3-demo"
      aws_access_key_id: "aws_access_key"
      aws_secret_access_key: "aws_secret_key"
      delimiter: ','
      temp_dir: "meltano_test"
environments:
- name: dev
- name: staging
- name: prod
Thanks! 🙂