akshay_p
01/17/2023, 9:10 AMmeltano add extractor tap-mysql
But unable to add it facing below issue.
Installing extractor 'tap-mysql'...
Extractor 'tap-mysql' could not be installed: could not create the virtualenv for 'extractors/tap-mysql'
Need help fixing this problem? Visit <http://melta.no/> for troubleshooting steps, or to
join our friendly Slack community.
Failed to install plugin(s)
Will Da Silva (Arch)
01/17/2023, 2:32 PMpython -m venv '.meltano/extractors/tap-mysql'
using the same Python environment/executable you used to run Meltano when you hit this error, from the root of your Meltano project directory.
That command is what failed when Meltano tried to run it. If running it yourself produces an error message, that may help us figure out what has gone wrong here.
If the command executes successfully, then please delete the directory at .meltano/extractors/tap-mysql
, since only Meltano is supposed to manage such virtual environments, and doing it manually will result in missing packages, and other problems later on.
Could you please also run python -m pip -V
using the same Python environment/executable, and post the results here.akshay_p
01/17/2023, 3:46 PMRun invocation could not be completed as block failed: Extractor failed
Here is my .yml file,
Here for security reason i have not mention the exact s3 creds,
my database name is : demo and it contains almost 10 tables but if i want to extract only single table then how should i do. @Sven Balnojan @Will Da Silva (Arch) @visch @thomas_briggs
version: 1
default_environment: dev
project_id: d62c3ecd-8465-4519-83d0-dec53a441bf9
plugins:
extractors:
- name: tap-mysql
variant: transferwise
pip_url: pipelinewise-tap-mysql
config:
port: "3306"
host: "localhost"
user: "akshay"
password: "abc@123"
database: "demo"
filter_dbs: "demo"
ssl: "false"
loaders:
- name: target-s3-csv
variant: transferwise
pip_url: git+<https://github.com/transferwise/pipelinewise-target-s3-csv.git>
config:
s3_bucket: "dremio-s3-demo"
aws_access_key_id: "aws_access_key"
aws_secret_access_key: "aws_secret_key"
delimiter: ','
temp_dir: "meltano_test"
environments:
- name: dev
- name: staging
- name: prod
Thanks! 🙂