Hi all, I am new to meltano and having some issues...
# troubleshooting
h
Hi all, I am new to meltano and having some issues: When I run meltano tap-mysql using variant transferwise my job works fine. However when I use variant meltanolabs - I get the following error:
Cannot start plugin tap-mysql--full: Catalog discovery failed: command ['C:\\Users\\haaris.hussain\\vi-data-docunet\\.meltano\\extractors\\tap-mysql\\venv\\Scripts\\tap-mysql.exe', '--config', 'C:\\Users\\haaris.hussain\\vi-data-docunet\\.meltano\\run\\tap-mysql--full\\tap.15cb6099-b2c4-46d4-9509-19cd130594c2.config.json', '--state', 'C:\\Users\\haaris.hussain\\vi-data-docunet\\.meltano\\run\\tap-mysql--full\\state.json', '--discover'] returned 1 with stderr:
2024-09-25 19:00:28,101 | INFO     | sqlconnector         | No is_vitess configuration provided, dynamically checking if we are using a Vitess instance.
a
Can you share your full
meltano.yml
with secrets removed and the meltano command you are trying to run?
There is more info here on the vitess config, perhaps you need
is vitess: False
https://github.com/MeltanoLabs/tap-mysql?tab=readme-ov-file#accepted-config-options
h
Command:
meltano run tap-mysql--full target-snowflake--full
a
I think adding
is_vitess: false
somwhere after line 130 might help?
In your base
tap-mysql
config
h
That didn't work - I'm getting another error now
The new error I am getting consists of:
Run invocation could not be completed as block failed: Cannot start plugin tap-mysql--full: Catalog discovery failed: command ['C:\\Users\\haaris.hussain\\vi-data-docunet\\.meltano\\extractors\\tap-mysql\\venv\\Scripts\\tap-mysql.exe', '--config', 'C:\\Users\\haaris.hussain\\vi-data-docunet\\.meltano\\run\\tap-mysql--full\\tap.5acb266e-de57-4add-a77a-210925feaa20.config.json', '--state', 'C:\\Users\\haaris.hussain\\vi-data-docunet\\.meltano\\run\\tap-mysql--full\\state.json', '--discover'] returned 1 with stderr
sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (3159, 'Connections using insecure transport are prohibited while --require_secure_transport=ON.')
(Background on this error at: <https://sqlalche.me/e/14/e3q8>)
a
Progress of a kind!
🙌 1
@Haaris Isaac Hussain does this help? https://github.com/MeltanoLabs/tap-mysql/issues/3
The two variants do not necessarily have the same config, you will have to review the two taps configs and check yours still makes sense with the meltanolabs variant https://github.com/MeltanoLabs/tap-mysql?tab=readme-ov-file#accepted-config-options
h
I don't get how that makes a difference? the BamboOSZ variant works and not the MeltanoLabs
I have added the sqloptions but with no luck
a
Any chance you know what's going on @visch
v
My best guess is SSL is required for your mysql instance so you'll have to pass over ssl information https://docs.sqlalchemy.org/en/20/dialects/mysql.html#ssl-connections Why another variant would just work withou an ssl configuraiton (could you verify this is actually true?) Pipeline wise looks pretty clear that you have to turn
ssl
to True and configure it
👍 1
h
I had to set this option for it to work: sqlalchemy_options: ssl_verify_cert: "false"
❤️ 2