raaj sarma
10/15/2024, 2:07 AMextractors:
- name: tap-mysql--sach
inherit_from: tap-mysql
variant: transferwise
pip_url: pipelinewise-tap-mysql
config:
host: production-mysql.cluster-ro-cadsfe69zcjv.eu-west-1.rds.amazonaws.com
port: 3306
user: service_account_meltano
database: sach
default_replication_method: FULL_TABLE
session_sqls:
- SET @@session.max_execution_time=0 # No limit
- SET @@session.net_read_timeout=21600 # 6 hours
- SET @@session.net_write_timeout=21600 # 6 hours
# Set other session variables to the default PPW ones
- SET @@session.time_zone="+0:00"
- SET @@session.wait_timeout=28800
- SET @@session.innodb_lock_wait_timeout=3600
load_schema: sach_meltano
Hi this is the extractor that was working fine for months for me.
Recently the source db upgrade their mysql version to mysql 8 and immediately the tap started failing. I am unable to see any errors or find any reason why my tap is failing except this error that shows up.
File "/opt/meltano/project-meltano/.meltano/extractors/tap-mysql/venv/lib/python3.9/site-packages/pymysql/connections.py", line 729, in _read_bytes[0m [36mcmd_type[0m=[35melb[0m [36mconsumer[0m=[35mFalse[0m [36mname[0m=[35mtap-mysql--sach[0m [36mproducer[0m=[35mTrue[0m [36mstdio[0m=[35mstderr[0m [36mstring_id[0m=[35mtap-mysql--sach[0m
[2024-10-15, 01:43:51 UTC] {subprocess.py:93} INFO - [2m2024-10-15T01:43:51.087413Z[0m [[32m[1minfo [0m] [1m self._sock.settimeout(self._read_timeout)[0m [36mcmd_type[0m=[35melb[0m [36mconsumer[0m=[35mFalse[0m [36mname[0m=[35mtap-mysql--sach[0m [36mproducer[0m=[35mTrue[0m [36mstdio[0m=[35mstderr[0m [36mstring_id[0m=[35mtap-mysql--sach[0m
[2024-10-15, 01:43:51 UTC] {subprocess.py:93} INFO - [2m2024-10-15T01:43:51.087697Z[0m [[32m[1minfo [0m] [1mAttributeError: 'NoneType' object has no attribute 'settimeout'[0m [36mcmd_type[0m=[35melb[0m [36mconsumer[0m=[35mFalse[0m [36mname[0m=[35mtap-mysql--sach[0m [36mproducer[0m=[35mTrue[0m [36mstdio[0m=[35mstderr[0m [36mstring_id[0m=[35mtap-mysql--sach[0m
Could anyone suggest what I can try? Anything on the database end or connection end? Downgrading the version of mysql in the source is not an option.visch
10/15/2024, 12:33 PM