josh_lloyd
08/14/2023, 2:52 PMtap-mysql
‘s out there? I’ve got a situation where if the meltano run
pipeline fails in the target side of the pipeline (in my case target-snowflake
), it would seem that it unceremoniously kills the connection on the tap-mysql
side. The connection is set to timeout on the mysql server’s side about 8 hours later, so when my pipelines run again the next day, the tap-mysql
appears to try to open the same connection but ends up timing out with pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on '<host-name-here>' ([Errno 110] Connection timed out)")
. If this theory is correct, forcing a refresh of the connection (if such a concept exists) should fix the error. But rerunning the pipeline with --full-refresh
doesn’t seem to help since it only refreshes the state in meltano. Any ideas?