Hello all, I’ve got a question about log-based replication and state for a mysql database. Today I discovered a number of my pipelines could no longer find the associated binlog:

Unable to replicate binlog stream because the following binary log(s) no longer exist

This seems a bit odd to me because I’ve been running these pipelines daily and assumed the associated binlog for that state would have updated to a more recent binlog file (the binlog files get removed after seven days). Upon reflection I realize that perhaps if no changes occurred to that table then the binlog may not have gotten updated. So my question is the following: Does the associated binlog file for a table ONLY get updated if there is a data change for that table? As a background I’m using the transferwise mysql tap. Thanks all.

Does the associated binlog file for a table ONLY get updated if there is a data change for that table?

Correct. As such, log based is not suitable for tables that don't change that often.

Thank you for the response!