question regarding extractors. I see extractor for...
# best-practices
a
question regarding extractors. I see extractor for MySQL - https://hub.meltano.com/extractors/tap-mysql its mentioned about ‘incompatible with the default
datamill-co
variants of
target-postgres
and
target-snowflake'
From what I can understand it does not support snowflake target. Can anyone familiar with this extractor confirm this? Also for mysql, I am not seeing option for CDC mentioned in https://transferwise.github.io/pipelinewise/connectors/taps/mysql.html even though the its touching upon log based data extraction with GTID. I am looking for both a CDC option by reading binlogs and an option to read tables from a certain timestamp or id (able to run sql statement).
t
Hi @arjunkumar_krishnankutty. That note says that the MySQL tap doesn't work specifically with the datamill target for Snowflake - the other Snowflake targets will work fine though. I tested a MySQL-to-Snowflake pipeline a few months ago (using the transferwise target) and it worked fine.
As far as CDC goes - configuring tables to used LOG_BASED replication will handle that. I think your "certain timestamp" scenario is probably covered by INCREMENTAL mode. It depends on exactly what you mean though.
a
thanks for the clarification. new the environment and getting familiar with singer, meltano ethos.