Hi 👋 I'm using tap-mysql to load data, but what I want is to only load the data incrementally .. I have this config in the yaml file, but unfortunately its not catching the changes ..

plugins:
  extractors:
  - name: tap-mysql
    variant: transferwise
    pip_url: pipelinewise-tap-mysql
    metadata:
      '*':
        replication-method: FULL_TABLE
      id:
        replication-method: INCREMENTAL

My question: • Does Meltano supports catching data incrementally? • If yes, how 😄 because the previous one did not work.

Does Meltano supports catching data incrementally?

yes

If yes, how 😄 because the previous one did not work.

Your question is really how do I do incremental replication with

pipelinewise-tap-mysql

I don't use the tap so I'm not certain so you'd have to dive (or pay someone to dive for you). Your metadata from a far looks right except normally you'd see a replication-id, and your select also isn't listed. What'd I'd do from here is generate your catalog with

meltano invoke --dump=catalog tap-mysql > catalog.json

verify the stream that you want is selected and has the replication method set properly. After that if it's still not working I'd dive into the tap implementation to see what I"m missing. It's a good assumption that the tap supports incremental streams Someone else here may have tap-mysql experiance!