Hi everyone, I have a use case where I need to ext...
# singer-taps
c
Hi everyone, I have a use case where I need to extract the data from mysql and load it into bigquery. I want to use meltano's tap-mysql for this. One doubt I have is, the incremental load should happen through the updated_at column and according to standard ETL process, checking the destination before proceeding with the load is good. Is there a way, I can pass a WHERE condition or even a filter condition to the tap before I run the job?
e
Copy code
metadata:
      your_db-your_table:
        replication-method: INCREMENTAL
        replication-key: updated_at
        key_properties:
          - id
I would imagine the above should work with tap-mysql
👍 1