Hi, We are using MySQL taps to Snowflake Targets. Is there a way to do full replication of table with a

where

clause . i.e. Want to do full table replication with

LAST_MODIFIED_DATE

>

Jan-01-2022

. I cannot truncate source table because its required by other table and the source table is too huge, 2 TB total table size. Does anybod have any option for doing this ?

I can think of a couple options... 1. Create a view that selects only the rows you care about and replicate that 2. Use something like meltano-map-transformer to filter out the rows you don't want

There is barely any documentation for the

meltano-map-transformer

@thomas_briggs looked at its github repo.. didnt see any docs

That is true. I think the docs you really want are here: https://sdk.meltano.com/en/latest/stream_maps.html

Thank you for the response.. this is good lead..

You are welcome! 😄