I have a situation where I have to rerun few loads...
# plugins-general
s
I have a situation where I have to rerun few loads with backfill and I have set the primary key using stream_maps
Copy code
stream_maps:
          useranalytics:
            __key_properties__:
            - date
            - user_id
          channelanalytics:
            __key_properties__:
            - date
            - channel_id
but when I run el it keeps adding records with the same date. How can I achieve a delete update? Is it better to do it in the T phase using dbt? we are using Snowflake so the lesser the compute better it is
ok this worked when defining the primary key in stream class, As per docs key properties should do the same, I am wondering if I am doing something wrong. 1 -- no primary key in stream class, only key_properties set -- not working 2 -- set primary ket in stream class -- working