Hey everyone, I was wondering what the preferred settings on an extractor were for a child extractor in the format of:
• Association table
• Format /association/{contact_id}/deal
• Large amount of contacts (100 000+)
• No replication key
• Unsure if deal updated at is updated once contact is updated
j
julian_knight
09/23/2022, 2:46 PM
I imagine your concern is that you don’t want 100K+ state bookmarks, right?
If you don’t mind making each call every run, you could just make the child stream full table so it shouldn’t store any state
s
Stéphane Burwash
09/23/2022, 2:47 PM
My issue is two-fold:
1. Storing state
2. Amount of time it takes to pass through every child (it's a fairly important table, and should be kept up to date)