Hey everyone, I was wondering what the preferred s...
# singer-tap-development
s
Hey everyone, I was wondering what the preferred settings on an extractor were for a child extractor in the format of: • Association table • Format /association/{contact_id}/deal • Large amount of contacts (100 000+) • No replication key • Unsure if deal updated at is updated once contact is updated
j
I imagine your concern is that you don’t want 100K+ state bookmarks, right? If you don’t mind making each call every run, you could just make the child stream full table so it shouldn’t store any state
s
My issue is two-fold: 1. Storing state 2. Amount of time it takes to pass through every child (it's a fairly important table, and should be kept up to date)