Hi there! There is a way to partition the response...
# getting-started
c
Hi there! There is a way to partition the response from a parent stream and send 'batchs' to a child stream? For example, i have a parent stream returning 100 records, and i want to break this 100 records and send in 10 blocks of 10 records, each one. Is this possible?
l
yes i think that is fairly common, e.g. see what this postgres tap does using a db cursor: https://github.com/transferwise/pipelinewise-tap-postgres/blob/master/tap_postgres/sync_strategies/incremental.py#L97