Hi.. question on how meltano works internally.. if...
# troubleshooting
a
Hi.. question on how meltano works internally.. if you're executing a tap as
meltano run tap-zendesk target-snowflake
. Will the data loading to snowflake begin only after the data from extractor(zendesk) has been extracted completely? Or is there some batching mechanism which starts loading the data to target when the batch size is reached?
e
It's up to the target implementation, but loaders usually batch a certain amount of records before writing them and emitting state.
a
if state is emitted by the loader, will the target kick off the execution even if the loader hasn't pulled all the data?