hi, what is the explanation of this message? target-snowflake (meltano sdk variant)
Copy code
One or more records have exceeded the max age of 5 minutes. Draining all sinks.
-- seems it doesn't fail things per-se
✅ 1
e
Edgar Ramírez (Arch.dev)
02/04/2025, 4:33 PM
Singer targets don't normally write every record it receives immediately, but rather batches records in memory and waits until one of two conditions is met: either the batch size has reached its limit, or when the batch is too old. The latter ensures that data is committed with sufficient frequency so the bookmark is advanced in case the pipeline is interrupted.