GitHub
10/22/2026, 5:39 PMget_record_batches.
• Support Arrow batch rechunking, schema-aware column selection, incremental bookmark advancement, STATE emission, and partition-aware processing for native Arrow data.
Enhancements:
• Preserve existing record-based batching and child-stream behavior when native Arrow data is unavailable or unsupported.
Documentation:
• Document how to implement native Arrow data production, schema requirements, batching behavior, and bookmark handling.
Tests:
• Add coverage for Arrow rechunking, schema promotion, incremental and partitioned syncs, column selection, fallback behavior, child streams, and missing dependencies.
meltano/sdkGitHub
10/22/2026, 5:39 PMGitHub
10/22/2026, 6:54 PM