#3696 feat: Support Arrow IPC as a BATCH file encoding format Pull request opened by edgarrmondragon SSIA Summary by Sourcery Add Arrow IPC as a supported BATCH file encoding format and integrate it into the SDK and documentation. New Features: • Introduce an Arrow IPC batch encoder and register it as a BATCH file format option. • Add an optional

arrow

extra to install Arrow-related dependencies. Enhancements: • Document Arrow IPC as a supported BATCH encoding format alongside JSONL and Parquet. • Broaden batcher interfaces to accept generic iterables of records instead of only iterators. • Enable dependency checking sessions to cover the new Arrow extra. • Relax the batch encoding capability schema to allow additional formats beyond JSONL and Parquet. Tests: • Add tests validating Arrow batch encoding behavior and file naming, gated on

pyarrow

availability. • Ensure existing Parquet batch tests are skipped when

pyarrow

is not installed. meltano/sdk