Hello, the self.schema returned in the BatchSink returns the full schema of the stream instead of the selected attributes, this is the expected behaviour? It's possible to get a schema with only the selected attributes?
a
aaronsteers
02/24/2022, 10:12 PM
If the schema is not filtered, that probably lands on the responsibility of the tap.
aaronsteers
02/24/2022, 10:12 PM
The tap should ideally only send the selected set of schema fields to the target.
aaronsteers
02/24/2022, 11:42 PM
If self.schema contains the full schema, that's indicating that the tap does not support filtering its schema, only the record data itself. (SDK-based taps filter both automatically.)