taylor
08/25/2021, 9:24 PMedgar_ramirez_mondragon
08/25/2021, 9:34 PMalter table my_table add column ...
should support schemas with added fields. Maybe target-athena can be a reference implementation for the sdk?taylor
08/25/2021, 9:36 PMken_payne
08/25/2021, 9:49 PMaaronsteers
08/26/2021, 4:58 PMSink.prep_destination(stream_name, schema, key_properties)
and for tabular/columnar Sinks, a per-column, something like ensure_column_exists(...)
and ensure_column_compatible(...)
. Even a TabularSink.get_native_type(jsonschema_type) -> Any
might be helpful because we can catch errors and give a developer-provided fallback type automatically.