hey all, i was wondering how meltano handles schema evolution? Anybody able to share their experience when the source system introduces non-breaking or breaking changes
hey @aaron_phethean, i don't see anything about schema changes in that thread
a
aaron_phethean
06/27/2023, 9:44 PM
The idea is that the expectations catch the schema change. You’re right that there’s no ‘clever’ handling of the schema changes in that thread (or in meltano) Some taps / targets automatically handle some changes, but all effects on the downstream aggregations are on the model developer https://transferwise.github.io/pipelinewise/user_guide/schema_changes.html