#3340 fix(targets): Track table preparation to prevent data loss on schema changes
Pull request opened by
edgarrmondragon
## Summary by Sourcery
Prevent data loss when target schemas change mid-stream by tracking table preparation state and only dropping tables on the first overwrite, then incrementally adding new columns thereafter.
Bug Fixes:
• Fix unexpected table drops and data loss on schema changes in OVERWRITE mode
Enhancements:
• Introduce a preparation cache to ensure tables are only dropped once per run and subsequent schema updates add columns incrementally
Tests:
• Add unit tests to verify tables aren’t dropped and data is preserved during schema evolution
• Add an end-to-end SQLite integration test for successive schema changes
meltano/sdk