GitHub
05/08/2025, 8:28 PMpost_process automatically to all stream types
Pull request opened by edgarrmondragon
With this change, developers won't need to re-implement the call to post_process when they override the public Stream.get_records(...) method.
A few examples just from MeltanoLabs: https://github.com/search?q=org%3AMeltanoLabs+%22self.post_process%22&type=code.
i.e.
• https://github.com/MeltanoLabs/tap-dbt/blob/49cbf08f91d297d73f2cf19d73614a9a65a31f70/tap_dbt/streams.py#L107-L111
• https://github.com/MeltanoLabs/tap-postgres/blob/d7e11bcaae0d87717771a5a38744d0ec674dabf5/tap_postgres/client.py#L259-L267
• https://github.com/MeltanoLabs/tap-jira/blob/caa12cdc5ee890a440e61df880f76172c9a85e8a/tap_jira/streams.py#L2402-L2406
• https://github.com/MeltanoLabs/tap-messagebird/blob/37a64a4b178e7c1e511ac4481bd69b2e145c6df6/tap_messagebird/streams.py#L98-L102
## Summary by Sourcery
Automatically apply post_process method to all stream types during record synchronization
New Features:
• Automatically invoke post_process method for all stream types during record sync
Enhancements:
• Updated record processing workflow to consistently apply post-processing across different stream types
Tests:
• Added test case to verify post-processing functionality for streams
meltano/sdkGitHub
05/08/2025, 8:28 PMpost_process automatically to all stream types
Pull request ready for review by edgarrmondragon
meltano/sdkGitHub
05/28/2025, 6:34 PMpost_process automatically to all stream types
Pull request merged by edgarrmondragon
meltano/sdk