Hi! We’re working on replacing a customer’s current custom python scripts with Meltano but ran into an issue with one of the tables in Microsoft SQL Server. The data of this table spans from 2001 up to current date. Somewhere around 09/2010 there seems to be “corrupted unsorted chunks” that make the extraction fail. I encountered the error in both FULL and INCREMENTAL methods. Since we only need data from last year onwards; has anyone found a way to reverse the extraction working from most recent first? (Z -> A). My plan B would be asking the customer to create a view filtering the dates, plan C would be working the logic into the tap but I wanted to know if it could be achieved through meltano first. Thanks!

Which tap are you using? Does it support the config option of setting a start date? Because if you only need the data from the last year you could just set the start date to one year ago and the tap will skip everything before this date including the corrupted chunks.

Hi @ole_bause! Thank you for your feedback. We’re using `tap-mssql`the

wintersrd

variant