david_m_williams
09/05/2023, 5:29 AMmeltano select tap-msql --list --all
it runs for a while and then eventually fails with a stack dump - which I assume is because the database is vast with too many tables, and the call to list the tables is likely timing out. Or, at least I assume this command is to list tables? This is my first time using Meltano.
I know the select command allows us to specify some kind of filter that should allow me to shrink down the number of tables I want to consider, but I'm not sure of the syntax. The tables I want start with "ABC$" so I tried meltano select --list --all tap-msql "ABC$%"
but I still get the same result.
Is there a way I can increase the timeout for SQL Server here? And any other way I can limit the work the tap is trying to perform on the SQL Server? My assumption here is this command lets me list the tables available, and I can then use meltano select tap-mssql commits <tablename>
to add it to my project. Am I right in this thinking?
Thank you kindly.