I keep running into an issue where my `tap-mssql` ...
# troubleshooting
i
I keep running into an issue where my
tap-mssql
job hangs after uploading state to blob storage. I've tried editing the state file, deleting the container, and nothing is working and the job still hangs at this step: 125447.946 PM gp INFO 2025-10-17T165447.946654Z [info ] Reading state from Azure Blob Storage 125448.028 PM gp INFO 2025-10-17T165448.027881Z [info ] uploading part #1, 17 bytes (total 0.000GB) Has anyone run into this? Any ideas? The file itself in Blob Storage IS being updated with the correct replication key, so I've got no idea why this is failing.
Copy code
pip_url: dagster-ext==0.1.3 dbt-core==1.9.3 dbt-snowflake==1.9.3 dagster==1.9.7
this is my dagster version if it matters
v
something is hanging so you have to figure out why. I've seen a lot of folks muff sub processes with their Meltano calls, I've seen tap's hanging. Easiest is to throw a debugger in and figure out where it's getting hung exactly in the stack
i
So just set this and try again? _MELTANO_CLI_LOG_LEVEL='debug'_
a
@Ian OLeary are your other jobs using azure state running successfully? Is it just this combination of state and tap, or any combination?
v
👀 1
i
@Andy Carter My other jobs using Azure state were running successfully, and it appears that stream seems to have resolved itself over the weekend.
@Andy Carter @visch I revisited this since some of my jobs started failing again. It looks like it's hanging while doing tap discovery, not necessarily during the read/write to Azure Blob storage. There's like 300-400 tables in that database (and also in the other databases on that server that the same job hits) but I don't want to replicate any of those tables. Does it still need to discover those tables in the DB to work? Any ideas? Can provide my meltano.yml for the tap if needed.
v
ahhh nice you found it! https://github.com/BuzzCutNorman/tap-mssql/issues/76 would solve it if you want to run with it!
✅ 1
i
Copy code
if self.config.get('fake_it', False):
so setting this in config to True?
@visch
Or you mean create some branch and use that?
v
Yes, tap postgres has this already with filter schemas I think it would translate maybe even 1:1 I'm not sure
i
But if there's tables in the same schema as the table I'm trying to replicate and i filter it out - wouldn't it break that stream?