Hi! I have issue running tap-mssql in production environment, I saw error:

ELT could not be completed: Cannot start extractor: Catalog discovery failed: command ['/project/.meltano/extractors/tap-mssql/venv/bin/tap-mssql', '--config', '/project/.meltano/run/elt/puzzel/d8e73cf9-4cb3-4f92-90f4-be9ac3be4664/tap.d31db82c-d6a5-47f4-a8f4-afe34e198458.config.json', '--state', '/project/.meltano/run/elt/puzzel/d8e73cf9-4cb3-4f92-90f4-be9ac3be4664/state.json', '--discover'] returned 1.

But when I test thing in local env, everything works, I do not know how to find the issue. Please help, thank you!

What’s the output with

--log-level debug

?

Sorry, I am wondering how can I run

--log-level debug

in production environment on AWS?

Sorry for the late reply. Can you modify the

meltano

command you are running to include

--log-level debug

? I have close to no experience with AWS, so I'm not sure if I'm missing something fundamental here. 😅 I don't think this is a good thing to be doing in a production environment though... I'm assuming that this is a problem with the settings you are providing to

tap-mssql

. It would be a good idea to try and replicate this issue locally, in an environment the same as or similar to your AWS configuration (use Docker if an image is available to you). Then: 1. Change your

tap-mssql

settings 2. Run

meltano --log-level debug elt tap-mssql <LOADER>

3. Check the debug log output for the error cause 4. Repeat until you get a working configuration.

Hi! I tried to run the

--log-level debug

in the prod env. And having detailed error:

CRITICAL (20002, b'DB-Lib error message 20002, severity 9:\nAdaptive Server connection failed (<http://hrd02.puzzel.com|hrd02.puzzel.com>)\n')
...

It is something wrong with the connection to the db server, right?

Looks like it. 👍

Hi, another late reply. tap-mssql is using some older libraries (pymssql) for connecting to MS SQL databases if you are still having issues you may wish to try my variant. I have a variant here https://github.com/s7clarke10/pipelinewise-tap-mssql which has some significant updates to support CDC log based replication as well.

Hi! thank you for replying! My issue is that I can run it with no problem in my local environment but having that error in production environment (when running on AWS) which I have no idea why it happened. 😅

Hi @xinge_li, I can state that I am successfully using my variant of pipelinewise-tap-mssql against mssql database running on RDS in AWS. Have you tried this variant https://github.com/s7clarke10/pipelinewise-tap-mssql it has an updated version of pymssql which I believe is required. Additionally have you got the right networking in place for where your container or Meltano instances is running to AWS RDS. For me I am running my container containing Meltano in AWS which helps from a networking perspective - there was still a requirement to allow networking from my account. I also need to get the hostname from the RDS instance to connect to database. I would suggest that your issue might be a networking connectivity issue.