Hey Everyone! I am trying to install the singer-io variant of

tap-mssql

extractor via

meltano add extractor tap-mssql --variant singer-io

However I keep getting:

2024-07-09T15:09:56.006815Z [info     ] Installing extractor 'tap-mssql'
2024-07-09T15:09:56.006815Z [info     ] Skipped installing extractor 'tap-mssql'
2024-07-09T15:09:56.007322Z [info     ] Skipped installing 1/1 plugins

Is there a way I can find why this is being skipped? I have tried cleaning and reinstalling, but it just skips the install.

can you start your command with

meltano --log-level=debug

https://docs.meltano.com/guide/troubleshooting/#log-level-debug

@Andy Carter unfortunately that doesn't provide much more information:

C:\Users\conner.panarella\Documents\Code\data\meltano-test\test>meltano --log-level=debug add extractor tap-mssql --variant singer-io
2024-07-09T16:05:05.968259Z [warning  ] Failed to create symlink to 'meltano.exe': administrator privilege required
2024-07-09T16:05:05.972575Z [debug    ] meltano 3.5.0a3, Windows
2024-07-09T16:05:05.975617Z [debug    ] Looking up time zone info from registry
2024-07-09T16:05:05.979589Z [debug    ] Creating DB engine for project at 'C:\\Users\\conner.panarella\\Documents\\Code\\data\\meltano-test\\test' with DB URI 'sqlite:/C:\\Users\\conner.panarella\\Documents\\Code\\data\\meltano-test\\test\\.meltano/meltano.db'
2024-07-09T16:05:06.839713Z [debug    ] Found plugin parent            parent=tap-mssql plugin=tap-mssql source=HUB
2024-07-09T16:05:06.857585Z [debug    ] Locked plugin definition       path=WindowsPath('C:/Users/conner.panarella/Documents/Code/data/meltano-test/test/plugins/extractors/tap-mssql--singer-io.lock')
Added extractor 'tap-mssql' to your project
Variant:        singer-io
Repository:     <https://github.com/singer-io/tap-mssql>
Documentation:  <https://hub.meltano.com/extractors/tap-mssql--singer-io>

2024-07-09T16:05:06.863085Z [info     ] Installing extractor 'tap-mssql'
2024-07-09T16:05:06.863311Z [info     ] Skipped installing extractor 'tap-mssql'
2024-07-09T16:05:06.863798Z [info     ] Skipped installing 1/1 plugins

Can you share your

meltano.yml

? Are you able to invoke your tap at all, get any data from mssql?

@Andy Carter This is a fresh meltano project so the

meltano.yml

is pretty simple:

version: 1
default_environment: dev
project_id: bce6b828-5688-4f16-ba42-317a16283d8a
environments:
- name: dev
- name: staging
- name: prod
plugins:
  extractors:
  - name: tap-mssql
    variant: singer-io

Can you do a

meltano remove extractor tap-mssql

and then

meltano add extractor tap-mssql --variant singer-io

again. You're missing a namespace afaict but I wanna confirm if it's not added by

meltano add

.

@Edgar Ramírez (Arch.dev)

C:\Users\conner.panarella\Documents\Code\data\meltano-test\test>meltano remove extractor tap-mssql
2024-07-09T16:21:31.459839Z [warning  ] Failed to create symlink to 'meltano.exe': administrator privilege required

Removing extractor 'tap-mssql'...

Reset extractor 'tap-mssql' plugin settings in the system database
Removed extractor 'tap-mssql' from meltano.yml
Could not find extractor 'tap-mssql' in .meltano\extractors to remove
Removed extractor 'tap-mssql' from plugins\extractors\tap-mssql*.lock


C:\Users\conner.panarella\Documents\Code\data\meltano-test\test>meltano add extractor tap-mssql --variant singer-io
2024-07-09T16:21:45.519298Z [warning  ] Failed to create symlink to 'meltano.exe': administrator privilege required
Added extractor 'tap-mssql' to your project
Variant:        singer-io
Repository:     <https://github.com/singer-io/tap-mssql>
Documentation:  <https://hub.meltano.com/extractors/tap-mssql--singer-io>

2024-07-09T16:21:46.313614Z [info     ] Installing extractor 'tap-mssql'
2024-07-09T16:21:46.317648Z [info     ] Skipped installing extractor 'tap-mssql'
2024-07-09T16:21:46.318638Z [info     ] Skipped installing 1/1 plugins

To learn more about extractor 'tap-mssql', visit <https://hub.meltano.com/extractors/tap-mssql--singer-io>

Hmm ok. What version of Meltano are you using?

@Edgar Ramírez (Arch.dev) I tried both 3.4.2 and 3.5.0a3

Oh I see what's going on. According to https://github.com/singer-io/tap-mssql?tab=readme-ov-file#requirements:

This tap is written in Clojure, and as such, requires the JVM. It has been consistently tested to run using

OpenJDK 8

, which can be installed on Ubuntu using these commands.

So yeah, you were never gonna be able to install it with Meltano. Have you tried any of the other available variants in https://hub.meltano.com/extractors/tap-mssql/?

@Edgar Ramírez (Arch.dev) Got it, I read through that as well. I just thought it required the jdk installed and then I could use meltano. I've tried the other variants but I was hoping to use the Stitch variant as it is the only variant to use MSSQL Change Tracking instead of CDC.

fwiw I think you can still run it with Meltano, you just have to download the repo to a location in your computer, and set the

executable

attribute of the plugin to point to

/path/to/bin/tap-mssql

.

@Edgar Ramírez (Arch.dev) Good point! Unfortunately, as I am finding out, it requires openjdk-8-jdk which is not compatible with the Meltano docker image. 🤷‍♂️

Bummer 😕