Hi all, already my first question - how can I add ...
# plugins-generala
axel_bock
03/05/2021, 3:33 PMHi all, already my first question - how can I add the MS SQL server tap to a docker-based meltano project? (to a “normal” meltano project might work just as fine, I just started out with the docker container but this is no requirement). Anyone who did this before?
t
taylor
03/05/2021, 3:42 PMIs your workflow that you just pulled the latest docker image? You will need a meltano project that docker can point to. I believe you should be able to start the docker image and you could run through the project initialization steps to make this happen.
a
axel_bock
03/05/2021, 4:12 PMoh i did all the “meltano init” etc. stuff. i also configured the target.
d
douwe_maan
03/05/2021, 4:12 PM@axel_bock https://github.com/singer-io/tap-mssql is built using Clojure instead of Python, so Meltano doesn't currently support it, but we plan to address that using https://gitlab.com/meltano/meltano/-/issues/2205.
I'd suggest trying one of the workarounds here: https://gitlab.com/meltano/meltano/-/issues/1175#note_407636966, or https://github.com/wintersrd/pipelinewise-tap-mssql
a
axel_bock
03/05/2021, 4:12 PMI just don’t know how I get this non-discoverable JVM-based exampleless mssql tap into this project - docker being NO requirement, I can also install meltano locally on the host.
axel_bock
03/05/2021, 4:13 PMso Meltano doesn’t currently support it
d
douwe_maan
03/05/2021, 4:13 PMThere's no difference between using Meltano in Docker, or installing it directly in your local environment here
a
axel_bock
03/05/2021, 4:13 PMnoooooooooooooooo
d
douwe_maan
03/05/2021, 4:13 PMhttps://github.com/wintersrd/pipelinewise-tap-mssql is worth a try though!
a
axel_bock
03/05/2021, 4:14 PMoh there is a python tap? even better.
axel_bock
03/05/2021, 4:15 PMseems very inactive though. still, if it works …
d
douwe_maan
03/05/2021, 4:16 PMMSSQL hasn't changed much in the last few months though 😉
a
axel_bock
03/05/2021, 4:18 PMso how do I get this into the project?
d
douwe_maan
03/05/2021, 4:18 PMa
axel_bock
03/05/2021, 4:19 PMokay I could have found that. 🙈 thanks!!
axel_bock
03/05/2021, 4:26 PMunfortunately this fails:
pip install pipelinewise-tap-mssqld
douwe_maan
03/05/2021, 4:31 PM@axel_bock You can install it directly from the Git repo: https://adamj.eu/tech/2019/03/11/pip-install-from-a-git-repository/
a
aaronsteers
03/05/2021, 6:25 PMHi, @axel_bock - If you are able to get this working (and also if not), do you mind adding some comments on your experience here on my related issue: https://github.com/wintersrd/pipelinewise-tap-mssql/issues/3
There’s broad interest in having a stable MSSQL tap based in python. If you can get it working, or even just log the error(s) you get when trying, I think either way would be a net positive for the community.
a
axel_bock
03/05/2021, 6:38 PMI was about to ask where there are docs about writing a plugin - although I am a so-so programmer python is my language.
axel_bock
03/05/2021, 6:38 PMI’m happy to help out, and for sure you will hear from me if you want 😉
axel_bock
03/05/2021, 6:39 PM@douwe_maan and yup, that worked. installing, at least. i should stop working I really didnt think of that although it’s mentioned right there in the interactive text output.
axel_bock
03/05/2021, 6:42 PM@aaronsteers looking at the 3 issues with no replies and the github activity of wintersd … a fork might be the best idea. I don’t really trust this thing to be honest.
a
aaronsteers
03/05/2021, 6:44 PMYeah, totally fair. I was just browsing there are a few forks already but no information yet I could find regarding what works (or doesn’t). For what it’s worth, I also sent the maintainer a slack invite and message using his listed contact email. I’ll post back on that issue if I hear anything.
a
axel_bock
03/05/2021, 6:47 PMso let’s get this thing to work 😉 . but first - weekend for me 😆
a
aaronsteers
03/05/2021, 6:48 PMSounds like a plan!
Enjoy your weekend!! 🥳🥳