Hi Meltano Team! I'm wondering if you could point ...
# announcements
n
Hi Meltano Team! I'm wondering if you could point me in the right direction for how to troubleshoot the adding of a custom tap. I'd love to be able to use Meltano to pull data from several locations, the most important of which is a mysql database. There's a singer tap available (https://github.com/singer-io/tap-mysql) which I've been able to get running ok on it's own (I can run the commands in the CLI and get it to pipe records to stdout). I've also added to
meltano.yml
such that I can see it showing up in the UI as a tap and set up a pipeline. However, when I try to Test Connection or run the pipeline, it's unable to connect and I'm getting "Subprocess didn't exit cleanly" errors in the logs. Any suggestions for where I should investigate next?
Other potentially helpful info: I'm running meltano (~1.15 I think) in a docker container. Mysql and Postgres (my desired target) are also both running in separate containers.
Please let me know if there's other details I can provide that would be helpful too!
m
n
Thanks! I had seen this, but had thought that this was for taps/targets being written entirely from scratch instead of existing taps/targets pulled from other repos (e.g. why would I need to use a cookiecutter template if I can just clone an existing repo?)
Reading through it again, I think I can tell which steps to skip or modify if I want to use an existing tap, but flagging that it might be worth clarifying the differences between that process and writing a completely new tap in future versions of these docs
m
Thanks for your feedback — hit me up if you need anything else.
n
thanks, will do!