I met cool folks from Meltano in the recent Data C...
# singer-target-development
j
I met cool folks from Meltano in the recent Data Council. This afternoon/night, I tried to build a new target connector for my startup company (timeplus). A MVP working version is ready https://github.com/timeplus-io/target-timeplus A few comments regarding the doc/exp: • Overall I like the docs and sample code • The first 1/3 of dev guide is nice, but then I don't get many useful info regarding custom loader/target. https://docs.meltano.com/tutorials/custom-extractor looks great, but can we have a similar version for target? • (BTW) I was a bit confused for the terms: source/tap/extractor, sink/target/destination/loader • Once I got the sample code generated, I'd like to test it with a source/tap. I have problem to use
tap-carbon-intensity
or
tap-smoke-test
(they are not on hub.meltano.com or pipx) Then I noticed a few OSS project just import
tap-smoke-test
directly, I did then used
meltano install
but it failed to load
tap-smoke-test
First I saw "0.9.0 Requires-Python >=3.7.1,<3.11" then I downgrade from Python 3.11.3 to 3.10.11, but failed again. I tried many python version and ended up with 3.8.16 • Once I can run a elt pipeline to feed my target with sample data, make it work took ~0.5 hour since I built a similar connector for airbyte before. • TL;DR, the current dev guide is more focusing on building a tap. Suggest adding more guide for targets
p
@jove_zhong great meeting you at Data Council! Thanks for that feedback, thats super helpful. I created a PR https://github.com/meltano/hub/pull/1232 to add your target to the hub and I also added tap-smoke-test https://github.com/meltano/hub/pull/1233
j
Thank you, @pat_nadolny . I added few comments for the 1st PR. I will write a blog when the target is available on meltano hub. To be honest, I created a destination connector for airbyte around Xmas, even today the PR is not reviewed yet. 💯 to Meltano team
Again, thank you @pat_nadolny and @cody_hanson for the help and review. I wrote the first line of code around Sunday dinner time, and now the target-timeplus is live on Meltano Hub. I cannot be more happy than this. I wrote a blog to quickly summarize what I did on medium. A more formal announcement will be shown up in our website later today.