Hey folks, idk if this is a meltano or singer-sdk ...
# singer-tap-development
p
Hey folks, idk if this is a meltano or singer-sdk thing, but my tap is writing a log for each row+column, is this normal? i'm getting thousands of lines like this: (My tap is https://github.com/decentraland/tap-decentraland-api - made with singer sdk) Is there some setting to supress these messages?
d
@pablo_seibelt I think that's a recently introduced bug. @aaronsteers?
p
The API is public and requires no authentication in case it helps test
a
@pablo_seibelt - Yes, that is a bug we resolved and will be releasing this week. You can pull from main to get the latest, or revert to a prior version.
p
Ok that's great to hear, is it a regression in Singer SDK or in meltano?
Thanks a lot!!
a
This was a regression in the SDK, specifically when we added the stream and property selection logic.
p
Amazing, thanks @aaronsteers!! I'll upgrade next week then
For reference πŸ‘†
@pablo_seibelt - I have just pushed a prerelease version
0.1.5-dev.1245286412
which you can reference if you want to test the fix ahead of the official next release.
p
Thanks a lot!! I'll try that out tomorrow πŸ™‚
Also thanks for this working on this sdk, i was going crazy trying to create a singer tap from scratch 😬
(Using stich's template)
a
Awesome! Thanks for providing the feedback. We feel that pooling our collective resources into a great SDK is the right long-term investment. If you ever have ideas for improvements, we happily accept issues and merge requests. We are still in early stages but we are working hard with community members make sure we have the right features (and stability) before we publish as a
1.0
release.
s
Was going to post about this issue yesterday, amazing as always to see that you’re on it already @aaronsteers
p
That worked perfectly @aaronsteers! Thanks
a
@pablo_seibelt - Thanks for confirming! We plan to release that formally on Thursday/Friday. (And it was just one click to get a pre-release published so I was happy to do that πŸ™‚. )
p
Yeah the ECS job i was running was taking >1h without ending and now my process runs in ~9 min
a
Much improved! πŸ˜…
p
Yeah thanks!!
s
wow, this is a great fix. Just tested and it it worked great for me.