I'm trying to implement a CI pipeline that uses `s...
# singer-tap-development
e
I'm trying to implement a CI pipeline that uses
singer-tools
to check the tap output, but just realized that the package last had a release in 2017 😅. Would porting some of those CLI tools to the SDK be of some value? If so, I think I can work on a MR
d
We just started discussing that in https://gitlab.com/meltano/meltano/-/issues/2624#note_521419421! I think that would definitely be valuable
Although I also like just using
meltano elt
in CI to test a tap in an actual pipeline: https://gitlab.com/DouweM/tap-investing/-/jobs/1079644316
e
Ah, I missed that conversation 👀. I was able to use
singer-tap-check
to create a comment like this: https://github.com/edgarrmondragon/tap-confluence/pull/7#issuecomment-792484286. I figure something like that may be helpful for people developing/maintaining a tap. I like the idea of using meltano in the CI! If the data is small and PII-free enough maybe use target-sqlite and be able to download it as an artifact of the CI pipeline.