Is there a doc that covers or explains why Meltano...
# plugins-general
j
Is there a doc that covers or explains why Meltano taps are different from Singer Taps? Shouldn’t the Meltano tap registry contain > 50 taps? Is help needed or do I just misunderstand?
d
@john_g Good question, and I intend to clear that up in https://gitlab.com/meltano/meltano/-/merge_requests/1641! There's no such thing as a "Meltano tap", as Meltano aims to support all existing and new Singer taps. However, for Meltano to be able to use a Singer tap as a "Meltano extractor" plugin, it needs some extra information (metadata) about the tap's capabilities and settings. When you add a custom plugin (see https://meltano.com/#meltano-add), you'll be asked to provide this metadata yourself. When you add a "known" extractor by name, Meltano will look up this metadata in a file called
discovery.yml
(https://meltano.com/docs/contributor-guide.html#known-plugins). This means that for existing Singer taps to become known extractors in Meltano, a user (like yourself) will first need to add it to a local Meltano project as a custom plugin, verify it works with the provided metadata, and then contribute that new metadata to the Meltano project.
So help would definitely be appreciated, and since this hasn't been as clear as it could be so far, I intend to explain this process more clearly in https://gitlab.com/meltano/meltano/-/merge_requests/1641 🙂
j
Thanks for clarifying Douwe. I appreciate all the hard work.
d
@john_g Thanks for giving it a try and for your feedback 🙂 I know there are still a lot of rough edges, but together we'll smoothen them out!