Does anyone know if it is possible to list all streams for a tap and all fields belonging to a given stream from the CLI? I am in a situation in which I am writing taps and targets for my team, however, it is my colleagues who are actually defining our Meltano jobs and such. One thing they struggle with is knowing what is actually going to get synced without having to go into the source code. Sometimes they only want to select certain streams or certain fields within a stream, but we cannot figure out an easy way to cleanly see that information. Take tap-hubspot for example (https://github.com/MeltanoLabs/tap-hubspot/tree/main), how would I know there is a stream called "users" and its schema without looking at

streams.py

?

https://docs.meltano.com/reference/command-line-interface/#select

meltano select tap-hubspot --list --all

😄

Haha WOW, I must be blind...

No problem! Glad to help

After spending a bit of time today trying to ask the question: "how do I just list the stream names without all of the field names?" I realized why I didn't find this command.

meltano select

is really intended for setting the SELECT config and not to provide a nice user interface to list the streams and/or their attributes. In my case, I have many streams in the tap with 300+ attributes each. The massive flood to the terminal makes this workaround stop being viable if I just want a simple compiled list of available streams. @Edgar Ramírez (Arch.dev) Is there any other way to get a list of streams or would this be worthy of a feature request?

Something like this would work for your needs @Adam Wegscheid?

meltano select tap-github --all --json | jq '.streams[] | select(.selection != "excluded") | .stream' select.json | uniq
"repositories"
"stargazers"

@Edgar Ramírez (Arch.dev) Definitely, though my question was more so if there was something built in to Meltano to provide such an output. The users of the taps I produce don't have the skill set to author such a statement on demand, but would easily be able to run something like

meltano tap-github --list-streams

or

meltano tap-github --list-attributes

if it were available. That may be out of scope for Meltano, however, I will likely create a feature request just to provide a place to discuss.

I will likely create a feature request just to provide a place to discuss.

Please do!

Feature request: https://github.com/meltano/meltano/issues/9654