Hey,

meltano compile

creates manifest.json. The problem is that it does not expand attributes in streams. Example: using tap-github, I declare

workflows.*

. When I run the compile, manifest.json contains

workflows.*

, the wildcard is not expanded. Current workaround solution: Run

meltano select --list --all

and extract selected (and expanded) attributes for the workflows stream. It is not an ideal workaround because

meltano select

command much slower than

meltano compile

. Questions: • Would it feasible to extend the

meltano compile

command accordingly? • If yes, I can contribute, if anyone is so kind to guide me 😉 cc: @Justin Cohen

Hey @jan_soubusta!

• Would it feasible to extend the

meltano compile

command accordingly?

I think so: • The Manifest.data would be the place where this happens • You might need to instantiate an invoker for each extractor plugin • The PluginInvoker.files property holds a mapping with the

catalog

key pointing the catalog file

It is not an ideal workaround because

meltano select

command much slower than

meltano compile

.

It's possible that implementing this makes

meltano compile

somewhat slower 😅. We could make it optional, though. Do log a feature request!