Meltano

Is anyone programmatically generating Meltano YAML project files? I’ve been doing this for a long time in an adhoc way (scaffold tap definitions for 130 databases, or 80 google analytics projects, etc) but we’re scaling out our Meltano infra, we’ll have a lot more tap and target definitions to manage, and I’m interested in any prior art in this area.

For example: does the `meltano` python package expose project file schemas? Could I generate a YAML file and then validate it against that schema?

it appears that the schema is defined here <https://github.com/meltano/meltano/blob/c82fdc8d3ac47ca8e9ecf2f081534e0fbf4a3527/src/meltano/schemas/meltano.schema.json>

but, unclear if that’s accessible in a python project that depends on the `meltano` package (I’ll need to test this)

Yeah, the schema file is distributed with the Meltano package (both wheel and sdist include it) since it's used by `meltano compile`.

I'm also curious about exploring <https://pkl-lang.org/> for this type of thing. Essentially there'd be a remote meltano module and people could import it into their own pkl project to generate a `meltano.yml`