Hello my good Meltano community I m trying to set multiple s

Question

Hello my good Meltano community I m trying to set multiple schema definitions via environment variables How would I structure the ` lt EXTRACTOR gt SCHEMA` variable to include multiple different streams with different column definitions I m looking specifically at <https meltano com docs plugins html how to use 4|this documentation>

salmon-salesclerk-77709 · Answer

hello

proud-pillow-55935 · Answer

Lol hit enter by mistake laughing

salmon-salesclerk-77709 · Answer

```export lt EXTRACTOR gt SCHEMA lt ENTITY gt lt ATTRIBUTE gt lt KEY gt = lt value gt ``` seems to be the answer but full disclosure I ve never done this do you have the different stream definitions

proud-pillow-55935 · Answer

It said this right above that ``` Once schema descriptions have been set in `meltano yml` environment variables can be used to override specific nested properties ```

proud-pillow-55935 · Answer

So it sounds like I need to define the schema in `meltano yml` before I use that

salmon-salesclerk-77709 · Answer

oh that s in the code block hmm I don t know the answer then My gut would say that you could just set the environment variable and that would work that s what would make sense to me but that text there seems to indicate otherwise < ripe musician 59933> can you chime in

salmon-salesclerk-77709 · Answer

Or < salmon actor 23953> since Douwe is out for the next hour or so

salmon-actor-23953 · Answer

Hi < proud pillow 55935> just to confirm did you want to set up two instances of the extractor with one inheriting from the other or did you want a single instance that can target two different schemas depending on the env vars when run

salmon-actor-23953 · Answer

Based on your original comment I think you want the inherits from behavior which basically makes two extractor definitions one inheriting from the other but each can have their own selection logic and their own variable overrides Does that sound right

ripe-musician-59933 · Answer

< proud pillow 55935> So you want to set the entire schema for a tap and its multiple streams using a single env var You re on the right track with `TAP FOO SCHEMA` which you ll want to set it to a JSON encoded dictionary with a top level key for each stream If you want to use a separate env var for each stream you ll first have to add a key for each stream to `meltano yml` which can look like this ```schema stream one stream two ``` You can then use `TAP FOO SCHEMA STREAM ONE= lt attribute gt lt key gt lt value gt `

ripe-musician-59933 · Answer

However it ll be easiest to maintain if you just set the entire schema in `meltano yml` instead of injecting it at runtime using the environment

ripe-musician-59933 · Answer

As AJ said if you want to use the same tap with different schema settings you can use inheritance