Hi,
I am currently moving my singer taps to meltano sdk and I am asking myself some questions regarding catalogs.
I do not use a schema directory but a catalog as input. Why? Because I define the catalog as Kubernetes ConfigMap. Therefore I can easily change the catalog without the need to redeploy things. I personaly think, that it is better to have those things separated to change them easier.
Now when the question: I can still pass my catalog as parameter, but what/how to correctly use it with the meltano sdk. I started from scratch using the cookiecutter.
I won't need the schema definition or schema directory within the streams, but how do I map the input catalog to the streams? Is there an easy way? Are there examples?
For example, I define a Stream
GoalsStream
and in my catalog I have a stream with
"tap_stream_id": "goals"
. How to map those two together?