Is it possible to read any extractor configuration when in the target namespace?
For example in the tap namesapace, I can read using:
client.py
.....
self.config["domain"]
.....
meltano.yml
.....
plugins:
extractors:
- name: tap-custom
namespace: tap_custom
pip_url: -e ./
capabilities:
- state
- discover
- catalog
config:
domain: "https://www.googleapis.com"
....
However, if I use self.config in targets namespace I can only read configuration from targets
r
Reuben (Matatika)
06/12/2024, 2:27 PM
Don't think that's possible. Curious what your use-case is though?
My target is Elastic and in Elastic when you bulk load records, there is a parameter "op_type". For some taps I will be using "Create" and for others "Index". Since I have one project and multiple extractors, I need to read the configuration from the extractors in the target code (sinks).
Nir Diwakar (Nir)
06/12/2024, 8:00 PM
For now, I have defined a config variable in target. It is a list of tap names which will be using "Create" op_type.