Matt Menzenski
06/21/2024, 3:37 PMmeltano config tap-mongodb list
today and noticed this at the end of the output:
Custom extras, plugin-specific options handled by Meltano:
_metadata.*.replication-key [env: TAP_MONGODB__METADATA___REPLICATION_KEY] current value: 'replication_key' (from `meltano.yml`)
_metadata.*.replication-method [env: TAP_MONGODB__METADATA___REPLICATION_METHOD] current value: 'INCREMENTAL' (from `meltano.yml`)
Does this mean I can specify the replication-key and replication-method via environment variables? If so, this is awesome - it’ll halve the number of tap configurations I have in YAML today (as we run this particular tap in both incremental and log-based replication modes).Edgar Ramírez (Arch.dev)
06/21/2024, 5:23 PMmeltano.yml
(as you've done) or declare them as settings, e.g.:
plugins:
extractors:
- name: tap-mongodb
settings:
- name: _metadata___replication_key
- name: _metadata___replication_method
Edgar Ramírez (Arch.dev)
06/21/2024, 5:24 PMTAP_MONGODB__METADATA___REPLICATION_KEY
and TAP_MONGODB__METADATA___REPLICATION_METHOD
env var names)