Hi all :slightly_smiling_face: do you know if ther...
# best-practices
o
Hi all 🙂 do you know if there's a way that when I inherit a configuration from a certain tap I can reuse it value with a small addition? For example: In production I have one database, and for every source that I load into snowflake, I have a dedicated schema. I also have a dev database in snowflake, and whenever a developer is working on a pipeline, the schema he uses consists of two parts: empName__schemaName e.g. if I develop a pipeline to pull data from salesforce, in production the schema will be
prod_db.salesforce.some_table
and in dev it'll be
dev_db.omri_salesforce.sometable
In meltano I defined a schema var for my dev_enviorment, but if I define a different schema in my target, it overwrites it instead of appending it (which is expected) Is there a way to append it? Example template (that is not working)
Copy code
environments:
- name: dev
  config:
    plugins:
      loaders:
      - name: target-snowflake
        config:
          database: AIRFLOW_TASKS_DEV
          warehouse: dbt_dev_wh
          schema: omri_
  loaders:
  - name: target-snowflake-salesforce
    inherit_from: target-snowflake
    config:
      schema: salesforce 
      load_method: overwrite
v
I don't understand what you're saying I'm sorry 😕
e
@Omri Antman Here's the closest I can think of to your request. See https://docs.meltano.com/guide/configuration/#available-plugin-environment-variables You might be able to customize the
namespace
of the inherited plugin and use
schema: omri_$MELTANO_EXTRACTOR_NAMESPACE
🙌 1