#6727 bug: A single Environment definition can not be split into multiple YAML files Issue created by edgarrmondragon Meltano Version 2.5.0 Python Version NA Bug scope API Operating System Any Description When a Environment (e.g.

prod

) is defined in multiple project files, Meltano fails with the following error message:

Plugin with path "environments:prod" already added in file /run/media/atif.imam/data/pycharm_projects/data-integration/source_config/file_1.yml.

This is because the multi-file implementation indexes environment by name alone. This means an entire environment definition MUST be contained in a single YAML file and it makes use cases where it's desirable to split plugin configuration in one file per plugin with a common set of environments impossible to accomplish. From a Slack thread: https://meltano.slack.com/archives/C01TCRBBJD7/p1662443196912219 Code YAML files # meltano.yml environments: - name: dev - name: uat - name: prod send_anonymous_usage_stats: true project_id: 488164fd-cb5b-4fe1 include_paths: - ./source_config/file_1.yml - ./source_config/file_2.yml plugins: extractors: - name: tap-mysql variant: transferwise pip_url: pipelinewise-tap-mysql config: .. .. loaders: - name: target-snowflake variant: transferwise pip_url: pipelinewise-target-snowflake config: add_metadata_columns: true hard_delete: true .. .. # file_1.yml environments: - name: prod config: plugins: extractors: - name: tap-mysql-db1 loaders: - name: target-snowflake-db1 config: s3_key_prefix: snowflake/db1/ - name: uat config: plugins: extractors: - name: tap-mysql-db1 loaders: - name: target-snowflake-db1 config: plugins: extractors: - name: tap-mysql-db1 inherit_from: tap-mysql loaders: - name: target-snowflake-db1 inherit_from: target-snowflake config: default_target_schema: db1 # file_2.yml environments: - name: prod config: plugins: extractors: - name: tap-mysql-db2 loaders: - name: target-snowflake-db2 config: s3_key_prefix: snowflake/db2/ - name: uat config: plugins: extractors: - name: tap-mysql-db2 loaders: - name: target-snowflake-db2 config: plugins: extractors: - name: tap-mysql-db2 inherit_from: tap-mysql loaders: - name: target-snowflake-db2 inherit_from: target-snowflake config: default_target_schema: db2 meltano/meltano