Hi everyone, I have used meltano-map-transformer to add an extra field to my csv output. It is working when the value is hardcoded but I am trying to send it through the .env file and it is failing when referred as env varaible. This is my meltano.yml

mappers:
    - name: meltano-map-transformer
      variant: meltano
      pip_url: git+<https://github.com/MeltanoLabs/meltano-map-transform.git>
      mappings:
        - name: add_clientid
          config:
            stream_maps:
              collects:
                client_id: ${CLIENT_ID}

And below is the error I am getting

2025-01-16T08:05:12.215689Z [info     ]     raise MapExpressionError(msg) from ex cmd_type=elb consumer=True job_name=dev:tap-shopify-to-target-csv:1 name=meltano-map-transformer producer=True run_id=3080d92f-bf3f-4152-b72d-820dbfc4befd stdio=stderr string_id=meltano-map-transformer
2025-01-16T08:05:12.215689Z [info     ] singer_sdk.exceptions.MapExpressionError: Failed to parse expression ${CLIENT_ID}. cmd_type=elb consumer=True job_name=dev:tap-shopify-to-target-csv:1 name=meltano-map-transformer producer=True run_id=3080d92f-bf3f-4152-b72d-820dbfc4befd stdio=stderr string_id=meltano-map-transformer
2025-01-16T08:05:12.216724Z [info     ] 2025-01-16 13:35:12,216 | INFO     | target-csv           | Target 'target-csv' is listening for input from tap. cmd_type=elb consumer=True job_name=dev:tap-shopify-to-target-csv:1 name=target-csv producer=False run_id=3080d92f-bf3f-4152-b72d-820dbfc4befd stdio=stderr string_id=target-csv
2025-01-16T08:05:12.282215Z [warning  ] Intermediate block in sequence failed.
2025-01-16T08:05:12.290259Z [info     ] 2025-01-16 13:35:12,290 | INFO     | target-csv           | Target 'target-csv' completed reading 1 lines of input (0 schemas, 0 records, 0 batch manifests, 1 state messages). cmd_type=elb consumer=True job_name=dev:tap-shopify-to-target-csv:1 name=target-csv producer=False run_id=3080d92f-bf3f-4152-b72d-820dbfc4befd stdio=stderr string_id=target-csv
2025-01-16T08:05:12.291258Z [info     ] 2025-01-16 13:35:12,291 | INFO     | target-csv           | Emitting completed target state {} cmd_type=elb consumer=True job_name=dev:tap-shopify-to-target-csv:1 name=target-csv producer=False run_id=3080d92f-bf3f-4152-b72d-820dbfc4befd stdio=stderr string_id=target-csv
2025-01-16T08:05:12.309903Z [info     ] Writing state to Local Windows Filesystem
2025-01-16T08:05:12.311902Z [info     ] Incremental state has been updated at 2025-01-16 08:05:12.311902+00:00.
2025-01-16T08:05:12.318901Z [error    ] Unexpected completion sequence in ExtractLoadBlock set. Intermediate block (likely a mapper) failed.
2025-01-16T08:05:12.318901Z [error    ] Block run completed.           block_type=ExtractLoadBlocks err=RunnerError('Unexpected completion sequence in ExtractLoadBlock set. Intermediate block (likely a mapper) failed.') exit_codes={<PluginType.EXTRACTORS: 'extractors'>: 1, <PluginType.LOADERS: 'loaders'>: 1} set_number=0 success=False

The format ${env} is working for other variables in extractor and loader but I am not sure why its failing in the mapper.

Hi @Chandana S! This is a known gap in env var expansion unfortunately, see https://github.com/meltano/meltano/issues/7151