I am trying to define a tap configuration once, in meltano.yml, and use it in all of my environments. To do this, I will need to dynamically build the S3 bucket path. I haven’t been able to get this to work, although the documentation makes me think that it should. Any thoughts?

- name: tap-s3-mongo
      inherit_from: tap-spreadsheets-anywhere
      config:
        tables:
          - path: <s3://raw-data>-${PAYIT_ENVIRONMENT}
            name: raw_data
            pattern: raw_data/.*json
            start_date: '2023-02-01T00:00:00Z'
            key_properties: [ ]
            format: jsonl

$ PAYIT_ENVIRONMENT=dev meltano --environment=dev config tap-s3-mongo
2023-02-07T17:39:23.854919Z [info     ] Environment 'dev' is active
{
  "tables": [
    {
      "path": "<s3://raw-data>-${PAYIT_ENVIRONMENT}",
      "name": "raw_data",
      "pattern": "raw_data/.*json",
      "start_date": "2023-02-01T00:00:00Z",
      "key_properties": [],
      "format": "jsonl"
    }
  ]
}

Env vars inside array values are not expanded: https://github.com/meltano/meltano/issues/3171

thanks, that’s what it seemed like