question about

target-s3

- I want to build an environment that has multiple sources that all write to the same S3 bucket ideally, i would define the AWS credentials + bucket specifications once, however, i do want each source to write to a separate path in the bucket, for example slackSource -> s3://my-data/data/slack/... Github -> s3://my-data/data/github/.... etc... how can this be achieved without duplicating many s3-targets ? can the prefix setting somehow be changed dynamically per source or per EL operation ?

Meltano exposes a few environment variables to plugins that could help here: https://docs.meltano.com/guide/configuration/#available-plugin-environment-variables. For example, using

MELTANO_EXTRACTOR_NAMESPACE

plugins:
  loaders:
  - name: tap-s3
    config:
      prefix: $MELTANO_EXTRACTOR_NAMESPACE

thanks ! this is helpful, but what i was looking for is the "inherit_from" feature, which enables me to set different prefixes (for different loaders) based on the same basic loader that is target-s3.