Using two different paths for `tap-spreadsheets-an...
# troubleshooting
r
Using two different paths for
tap-spreadsheets-anywhere
on dev vs prod run. Having some issues with writing the
meltano.yml
file. I have this setup:
Copy code
plugins:
  extractors:
  - name: tap-spreadsheets-anywhere
    variant: ets
    pip_url: git+<https://github.com/ets/tap-spreadsheets-anywhere.git>
    config:
      tables:
      - path: file://../../data/dev/tracks
This works. However, I am not sure how to make a custom configuration for prod? I just need the path to change to
- path: file://../../data/prod/tracks
. I just learned here meltano has a bug, that maks it unpossible to add a
.env
variable for this switch. Would love your help
m
(tap-spreadsheets-anywhere maintainer here) I believe the only way to get this behavior is to duplicate the entire
tables
config property between your dev and prod environment, changing only the environment name:
Copy code
environments:
- name: dev
  config:
    plugins:
      extractors:
        - name: tap-spreadsheets-anywhere
          config:
            tables:
              - path: file://../../data/dev/tracks
- name: prod
  config:
    plugins:
      extractors:
        - name: tap-spreadsheets-anywhere
          config:
            tables:
              - path: file://../../data/prod/tracks

plugins:
  extractors:
  - name: tap-spreadsheets-anywhere
    variant: ets
    pip_url: git+<https://github.com/ets/tap-spreadsheets-anywhere.git>
this is what we do, for instance. It works fine although it feels very verbose
r
Thanks Matt, exactly what I was looking for. Works like charm! 😄