dean_morin
05/11/2021, 6:04 PMloaders:
- name: target-snowflake
pip_url: pipelinewise-target-snowflake==1.12.0
capabilities:
- catalog
- discover
- state
config:
file_format: FILE_FORMATS.CSV
user: MY_USER
role: MY_ROLE
default_target_schema: MY_SCHEMA
In my .env I have TARGET_SNOWFLAKE_DBNAME="MELTANO".
When I run an elt I get a configuration error complaining that it’s not set:
$ meltano --log-level=info elt --job_id=wip tap-postgres target-snowflake
...
target-snowflake | * Required key is missing from config: [dbname]
meltano | Loading failed (1): * Required key is missing from config: [dbname]
I think I’m using the expected variable name according to the docs: https://github.com/transferwise/pipelinewise-target-snowflake#to-run-testsedward_smith
05/11/2021, 6:16 PMsource .env before you ran the command?dean_morin
05/11/2021, 6:44 PMdouwe_maan
05/11/2021, 7:14 PMvariant: transferwise to the definition?dean_morin
05/11/2021, 7:23 PMdean_morin
05/11/2021, 7:27 PMdouwe_maan
05/11/2021, 8:19 PMdouwe_maan
05/11/2021, 8:20 PMTARGET_SNOWFLAKE_DBNAME won't be picked up unless you define dbname: null under config, or - name: dbname under settingsdouwe_maan
05/11/2021, 8:20 PMmeltano add --custom loader target-snowflake , it would've asked you to provide the names of all the settings. If you had listed dbname there, it would've worked as expecteddouwe_maan
05/11/2021, 8:21 PMmeltano config target-snowflake list it won't currently show dbname, or TARGET_SNOWFLAKE_DBNAMEdean_morin
05/11/2021, 9:07 PM