- SOLVED! - - I must have made a type before - env...
# troubleshooting
m
- SOLVED! - • I must have made a type before • env var
TARGET_BIGQUERY__EXCHANGERATE_TABLE_SUFFIX
works perfectly - thx @edgar_ramirez_mondragon for solution ------------------------------------------- Hi, I have my base plugin loader “target-bigquery”, and one inherited called “target-bigquery--exchangerate”, and I need to set table suffix for extracted data. I can do it through config, but I need to set it on the load date through Airflow, but environment variables cannot contain dashes (“-”) in their name, therefor I am a bit unsure how to set it. In my Airflow DAG, this is not picked up (obviously):
env_vars={
'TARGET_BIGQUERY__EXCHANGERATE_TABLE_SUFFIX': '_{{ ds_nodash }}'
,'TARGET_BIGQUERY--EXCHANGERATE_TABLE_SUFFIX': '_{{ ds_nodash }}'
},
The first envvar is created, but not picked up as I suspect Meltano cannot find it as the plugin is called target_bigquery--exchangerate (inherited plugin). • Please advise 🙂
PS: I run this on K8s…
e
Hi @magnus_avitsland. I can confirm that
TARGET_BIGQUERY__EXCHANGERATE_TABLE_SUFFIX
should be picked up by Meltano. You can confirm that’s the expected env var name by running
Copy code
meltano config target-bigquery--exchangerate list
m
Will check, thought I tried already, but will check again. Thanks for getting back, @edgar_ramirez_mondragon
should it be
target_bigquery__exchangerate_table_suffix
? Or
target-bigquery__exchangerate_table_suffix
? First one, right (as env vars cannot contain dashes “-”)?
@edgar_ramirez_mondragon thank you so much -
target_bigquery__exchangerate_table_suffix
worked perfectly 🙂 gg!