:wave: Is there a way to access the current date i...
# troubleshooting
o
👋 Is there a way to access the current date in a config parameter? Like if my API requires an
end_date
parameter and I want to set it to the current date.
I was hopeful and thought the config value might be able to accept bash, so I tried
end_date: "$(date -I date)"
, but of course, it just read it as a string. I guess I could set an environment variable with bash, but since all the other config values are stored in the meltano.yml file, I was hoping to keep everything co-located, if possible.
Based on the docs, I think the answer is that only environment variables (and a few predefined meltano path variables) are available in the meltano.yml file. 😕 Feel free to 👍 and ignore me if that sounds right.
But... Now I'm not sure if the Dagster UI only accepts static environment variables as well. Basically, to summarize: Not sure how to set a dynamic config value. https://docs.dagster.io/dagster-cloud/developing-testing/environment-variables-and-secrets#creating-new-variables 🤔
p
Not sure about in dagster, but in airflow we pass it as an env variable to the subprocess that runs meltano so we create the value for the env var at runtime.