Hey everyone, We're choosing our ELT stack and I'v...
# random
i
Hey everyone, We're choosing our ELT stack and I've landed on Meltano along with Airflow(Maybe Dagster) and dbt (Snowflake for DW). I was first planning on just setting this all up on a VM - but Azure Container Apps seems like a better/easier route (It's built on top of AKS). Has anyone had experience with a similar stack? If so - where should I store audit logs (Airflow requires a Postgres backend - I'll probably want to query these logs for troubleshooting)? Should I spin up containers for my Meltano/dbt jobs, respectively? Does there seem like a more efficient way to do this? Thank you!