Good afternoon all, Over the last couple months I have been working on a migration from BQ to Snowflake, one of the primary reasons for shifting to Snowflake had to do with Container Services which is essentially a k8 cluster. I intend to run meltano/airflow and a couple other things from there. Now comes the discussion part, I was wondering if it would be worthwhile creating and releasing a Snowflake Tgt that leverages Snowflake Secrets and the connection environment variables passed to the compute pool, or if someone is already working on this any input would be great.

Hey @John Archer 👋 Thanks for sharing that, TIL about Snowpark Container Services!

I was wondering if it would be worthwhile creating and releasing a Snowflake Tgt that leverages Snowflake Secrets and the connection environment variables passed to the compute pool

What would the benefits or use cases of that be? There's also the question of what level of support the existing Snowflake Python clients have for this feature(s), cause that would block adopting them in the existing MeltanoLabs connectors.

I may start hacking on this. I believe that having the ability to leverage Compute Cluster at the data layer is a game changer. I am also thinking that there is a

utility

here for generating and scheduling task in place of airflow. Combined all of this with Streamlit in Snowflake and wola Data Ops Platform at the data layer giving you one single interface.