Channels
#cli
Title
# cli
b
brave-ice-86395
11/27/2019, 5:33 PMmeltano permissions grant roles.yml --db snowflake --dry --difff
fierce-honey-5880
11/27/2019, 5:43 PMHey @brave-ice-86395!
It should be able to complete in a couple of minutes.
At least that's how much time it takes for Gitlab's Snowflake
Is this behavior new or was the permissions command always that slow for you?
b
brave-ice-86395
11/27/2019, 5:47 PMalways slow
our roles.yaml looks very similar to gitlab's
is there a debug flag?
f
fierce-honey-5880
11/27/2019, 5:48 PMNo, unfortunately there is not. But you can always clone Meltano and run the script in debug mode if you really want to check what happens
b
brave-ice-86395
11/27/2019, 5:50 PMit is stuck at
Checking that all entities in the spec file are defined in Snowflakef
fierce-honey-5880
11/27/2019, 5:52 PMThat;s the more heavy part: we ping Snowflake a lot to get users, DBs, schemas, etc
But I can not see why it would take hours.. you can download all the Star Wars films in a couple hours..
b
brave-ice-86395
11/27/2019, 5:52 PMTrue story
f
fierce-honey-5880
11/27/2019, 5:52 PMMaybe Snowflake throttles you? That's really weird
b
brave-ice-86395
11/27/2019, 5:53 PMokay that part finished so i guess mostly stuck in fetching privileges per entity
f
fierce-honey-5880
11/27/2019, 5:56 PMI have only one idea:
1. Clone Meltano
2. Update the SnowflakeConnector and uncomment the
insecure_mode=True,pip install -e '.[dev]' Copy code
python3 -m venv venv
source venv/bin/activate
pip install -e '.[dev]'You may be getting OCSP errors which would make the script make 100x more calls
If that's the case, then we should add a flag to enable that mode. I was only getting this while testing from home but it may be the case for production systems also.
b
brave-ice-86395
11/27/2019, 5:58 PMclearly its snowflake's end
didnt know show grants can take soo long
f
fierce-honey-5880
11/27/2019, 6:00 PMwow! I have never seen that.. It's just a
SHOWOr you have assigned 334198231487123 privileges to that role lol
b
brave-ice-86395
11/27/2019, 6:01 PMmakes sense!!
this is insane it is into 10 mins now
its a xsmall warehouse but not sure we need so much compute for a simple
showf
fierce-honey-5880
11/27/2019, 6:02 PMDo you get the same when you run it from inside the Snowflake SQL editor?
You should totally report this to Snowflake!
I really want to see what's the problem there..
b
brave-ice-86395
11/27/2019, 6:03 PMyes doing that now
f
fierce-honey-5880
11/27/2019, 6:03 PM(I think that I am also using an xsmall warehouse for similar tasks)
b
brave-ice-86395
11/27/2019, 6:09 PM27,428 rows producedinsane
f
fierce-honey-5880
11/27/2019, 6:11 PMInsane indeed. Let's see what they are going to tell you.. Please don't forget to post back here after you discuss this with Snowflake support!
b
brave-ice-86395
11/27/2019, 6:14 PMsure thing, thanks Yannis