https://linen.dev logo
Join Slack
Powered by
my local dbt-snowflake install keeps getting hung ...
# plugins-dbt
i
my local dbt-snowflake install keeps getting hung up but it's installing fine in my container. what should I do?
e
Hey! What's your local OS, Python version and Meltano version?
i
OS: Windows 10.0.19045, Python 3.10.11, meltano version 3.6.0
e
And the container is presumably linux. What does the 
pip_url
look like for the dbt-snowflake utility?
i
- name: dbt-snowflake variant: dbt-labs pip_url: dbt-core~=1.8.0 dbt-snowflake~=1.8.0 git+https://github.com/meltano/dbt-ext.git@v0.1.0
- name: dagster variant: quantile-development pip_url: dagster-ext==0.1.1 dbt-core~=1.8.0 dbt-snowflake~=1.8.0 pendulum<3 dagster<1.9 I also had to add 
dagster<1.9
to my dagster install because there was some incompatibility with the new version of dagster and dbt 1.8. My plan was to just wait until the upcoming dbt 1.9 release and see if it (new dagster + new dbt versions) works then. However, I don't know if a dependency conflict in my dagster pip_url between dagster/dbt (if that conflict still even exists) would have any sort of implications on my dbt-snowflake install.
FROM meltano/meltano:v3.5.1-python3.10
is my base image in my dockerfile
e
So the command that hangs is 
meltano install
?
i
Yeah. Here it got hung up on the dbt-snowflake install and after 30 minutes I just aborted the install.
meltano install
is working fine in my container build. I actually just did a build to test a dbt pipeline bc i can't locally without a container lol
e
can we try isolating the problematic plugin? Maybe try 
meltano install utility dbt-snowflake
.
✅ 1
My suspicion at the moment is there's a missing binary wheel of some package for windows and it hangs because it's building it from source.
i
Running that utility install in isolation is just getting hung up as well
is there some sort of cache that meltano looks at for previous installs or something? or some lock file that could be causing issues?
e
Not really. Are you using the uv venv backend?
i
No, I am not
e
hmm can you try using this 
pip_url
?
Copy code
pip_url: dbt-core~=1.8.0 dbt-snowflake~=1.8.0 meltano-dbt-ext~=0.3.0
i
So, use 
git+<https://github.com/meltano/dbt-ext.git@v0.3.0>
instead of 
git+<https://github.com/meltano/dbt-ext.git@v0.1.0>
, or just override 
git+<https://github.com/meltano/dbt-ext.git@v0.1.0>
with 
meltano-dbt-ext~=0.3.0
Both failed
Well, didn't fail, but got hung up
e
ok, let's try this. Can you install uv? https://docs.astral.sh/uv/getting-started/installation/#__tabbed_1_2 Will use that to test the installation of each component individually.
i
Okay I installed with pipx
Should I init a new venv for meltano and try to run the install w that?
e
let's try 
uv tool install --with 'dbt-core~=1.8.0' --with 'meltano-dbt-ext~=0.3.0' 'dbt-snowflake~=1.8.0'
i
uv tool install --with dbt-core~=1.8.0 --with meltano-dbt-ext~=0.3.0 dbt-snowflake~=1.8.0
The ' caused an error so I did the above command and got the following output:
image.png
Should i use the versions it printed for dbt-core, dbt-snowflake, and meltano?
e
what versions are those?
i
image.png
Sorry haven't used uv before
e
Should i use the versions it printed for dbt-core, dbt-snowflake, and meltano?
nah, they are compatible with what we requested
✅ 1
ok since you have pipx let's try also
Copy code
pipx install dbt-snowflake~=1.8.0
pipx inject dbt-snowflake dbt-core~=1.8.0
pipx inject dbt-snowflake meltano-dbt-ext~=0.3.0
i
This is the output I got from 
pipx install dbt-snowflake~=1.8.0
I did a 
pipx list
and it looks like dbt-snowflake didn't install as well
image.png
e
Ah, let's try the other way around
Copy code
pipx install dbt-core~=1.8.0
pipx inject dbt-core dbt-snowflake~=1.8.0
pipx inject dbt-core meltano-dbt-ext~=0.3.0
i
All 3 succeeded
e
Without hanging?
i
Yup
e
Ok, I'm a bit at a loss then 😅
i
Any time I've used "hanging" it's been where something never completes nor fails and I just have to terminate it
e
Ok, so your local Meltano is 3.5.0 and is installed on Python 3.10.11. What's does the 
pipx list
output say about the fresh install of 
dbt-core
?
i
1.8.9
e
And Python 3.10.11?
i
correct
e
let's do 
meltano install --clean
for good measure
✅ 1
i
It got hung up on the dbt-snowflake install as well. I'm going to try and reinstall with an older dbt-snowflake version. Sometimes if I'm getting other dbt failures like 
dbt clean
isn't working, dbt run, or parse isn't working, etc... Doing a faulty install of dbt then an install with my current config has fixed the issue. No idea why it's worked but may as well try
12 Views
Open in Slack
PreviousNext
Powered by