david_lequin
05/10/2022, 2:30 PMmeltano install
on my local (which I rarely do). It's been running for 30 mins (🤯 ) to install 22 plugins, what on earth is this doing behind the scene? Just a bunch of pip installs? 🤔 Can I access logs some where to try understand what's taking so long?edgar_ramirez_mondragon
05/10/2022, 2:56 PMJust a bunch of pip installs?Yes, plus creating virtualenvs
Can I access logs some where to try understand what's taking so long?If you have
logging.yaml
set up, you can access the debug level logs and they should a bit more information, at least what high level step it's stuck in
My guess is the culprit is dbt
and in particular dbt-snowflake
, which takes a while to build (I'm not sure if the dbt folks publish wheels). If you're not using snowflake, you can edit the pip_url
of the dbt
plugin and get rid of dbt-snowflake
.david_lequin
05/10/2022, 3:03 PMtransformers:
- name: dbt
pip_url: dbt-redshift==1.0
david_lequin
05/10/2022, 3:04 PMdavid_lequin
05/10/2022, 3:04 PMdavid_lequin
05/10/2022, 4:23 PMdavid_lequin
05/10/2022, 4:23 PM