Does meltano support installing <https hub getdbt com dbt la Meltano #plugins-dbt

Does meltano support installing <dbt packages>? ca...

kathryn_cowie

11/03/2022, 5:55 PM

Does meltano support installing dbt packages? cant find on Docs. Attempting to run something like

meltano dbt deps

. (Use case is generating surrogate keys)

jacob_matson

11/03/2022, 5:55 PM

yes

jacob_matson

11/03/2022, 5:56 PM

meltano invoke dbt deps

kathryn_cowie

11/03/2022, 5:58 PM

wonderful thanks!

jacob_matson

11/03/2022, 5:58 PM

no prob! good luck!

aaronsteers

11/03/2022, 11:10 PM

@kathryn_cowie - Out of curiosity, do you have any need for auto-adding packages from the command line? Or are you okay to manually add into yaml first and then run

dbt deps

as described above?

aaronsteers

11/03/2022, 11:12 PM

In case these are interesting, I have a logged feature request for dbt here and a similar feature proposal for meltano dbt extension here.

aaronsteers

11/03/2022, 11:13 PM

(For context, we used to support a

meltano add transform

feature for adding dbt packages, but we've started to phase this out in favor of native dbt-level additions similar to the above.)

kathryn_cowie

11/03/2022, 11:28 PM

manually adding works, so I wouldn't say it's a need, but could be nice to have

kathryn_cowie

11/04/2022, 6:29 PM

my version of dbt is behind the dbt utils. I tried upgrading meltano

meltano upgrade all

(no change). Then added the flag --no-version-check , and modified the dbt version in

transform/dbt_packages/dbt_utils/dbt_project.yml

Now I see a different error:

Copy code

% meltano invoke dbt-postgres:run -s my_model
2022-11-04T18:22:34.307446Z [info     ] Environment 'dev' is active
18:22:38  Running with dbt=1.1.2
18:22:39  Unable to do partial parsing because a project dependency has been added
18:22:40  Encountered an error:
Compilation Error
  In dispatch: No macro named 'except' found
      Searched for: 'my_meltano_project.postgres__except', 'my_meltano_project.default__exc
ept', 'dbt.postgres__except', 'dbt.default__except'

any suggestions?

aaronsteers

11/04/2022, 7:35 PM

Modifying the dbt version in

meltano.yml

in the

pip_url

is correct. I don't recognize that error personally. Just to be sure, you can run

meltano install --clean

to ensure you get a fresh installation - and afterwards, running the

deps

command again would also be a good idea just to be safe.

8 Views

Open in Slack

Previous Next