https://linen.dev logo
Join Slack
Powered by
<@U06CE59HKBN> and <@U06CQE69U1X> - Since you’ve b...
# contributing
a
@andrew_stewart and @david_tout - Since you’ve both put in significant effort on getting us to support 
dbt
v0.18+
, I wanted to share the latest update here. Essentially, scope expanded because we needed to update how Meltano injects packages it downloads, and we also needed to update the 
files-dbt
packages as well as all of the tranform packages which meltano supports. We had to do this in a backwards compatible way, so that we would not break users on current/prior versions of meltano and dbt. The new MR (with task burndown) is here: https://gitlab.com/meltano/meltano/-/merge_requests/2170#note_599568022 I’m hopeful this will be able to merge next week in Meltano (probably 
v1.77.0
). Let me know if you have any additional thoughts or feedback. Thanks! And have a great weekend. 🏖️
fyi @aaron_phethean
a
Great work guys. Looking forward to trying it out. Let us know if any early testing would help. We could test on a branch pre release, etc
a
Thanks, @aaron_phethean. You're more than welcome to test it out if you've got an environment available to do so. 👍 We don't have a prerelease on PyPi so you'd just have to install via the latest branch/commit.
Luckily we do have a good amount of integration tests - and most of them failed initially, which is how I learned of the larger scope issues here. 😅
What I'd expect: • On first adding dbt to a project, you should get a new version of dbt and the latest version of files-dbt - which provides the initial dbt_project.yml file. • On adding a transform to a project that already has dbt installed, Meltano should smartly use the expected 
env
location and syntax based on what dbt_project.toml has for it's 
config-version
.
Also, since we now have to support git refs (branches) for dbt transforms packages, the 
packages.yml
file should now add a 
revision
property for packages which require them. (Our future plan is to migrate these to dbt hub so we can use semantic versioning.)
a
👍 we’ll take a look tomorrow. Let you know if we find anything unusual. Sounds like you’ve given it a good run, but can’t hurt to give it a spin on a project depending on dbt 18
a
👍
6 Views
Open in Slack
PreviousNext
Powered by