Are the Getting Started section and the follow-on ...
# getting-started
f
Are the Getting Started section and the follow-on Data Transformation (T) on the Meltano.com website supposed to be in working order? The E and L work fine, but the T has quite a few errors. Based on what I can tell, it looks like it is due to tables that are not present in the DB when doing the T, maybe because the projects (meltano/meltano and meltano/tap-gitlab) just don't have any relevant information? I'm basically just looking for a complete ELT demo or getting started that works from start to end so I can validate my setup. Any other examples of the complete process, including DBT for the transform, that I can reference?
p
Hey Fred! - I'm actually working on updating the documentation as we speak but the long and short of it is that the "out of the box" dbt transform modules (like this one) are deprioritzed right now to focus on the EL step because its difficult to make them scale with so many combinations of taps and targets. You can use those models as starting points for your transformations but they arent maintained right now so they most likely wont work out of the box without changes. A common pattern is for users to customize their DBT code in the
/transform
directory and run it using
meltano invoke dbt:run
.
f
OK. I'm rolling my own. I have a custom extractor, will use the postgres loader, and I'll create a DBT project to do some simple transforms.
p
Awesome! Let us know if you run into anything