Question: Does meltano have a tool that can help us document our data journey? That could be a cool way of documenting sources and destinations

Can you say more about your use case? I'm not sure if this is exactly what you meant but @alexander_butler added DataHub as a utility plugin at https://hub.meltano.com/utilities/datahub. I havent personally used it (and Alex can say more) but it looks like you can get lineage and metadata management across your stack, might be worth exploring

It was just an idea that was going through my head; being able to easily identify sources and their tables in an easy-to-use ui. The goal would be to be able to show to other team members what data we ingest. This should be super useful! I'll take a look into implementing it, thanks @pat_nadolny

I have just discovered this thread and I am super happy about it! It’s such an interesting addition to the ecosystem

Yeah its working great, I'll probably write a blog post on the engineering blog at some point. BTW if you really wanna nerd out with me

• dbt + DataHub integration improvements: you can now view dbt Test outcomes and enjoy a much improved dbt + warehouse navigation experience

datahub just announced this so dbt tests are surfaced alongside data assets (whereas before it was just great_expectations). this means my

meltano run tap-salesforce target-bigquery dbt-bigquery:salesforce datahub:ingest-dbt dbt-bigquery:salesforce-validate  datahub:ingest-dbt-tests

would automatically add constantly updated data validation statistics everytime i run the pipeline in datahub 🔥

This is 100% going in my tickets for implementation