https://linen.dev logo
#singer-tap-development
Title
# singer-tap-development
p

prratek_ramchandani

06/21/2021, 7:46 PM
This is still a WIP but for anyone interested I wrote a Singer tap for dbt artifacts. While it should work with other targets, I wrote it primarily with the intention of loading this data to to a BigQuery target. Because I wanted to load each field into BigQuery’s native types instead of just dumping the JSON to a string column, I had to throw in some transformation logic. For example, some artifacts have fields that are of type object with a property for each column in your table - I transformed that to instead be an array with one entry per column so that my final result has a definite set of columns in it. https://github.com/prratek/tap-dbt-artifacts