So let's say I have a single table in my source th...
# getting-started
t
So let's say I have a single table in my source that I'd like to split into multiple tables in the target. Further let's say that my tap is not SDK based. I feel like I should be able to accomplish that with some combination of meltano-tap-transformer and 'meltano run' but I'm having trouble putting the pieces together in my head. Any suggestions? Am I totally missing something here? P.S. I don't really think this is the best channel for this question but I can't find one that seems appropriate either, so... suggestions welcome there too 🤦🏻‍♂️
c
@thomas_briggs Is your target supported by dbt? It sounds like you would want to use dbt to create multiple models that will create the desired destination tables in your target system.
t
I could do it with dbt but it would be much more efficient to do it as part of the extraction process. Renaming the destination stream based on a bit of data in the record, before it gets to the target, is a trivial amount of work. Scanning the table N times after its been landed into the destination is N-1 times more expensive. 🤷🏻‍♂️ Not a blocker or anything, just trying to be efficient. 😉