Is there a way to rename all streams from a particular plugin? I want to use a single sqlite database, but this only supports a single schema, so I want to prefix all my streams from
tap-google-analytics
to be created in tables prefixed with
ga_*
etc to segregate them
p
pat_nadolny
03/03/2023, 8:34 PM
@Andy Carter you can use standalone mapper plugins or if either of your tap or target are SDK based then you can use stream-maps. I dont know that theres an easy way to do something like prefix all streams but you can use either of these mechanisms to configure your job to rename a specific stream. If you only have a few streams then its no big deal but if you have a ton of streams then it might become impractical to config each one.
a
Andy Carter
03/06/2023, 8:13 AM
Thanks Pat, will check it out. I will probably use sqlite only for local testing so maybe multiple database files is a compromise, one for each plugin.