Hi I'm working on a postrges -> snowflake load ...
# troubleshooting
a
Hi I'm working on a postrges -> snowflake load right now. Is there a way I can rename the tables as they arrive in snowflake? The documentation seems to provide ways to do this with stream maps but only for renaming columns and not tables.
This is the target I'm using . None of the config options seemed to be applicable either
j
I am currently using meltano map transformer to do that using
__alias__
here is an example
a
So that example should rename
customers
to
customers_v2
right? I tried something similar but it didn't work. I'll try again
This is the yml I used:
Copy code
stream_maps:
      sites:
        __alias__: partners__sites
I want to rename the table
sites
to
partners__sites
j
if sites is the stream-id for the table
sites
then yes.
a
Ahhh that might be my mistake
(not using the correct stream ID)
j
Stream-id's are crucial it is how everything communicates
a
Is there a place I can verify what the stream ID is? any logs or anything like that?
j
@Andrew Hintermeier what tap are you using? If you can share your tap, I can point out the stream-id or at least how it is generated outside of that you could use
discover
if your tap has it or look at the
tap.properties.json
file in
.meltano.run.<tap-name>
. In short the stream id is based on the TAP and what is selected. Ref docs and image the select has commits and tags, so there is a stream-id
commits
and
tags
for sql it is usually a combo of
schema.table
or
schema-table
a
We're using this one: https://github.com/transferwise/pipelinewise-tap-postgres I'm like 70% sure it's
schema-table
like you mentioned but that was not working for me
j
there should be a folder for the tap in
.meltano
ref image that file has all of the stream id's
if you follow the docs for the
select
command it will also show you the pattern