https://linen.dev logo
Join Slack
Powered by
I have a `target-redshift` plugin which comes from...
# plugins-general
h
I have a 
target-redshift
plugin which comes from a fork of a previously discoverable plug. The fork is my own. Most of my ETL pipelines use this to load to redshift. But I want to add the discoverage 
target-redshift
from TicketSwap (the Meltano default), and move pipelines over one by one. I'm not sure if I am doing this right. The Meltano docs are confusing on this.
Copy code
- name: target-redshift
    variant: transferwise
    pip_url:
      git+<https://github.com/hrm13/pipelinewise-target-redshift.git@sso-credential-provider-support>
  - name: target-redshift--ts
    inherit_from: target-redshift
    variant: ticketswap
    pip_url: git+<https://github.com/TicketSwap/target-redshift.git>
When I run a pipeline with 
meltano run
the new plugin does not appear to be used.
v
Quick answer is variants and inheritance doesn't work, have them be seperate custom loaders (no variant needed) and it'll get you what you're after!
➕ 1
That's what I recall, maybe I"m wrong but I know this will work!
h
Renaming the original, and having them both inherit seems to do the trick:
Copy code
- name: target-redshift--old
    variant: transferwise
    inherit_from: target-redshift
    pip_url:
      git+<https://github.com/hrm13/pipelinewise-target-redshift.git@sso-credential-provider-support>
  - name: target-redshift--ts
    inherit_from: target-redshift
    variant: ticketswap
    pip_url: git+<https://github.com/TicketSwap/target-redshift.git>
are you saying drop the variant, and just provide the pip_url with custom names?
v
if it works, great I swear that didn't' work for me a while back but if it works that's good!
Open in Slack
PreviousNext
Powered by