Hello! Is anyone using Pipelinewise target-postgres from the new GitHub repository? It seems the package referenced when installing

meltano add loader target-postgres --variant transferwise

is not updated anymore: https://pypi.org/project/pipelinewise-target-postgres/ The original repository is archived https://github.com/transferwise/pipelinewise-target-postgres And was moved to https://github.com/transferwise/pipelinewise/tree/master/singer-connectors/target-postgres but does not publish to pip anymore

I think there's a way to set up the

pip_url

to point to the pipelinewise subdirectory instead of PyPI, and we'll have to update our Hub plugins. Let me try it out.

I was able to make it sort of work:

- name: target-postgres
      namespace: target_postgres
      pip_url: git+<https://github.com/transferwise/pipelinewise.git#subdirectory=singer-connectors/target-postgres>
      config:
        host: db-warehouse
        user: meltano
        dbname: data_warehouse
        add_metadata_columns: true
        default_target_schema: misc

However, env variables such as TARGET_POSTGRES_HOST are not accessible by the plugin And load_schema is also not working, all taps go to the

default_target_schema

can you remove the

namespace

?

Then it defaults to

meltanolabs

variant

then also set variant to

transferwise

Sorry, I must have messed something in my earlier test, setting variant to

transferwise

makes the config and load_schema work as expected! I verified the tap is correctly using the version from git by checking if a bug merged yesterday was fixed

Thanks for confirming this

pip_url

approach works! Let me know if there other pipelinewise connectors you use or know of that we should update: https://github.com/meltano/hub/issues/1887.

I believe all repositories have been merged 🤔 • tap-twilio • tap-slack • tap-salesforce • tap-google-analytics • ...