I failed to load exchangeratehost data to Vertica....
# contributingj
jan_soubusta
05/16/2023, 1:18 PMI failed to load exchangeratehost data to Vertica.
Here is a fix:
https://github.com/full360/pipelinewise-target-vertica/pull/44
Any chance it could be merged before Wednesday 24th?
I am going to speak on Vertica conference and would like to mention there this contribution 😉
p
pat_nadolny
05/16/2023, 2:31 PM@jan_soubusta I had target-vertica on my list of targets to add to the hub but it throws an error while installing. Maybe this PR fixes it! I left a comment on your PR to ping the main contributor on the repo. We dont have control to get that merged but we can help encourage the maintainer to merge it. Otherwise, like I suggested in the comment, we can transfer it to MeltanoLabs or fork it if the maintainer never responds and register our version on the hub. Lots of options
j
jan_soubusta
05/16/2023, 2:33 PMCool, thanks!
If it is not merged, I just show the pull request on the conference, no rush 😉
r
rohit_amarnath
05/16/2023, 3:33 PMI sent you both messages, let me know how I can help
rohit_amarnath
05/16/2023, 3:35 PMactually, I merged the change, so you should be good to go
p
pat_nadolny
05/16/2023, 4:09 PMj
jan_soubusta
05/16/2023, 4:23 PMI will do a screenshot of this communication and put it to the presentation.
How quickly are things happening here 😉
jan_soubusta
05/16/2023, 4:56 PMBtw dbt does not work with Vertica, in particular, Snowflake-labs/db_containers.
Will try to send them a PR, we'll see what will be their responsiveness 😉
r
rohit_amarnath
05/16/2023, 5:09 PMThere is an official DBT plugin for Vertica
rohit_amarnath
05/16/2023, 5:10 PMrohit_amarnath
05/16/2023, 5:10 PMSo, I dont think you need to use the snowflake one
p
pat_nadolny
05/16/2023, 6:07 PMI also opened a hub issue for getting dbt-vertica added as a meltano utility plugin. I'm not familiar with Vertica and dont have credentials to test so I don't think I'll be able to help get that added but I'm happy to review PRs if anyone else was motivated to add it 😄
j
jan_soubusta
05/16/2023, 7:07 PMdbt-vertica itself works well.
What does not work is Snowflake-labs/dbt_constraints running on top of it.
I have dbt models executed against PostgreSQL, Snowflake and Vertica.
schema.yml files contain definitions of primary keys / references using the Snowflake plugin.
It works for Snowflake and PostgreSQL, but it does not work for Vertica because completely missing support.
I implemented the support (deriving it from PostgreSQL version), but it fails on error, more details here:
https://github.com/dbt-labs/dbt-core/issues/4560
jan_soubusta
05/16/2023, 7:08 PMIt is important to say that I do NOT want to create a special version of dbt models for Vertica.
They should work (with necessary macros) for all databases.
r
rohit_amarnath
05/16/2023, 7:21 PMJawahar at Vertica is in touch with the dbt folks, and might be able to have it addressed with them
p
pat_nadolny
05/16/2023, 7:30 PMThe target is up on the hub! https://hub.meltano.com/loaders/target-vertica
j
jan_soubusta
05/18/2023, 3:09 PMjan_soubusta
05/18/2023, 3:10 PMdbt fully works for me with Vertica now.
Besides the macros ^^^, I had to tune incremental_strategy, implement custom macros for TO_JSON and current_timestamp.
r
rohit_amarnath
05/18/2023, 3:11 PMnice
13 Views