Hi, can someone help me with the installation of target-chromadb. I'm getting this error while adding the loader . Am i missing something here ? Appreciate any help .

Hi @anand_sukumaran! Did you get an additional message indicating the location of the installation log file?

@edgar_ramirez_mondragon Yes, this is the message I got from pip log. Is this what you were asking for?

2023-11-28T23:45:21,150 Successfully built meltanolabs-target-chromadb
2023-11-28T23:45:21,151 Failed to build hnswlib
2023-11-28T23:45:21,152 ERROR: Could not build wheels for hnswlib, which is required to install pyproject.toml-based projects
2023-11-28T23:45:21,154 Exception information:
2023-11-28T23:45:21,154 Traceback (most recent call last):
2023-11-28T23:45:21,154   File "D:\Materials\esgchat_autogen\meltano-elt\chroma\.meltano\loaders\target-chromadb\venv\lib\site-packages\pip\_internal\cli\base_command.py", line 180, in exc_logging_wrapper
2023-11-28T23:45:21,154     status = run_func(*args)
2023-11-28T23:45:21,154   File "D:\Materials\esgchat_autogen\meltano-elt\chroma\.meltano\loaders\target-chromadb\venv\lib\site-packages\pip\_internal\cli\req_command.py", line 245, in wrapper
2023-11-28T23:45:21,154     return func(self, options, args)
2023-11-28T23:45:21,154   File "D:\Materials\esgchat_autogen\meltano-elt\chroma\.meltano\loaders\target-chromadb\venv\lib\site-packages\pip\_internal\commands\install.py", line 429, in run
2023-11-28T23:45:21,154     raise InstallationError(
2023-11-28T23:45:21,154 pip._internal.exceptions.InstallationError: Could not build wheels for hnswlib, which is required to install pyproject.toml-based projects
2023-11-28T23:45:21,174 Remote version of pip: 23.3.1
2023-11-28T23:45:21,175 Local version of pip:  23.3.1

Yeah, that's it! The target seems to depend on the ANN library https://github.com/nmslib/hnswlib, but it doesn't seem to use it in any way and ChromaDB itself seems to depend on its own fork that does have wheels published to PyPI. So if you wanna try 1. forking MeltanoLabs/target-chromadb 2. removing the dependency on

hnswlib

3. pointing the loader's

pip_url

to your fork that might work.

Thank you so much. Appreciate your effort. 🙂

embeddings_property

should be the name of the field in the record that's passed to the ChromaDB's

embeddings

parameter: https://github.com/MeltanoLabs/target-chromadb/blob/712daa1161055faf2f2bfa4c451655200045866c/target_chromadb/sinks.py#L79-L84