Instructions to use nvidia/llama-nemoretriever-colembed-3b-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use nvidia/llama-nemoretriever-colembed-3b-v1 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("nvidia/llama-nemoretriever-colembed-3b-v1", trust_remote_code=True, dtype="auto") - ColPali
How to use nvidia/llama-nemoretriever-colembed-3b-v1 with ColPali:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Update configuration_eagle_chat.py
Thank you for the model!
There's an issue with the to_dict method in this file where it's not properly loading the vision_config.
This needs to be fixed.
error messages:
File "/home/wjk/yongwoo/mteb-fork/mteb/.venv/lib/python3.10/site-packages/transformers/configuration_utils.py", line 871, in to_diff_dict
class_config_dict = self.class().to_dict() if not self.has_no_defaults_at_init else {}
File "/home/wjk/.cache/huggingface/modules/transformers_modules/nvidia/llama-nemoretriever-colembed-1b-v1/1f0fdea7f5b19532a750be109b19072d719b8177/configuration_eagle_chat.py", line 86, in to_dict
output['vision_config'] = self.vision_config.to_dict()
File "/home/wjk/yongwoo/mteb-fork/mteb/.venv/lib/python3.10/site-packages/transformers/configuration_utils.py", line 211, in getattribute
return super().getattribute(key)
AttributeError: 'llama_NemoRetrieverColEmbedConfig' object has no attribute 'vision_config'