Feature Extraction
Transformers
Safetensors
sentence-transformers
English
nvembed
mteb
custom_code
Eval Results (legacy)
Instructions to use nvidia/NV-Embed-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use nvidia/NV-Embed-v2 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="nvidia/NV-Embed-v2", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("nvidia/NV-Embed-v2", trust_remote_code=True, device_map="auto") - sentence-transformers
How to use nvidia/NV-Embed-v2 with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("nvidia/NV-Embed-v2", trust_remote_code=True) sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Notebooks
- Google Colab
- Kaggle
Commit History
-
Update usage instructions with infinity / Sentence Transformers
Verified signature755e6af -
Update configuration_nvembed.py
Verified signatureFile "/app/.cache/huggingface/modules/transformers_modules/nvidia/NV-Embed-v2/7604d305b621f14095a1aa23d351674c2859553a/modeling_nvembed.py", line 323, in __init__ self.latent_attention_model = AutoModel.from_config(config.latent_attention_config) File "/app/.venv/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 440, in from_config return model_class._from_config(config, **kwargs) File "/app/.venv/lib/python3.10/site-packages/transformers/modeling_utils.py", line 1494, in _from_config if config._attn_implementation_internal is not None: File "/app/.venv/lib/python3.10/site-packages/transformers/configuration_utils.py", line 202, in __getattribute__ return super().__getattribute__(key) AttributeError: 'LatentAttentionConfig' object has no attribute '_attn_implementation_internal'792a641
-
Update README.md
Verified signature7604d30
-
Add the Sentence Transformers tag (#14)
Verified signature- Add the Sentence Transformers tag (5cb301c3619a13ea2c9a986c6cbbcf7ee712010e) Co-authored-by: Tom Aarsen <tomaarsen@users.noreply.huggingface.co>0783263
-
Update metadata: Add library_name to Transformers (#7)
Verified signature- Update metadata: Add library_name to Transformers (1da2cb865d4f367cd66cb725a0f58ca8031a91a3) Co-authored-by: Tiezhen WANG <xianbao@users.noreply.huggingface.co>26db444
-
Super-squash branch 'main' using huggingface_hub
Verified signatureCo-authored-by: tomaarsen <tomaarsen@users.noreply.huggingface.co>2c0dadb