- Libraries
- Transformers
How to use unsloth/gte-modernbert-base with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("unsloth/gte-modernbert-base")
model = AutoModel.from_pretrained("unsloth/gte-modernbert-base", device_map="auto") - sentence-transformers
How to use unsloth/gte-modernbert-base with sentence-transformers:
from sentence_transformers import SentenceTransformer
model = SentenceTransformer("unsloth/gte-modernbert-base")
sentences = [
"That is a happy person",
"That is a happy dog",
"That is a very happy person",
"Today is a sunny day"
]
embeddings = model.encode(sentences)
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [4, 4] - Transformers.js
How to use unsloth/gte-modernbert-base with Transformers.js:
// npm i @huggingface/transformers
import { pipeline } from '@huggingface/transformers';
// Allocate pipeline
const pipe = await pipeline('feature-extraction', 'unsloth/gte-modernbert-base'); - Notebooks
- Google Colab
- Kaggle
