Feature Extraction
sentence-transformers
Safetensors
Transformers
xlm-roberta
sentence-similarity
granite
embeddings
multilingual
text-embeddings-inference
Instructions to use RikoteMaster/MNLP_M3_document_encoder with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use RikoteMaster/MNLP_M3_document_encoder with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("RikoteMaster/MNLP_M3_document_encoder") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Transformers
How to use RikoteMaster/MNLP_M3_document_encoder with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="RikoteMaster/MNLP_M3_document_encoder")# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("RikoteMaster/MNLP_M3_document_encoder") model = AutoModel.from_pretrained("RikoteMaster/MNLP_M3_document_encoder", device_map="auto") - Notebooks
- Google Colab
- Kaggle
File size: 1,818 Bytes
5259de9 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 | ---
license: apache-2.0
base_model: ibm-granite/granite-embedding-107m-multilingual
tags:
- sentence-transformers
- feature-extraction
- sentence-similarity
- transformers
- granite
- embeddings
- multilingual
library_name: sentence-transformers
pipeline_tag: feature-extraction
---
# Granite Embedding 107M Multilingual
This is a copy of the [ibm-granite/granite-embedding-107m-multilingual](https://huggingface.co/ibm-granite/granite-embedding-107m-multilingual) model for document encoding purposes.
## Model Summary
Granite-Embedding-107M-Multilingual is a 107M parameter dense biencoder embedding model from the Granite Embeddings suite that can be used to generate high quality text embeddings. This model produces embedding vectors of size 384.
## Supported Languages
English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese.
## Usage
### With Sentence Transformers
```python
from sentence_transformers import SentenceTransformer
model = SentenceTransformer('RikoteMaster/MNLP_M3_document_encoder')
embeddings = model.encode(['Your text here'])
```
### With Transformers
```python
from transformers import AutoModel, AutoTokenizer
import torch
model = AutoModel.from_pretrained('RikoteMaster/MNLP_M3_document_encoder')
tokenizer = AutoTokenizer.from_pretrained('RikoteMaster/MNLP_M3_document_encoder')
inputs = tokenizer(['Your text here'], return_tensors='pt', padding=True, truncation=True)
with torch.no_grad():
outputs = model(**inputs)
embeddings = outputs.last_hidden_state[:, 0] # CLS pooling
embeddings = torch.nn.functional.normalize(embeddings, dim=1)
```
## Original Model
This model is based on [ibm-granite/granite-embedding-107m-multilingual](https://huggingface.co/ibm-granite/granite-embedding-107m-multilingual) by IBM.
|