Feature Extraction
sentence-transformers
Safetensors
Transformers
xlm-roberta
sentence-similarity
granite
embeddings
multilingual
text-embeddings-inference
Instructions to use RikoteMaster/MNLP_M3_document_encoder with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use RikoteMaster/MNLP_M3_document_encoder with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("RikoteMaster/MNLP_M3_document_encoder") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Transformers
How to use RikoteMaster/MNLP_M3_document_encoder with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="RikoteMaster/MNLP_M3_document_encoder")# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("RikoteMaster/MNLP_M3_document_encoder") model = AutoModel.from_pretrained("RikoteMaster/MNLP_M3_document_encoder", device_map="auto") - Notebooks
- Google Colab
- Kaggle
| license: apache-2.0 | |
| base_model: ibm-granite/granite-embedding-107m-multilingual | |
| tags: | |
| - sentence-transformers | |
| - feature-extraction | |
| - sentence-similarity | |
| - transformers | |
| - granite | |
| - embeddings | |
| - multilingual | |
| library_name: sentence-transformers | |
| pipeline_tag: feature-extraction | |
| # Granite Embedding 107M Multilingual | |
| This is a copy of the [ibm-granite/granite-embedding-107m-multilingual](https://huggingface.co/ibm-granite/granite-embedding-107m-multilingual) model for document encoding purposes. | |
| ## Model Summary | |
| Granite-Embedding-107M-Multilingual is a 107M parameter dense biencoder embedding model from the Granite Embeddings suite that can be used to generate high quality text embeddings. This model produces embedding vectors of size 384. | |
| ## Supported Languages | |
| English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese. | |
| ## Usage | |
| ### With Sentence Transformers | |
| ```python | |
| from sentence_transformers import SentenceTransformer | |
| model = SentenceTransformer('RikoteMaster/MNLP_M3_document_encoder') | |
| embeddings = model.encode(['Your text here']) | |
| ``` | |
| ### With Transformers | |
| ```python | |
| from transformers import AutoModel, AutoTokenizer | |
| import torch | |
| model = AutoModel.from_pretrained('RikoteMaster/MNLP_M3_document_encoder') | |
| tokenizer = AutoTokenizer.from_pretrained('RikoteMaster/MNLP_M3_document_encoder') | |
| inputs = tokenizer(['Your text here'], return_tensors='pt', padding=True, truncation=True) | |
| with torch.no_grad(): | |
| outputs = model(**inputs) | |
| embeddings = outputs.last_hidden_state[:, 0] # CLS pooling | |
| embeddings = torch.nn.functional.normalize(embeddings, dim=1) | |
| ``` | |
| ## Original Model | |
| This model is based on [ibm-granite/granite-embedding-107m-multilingual](https://huggingface.co/ibm-granite/granite-embedding-107m-multilingual) by IBM. | |