Feature Extraction
sentence-transformers
Safetensors
Transformers
English
mistral
mteb
Eval Results (legacy)
text-embeddings-inference
Instructions to use Linq-AI-Research/Linq-Embed-Mistral with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use Linq-AI-Research/Linq-Embed-Mistral with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("Linq-AI-Research/Linq-Embed-Mistral") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Transformers
How to use Linq-AI-Research/Linq-Embed-Mistral with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="Linq-AI-Research/Linq-Embed-Mistral")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("Linq-AI-Research/Linq-Embed-Mistral") model = AutoModel.from_pretrained("Linq-AI-Research/Linq-Embed-Mistral", device_map="auto") - Notebooks
- Google Colab
- Kaggle
MOD: scores and links for referenced models
Browse files
README.md
CHANGED
|
@@ -9,9 +9,9 @@ license: cc-by-nc-4.0
|
|
| 9 |
|
| 10 |
**Linq-Embed-Mistral**
|
| 11 |
|
| 12 |
-
Linq-Embed-Mistral has been developed by building upon the foundations of the E5-mistral-7b-instruct and Mistral-7B-v0.1 models. We focus on improving text retrieval using advanced data refinement methods, including sophisticated data crafting, data filtering, and negative mining techniques. These methods are applied to both existing benchmark datasets and highly tailored synthetic datasets generated via LLMs. To enhance the quality of the synthetic data, we employ extensive prompt engineering and guidance from teacher models, ensuring these methods are specifically tailored to each task. Our efforts primarily aim to create high-quality triplet datasets (query, positive example, negative example), significantly improving text retrieval performance.
|
| 13 |
|
| 14 |
-
Linq-Embed-Mistral
|
| 15 |
|
| 16 |
This project is for research purposes only. Third-party datasets may be subject to additional terms and conditions under their associated licenses. Please refer to specific papers for more details:
|
| 17 |
|
|
|
|
| 9 |
|
| 10 |
**Linq-Embed-Mistral**
|
| 11 |
|
| 12 |
+
Linq-Embed-Mistral has been developed by building upon the foundations of the [E5-mistral-7b-instruct](https://huggingface.co/intfloat/e5-mistral-7b-instruct) and [Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) models. We focus on improving text retrieval using advanced data refinement methods, including sophisticated data crafting, data filtering, and negative mining techniques. These methods are applied to both existing benchmark datasets and highly tailored synthetic datasets generated via LLMs. To enhance the quality of the synthetic data, we employ extensive prompt engineering and guidance from teacher models, ensuring these methods are specifically tailored to each task. Our efforts primarily aim to create high-quality triplet datasets (query, positive example, negative example), significantly improving text retrieval performance.
|
| 13 |
|
| 14 |
+
Linq-Embed-Mistral excels in retrieval tasks, ranking `1st` among all models listed on the MTEB leaderboard with a performance score of `xxx`. The model performs well in the MTEB benchmarks, achieving an average score of `yyy` across 56 datasets. This performance ranks it 2nd among publicly accessible models on the MTEB leaderboard and 3rd overall among all evaluated models.
|
| 15 |
|
| 16 |
This project is for research purposes only. Third-party datasets may be subject to additional terms and conditions under their associated licenses. Please refer to specific papers for more details:
|
| 17 |
|