Sentence Similarity
sentence-transformers
PyTorch
Transformers
English
roberta
feature-extraction
text-embeddings-inference
Instructions to use AlgorithmicResearchGroup/arxiv-distilroberta-base-GenQ with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use AlgorithmicResearchGroup/arxiv-distilroberta-base-GenQ with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("AlgorithmicResearchGroup/arxiv-distilroberta-base-GenQ") sentences = [ "That is a happy person", "That is a happy dog", "That is a very happy person", "Today is a sunny day" ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [4, 4] - Transformers
How to use AlgorithmicResearchGroup/arxiv-distilroberta-base-GenQ with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("AlgorithmicResearchGroup/arxiv-distilroberta-base-GenQ") model = AutoModel.from_pretrained("AlgorithmicResearchGroup/arxiv-distilroberta-base-GenQ", device_map="auto") - Notebooks
- Google Colab
- Kaggle
ArtifactAI commited on
Commit ·
2a1c3e7
1
Parent(s): 2649083
Update README.md
Browse files
README.md
CHANGED
|
@@ -8,9 +8,11 @@ tags:
|
|
| 8 |
|
| 9 |
---
|
| 10 |
|
| 11 |
-
#
|
| 12 |
|
| 13 |
-
|
|
|
|
|
|
|
| 14 |
|
| 15 |
<!--- Describe your model here -->
|
| 16 |
|
|
|
|
| 8 |
|
| 9 |
---
|
| 10 |
|
| 11 |
+
# Arxiv-distilroberta-base-GenQ
|
| 12 |
|
| 13 |
+
|
| 14 |
+
Arxiv-distilroberta-base-GenQ is trained on a large corpus of ArXiv abstracts. It is designed to encode and transform sentences from academic papers, allowing for effective semantic similarity and information retrieval tasks.
|
| 15 |
+
It maps sentences & paragraphs to a 768 dimensional dense vector space.
|
| 16 |
|
| 17 |
<!--- Describe your model here -->
|
| 18 |
|