Sentence Similarity
sentence-transformers
Safetensors
English
modernbert
colbert
late-interaction
retrieval
pylate
multi-vector
text-embeddings-inference
Instructions to use chungimungi/GLInt with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use chungimungi/GLInt with sentence-transformers:
from sentence_transformers import MultiVectorEncoder model = MultiVectorEncoder("chungimungi/GLInt") queries = ["Which planet is known as the Red Planet?"] documents = [ "Venus is often called Earth's twin because of its similar size and proximity.", "Mars, known for its reddish appearance, is often referred to as the Red Planet.", "Jupiter, the largest planet in our solar system, has a prominent red spot.", ] query_embeddings = model.encode_query(queries) document_embeddings = model.encode_document(documents) similarities = model.similarity(query_embeddings, document_embeddings) print(similarities) - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -20,12 +20,26 @@ GLINT-base is a 149M-parameter English late-interaction retriever built from
|
|
| 20 |
128-dimensional token embeddings and uses MaxSim retrieval with 32 query tokens and 300
|
| 21 |
document tokens.
|
| 22 |
|
| 23 |
-
|
| 24 |
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
|
| 30 |
## Usage
|
| 31 |
|
|
@@ -63,4 +77,4 @@ computed by summing, over query tokens, the maximum similarity to a document tok
|
|
| 63 |
The corresponding private training artifacts are in
|
| 64 |
[GLINT-data](https://huggingface.co/datasets/chungimungi/GLINT-data). It contains the complete
|
| 65 |
prepared SFT data, the 1,046,009-row seven-source KD mixture, and Jina teacher-score parquet
|
| 66 |
-
shards. The repository contains no BEIR evaluation corpus or evaluation labels.
|
|
|
|
| 20 |
128-dimensional token embeddings and uses MaxSim retrieval with 32 query tokens and 300
|
| 21 |
document tokens.
|
| 22 |
|
| 23 |
+
## What is new in GLINT?
|
| 24 |
|
| 25 |
+
GLINT is designed around the mismatch between ordinary dense hard-negative mining and a
|
| 26 |
+
late-interaction retriever. Dense mining selects documents that are difficult under one pooled
|
| 27 |
+
vector; GLINT instead mines negatives under the same token-level MaxSim geometry used at
|
| 28 |
+
retrieval time. This exposes lexical, compositional, and localized token matches that a
|
| 29 |
+
single-vector miner can miss.
|
| 30 |
+
|
| 31 |
+
The training recipe has two stages:
|
| 32 |
+
|
| 33 |
+
1. supervised fine-tuning with multi-vector (MaxSim) hard negatives;
|
| 34 |
+
2. mixed listwise knowledge distillation over a diverse seven-source hard-negative mixture.
|
| 35 |
+
|
| 36 |
+
For the second stage, a frozen listwise teacher (`jinaai/jina-reranker-v3.5`) scores each
|
| 37 |
+
32-document candidate set jointly. GLINT distils that ordering with a sharpened listwise KL
|
| 38 |
+
objective, while a false-negative-masked InfoNCE term preserves a direct retrieval signal.
|
| 39 |
+
The result is still one compact, first-stage late-interaction retriever: it is neither an
|
| 40 |
+
ensemble nor a re-ranker at inference time.
|
| 41 |
+
|
| 42 |
+
This is a private research release.
|
| 43 |
|
| 44 |
## Usage
|
| 45 |
|
|
|
|
| 77 |
The corresponding private training artifacts are in
|
| 78 |
[GLINT-data](https://huggingface.co/datasets/chungimungi/GLINT-data). It contains the complete
|
| 79 |
prepared SFT data, the 1,046,009-row seven-source KD mixture, and Jina teacher-score parquet
|
| 80 |
+
shards. The repository contains no BEIR evaluation corpus or evaluation labels.
|