Text Ranking
sentence-transformers
Safetensors
Transformers
multilingual
t5gemma2
text2text-generation
reranker
encoder-decoder
FBNL
Retrieval
RAG
Instructions to use KaLM-Embedding/KaLM-Reranker-V1-Nano with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use KaLM-Embedding/KaLM-Reranker-V1-Nano with sentence-transformers:
from sentence_transformers import CrossEncoder model = CrossEncoder("KaLM-Embedding/KaLM-Reranker-V1-Nano") query = "Which planet is known as the Red Planet?" passages = [ "Venus is often called Earth's twin because of its similar size and proximity.", "Mars, known for its reddish appearance, is often referred to as the Red Planet.", "Jupiter, the largest planet in our solar system, has a prominent red spot.", "Saturn, famous for its rings, is sometimes mistaken for the Red Planet." ] scores = model.predict([(query, passage) for passage in passages]) print(scores) - Transformers
How to use KaLM-Embedding/KaLM-Reranker-V1-Nano with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("KaLM-Embedding/KaLM-Reranker-V1-Nano") model = AutoModelForMultimodalLM.from_pretrained("KaLM-Embedding/KaLM-Reranker-V1-Nano", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Add sentence-transformers CrossEncoder support
Verified signature# KaLM-Reranker-V1-Nano CrossEncoder validation Validation date: 2026-07-29. ## Immutable checkpoint baseline - `config.json`: `75926d34f90b64a3119e62535211bcd2305e8ea0ae4339773cb20dc84c8991d4` - `model.safetensors`: `98078ef7b21ec1ee82afa1b5cbdb3923d9548d5f3bed78d290b605c65cc3f49d` - `tokenizer.json`: `f5b325224482ec441ec5fbe2a5ac08c3758e0f9605f6e54368e31f736fcfb01d` ## Pre-adaptation CPU FP32 baseline Reference implementation, batch size 2, query length 512, document length 1024, encoder chunk size 4: ```text [0.9998076558113098, 0.000004796196662937291, 0.2090071737766266, 0.021608587354421616, 0.00004020768392365426] ``` ## Validation matrix | Target | Device/dtype | Status | Max absolute error | Notes | |---|---|---:|---:|---| | sentence-transformers 5.6.0, chunk size 4 | CPU FP32 | passed | `1.4901161193847656e-08` | `rtol=1e-5`, `atol=1e-6`; ranking `[0, 1]` | | local 5.7.0.dev0/main, chunk size 4 | CPU FP32 | passed | `1.4901161193847656e-08` | Imported from the loc…d43b4ac
-
Update kalm_reranker.py
Verified signature2bb6817 -
fix(reranker): avoid re-computing the first batch in predict()'s batch-size probe to reduce additional computational effort (#1)
- fix(reranker): avoid re-computing the first batch in predict()'s batch-size probe to reduce additional computational effort (209b7edfc558dbc00bb874749507167de9256b6d)5c2153d
-
Update vllm_support/README.md
Verified signature1d3dcd7 -
Update README.md
Verified signature343e2f6 -
Update vllm_support/src/kalm_t5gemma2_vllm_plugin/client.py
Verified signature02796d7 -
Update README.md
Verified signature4d3f673 -
update vllm support
Verified signatured541cf1
-
Update README.md
Verified signature58fad92
-
Update README.md
Verified signature229f6d5 -
Update README.md
Verified signature064dbc3 -
Update README.md
Verified signature5bb54d5 -
Update README.md
Verified signature25205cd -
Update README.md
Verified signature50f29e5 -
Update kalm_reranker.py
Verified signature4388e79
-
Update README.md
Verified signature4aadb1c -
add usage
Verified signature6c4c2be -
add modeling file
Verified signaturea42efa6 -
Update README.md
Verified signature20dbf1a -
Update README.md
Verified signature7504a1c -
Update README.md
Verified signature40035ff -
Update README.md
Verified signature17c3e45 -
Update README.md
Verified signature1218304 -
Update README.md
Verified signatureaa0f37a -
Update README.md
Verified signature54bd299 -
Update README.md
Verified signaturedfef4b6 -
Update README.md
Verified signature9c25e0c -
Update README.md
Verified signature4bc7a4f -
Upload lmeb_emb.jpg
Verified signaturedda0ad7 -
Update README.md
Verified signature93a711e -
Update README.md
Verified signaturec4c2e2b -
Upload 3 files
Verified signature16d7990 -
Update README.md
Verified signature8b36257 -
Upload template.jpg
Verified signaturebf3621a -
Update README.md
Verified signaturec34f103 -
Update README.md
Verified signature74efa17 -
Update README.md
Verified signature58959bf -
Update README.md
Verified signatureb5f9adb -
Update README.md
Verified signature60b3706 -
Upload assets/framework.jpg
Verified signature4f8e7fb -
Update README.md
Verified signature8a54110 -
Update README.md
Verified signaturecc12362 -
Create README.md
Verified signaturef861e39
-
Upload model.safetensors
Verified signaturece7bdab -
Upload 4 files
Verified signatureefc40be
-
initial commit
Verified signaturef4298c3