Instructions to use goodmai/Qwen3-Reranker-0.6B-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use goodmai/Qwen3-Reranker-0.6B-4bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download goodmai/Qwen3-Reranker-0.6B-4bit --local-dir Qwen3-Reranker-0.6B-4bit
- sentence-transformers
How to use goodmai/Qwen3-Reranker-0.6B-4bit with sentence-transformers:
from sentence_transformers import CrossEncoder model = CrossEncoder("goodmai/Qwen3-Reranker-0.6B-4bit") query = "Which planet is known as the Red Planet?" passages = [ "Venus is often called Earth's twin because of its similar size and proximity.", "Mars, known for its reddish appearance, is often referred to as the Red Planet.", "Jupiter, the largest planet in our solar system, has a prominent red spot.", "Saturn, famous for its rings, is sometimes mistaken for the Red Planet." ] scores = model.predict([(query, passage) for passage in passages]) print(scores) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Commit History
Yesterday
-
docs: add bas-alt.vercel.app link to README
Verified signature0f72734 -
Fix Run with Basalt static launcher URL and update version to v0.11.0
Verified signatureadf47fe
3 days ago
-
Add 'Run with Basalt / Запустить через Basalt' one-click buttons & CLI snippet
Verified signatureaa34591 -
Mirror mlx-community/Qwen3-Reranker-0.6B-4bit for Basalt inference stack
Verified signatured831722 -
initial commit
Verified signature9cd2155