Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

goodmai
/
Qwen3-Reranker-0.6B-4bit

Text Ranking
MLX
Safetensors
sentence-transformers
qwen3
reranker
4-bit precision
Model card Files Files and versions
xet
Community

Instructions to use goodmai/Qwen3-Reranker-0.6B-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • MLX

    How to use goodmai/Qwen3-Reranker-0.6B-4bit with MLX:

    # Download the model from the Hub
    pip install huggingface_hub[hf_xet]
    
    hf download goodmai/Qwen3-Reranker-0.6B-4bit --local-dir Qwen3-Reranker-0.6B-4bit
  • sentence-transformers

    How to use goodmai/Qwen3-Reranker-0.6B-4bit with sentence-transformers:

    from sentence_transformers import CrossEncoder
    
    model = CrossEncoder("goodmai/Qwen3-Reranker-0.6B-4bit")
    
    query = "Which planet is known as the Red Planet?"
    passages = [
    	"Venus is often called Earth's twin because of its similar size and proximity.",
    	"Mars, known for its reddish appearance, is often referred to as the Red Planet.",
    	"Jupiter, the largest planet in our solar system, has a prominent red spot.",
    	"Saturn, famous for its rings, is sometimes mistaken for the Red Planet."
    ]
    
    scores = model.predict([(query, passage) for passage in passages])
    print(scores)
  • Notebooks
  • Google Colab
  • Kaggle
  • Local Apps Settings
  • LM Studio
  • Atomic Chat
Qwen3-Reranker-0.6B-4bit
347 MB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 5 commits
goodmai's picture
goodmai
docs: add bas-alt.vercel.app link to README
0f72734 verified about 13 hours ago
  • .gitattributes
    1.57 kB
    Mirror mlx-community/Qwen3-Reranker-0.6B-4bit for Basalt inference stack 3 days ago
  • README.md
    3.49 kB
    docs: add bas-alt.vercel.app link to README about 13 hours ago
  • chat_template.jinja
    741 Bytes
    Mirror mlx-community/Qwen3-Reranker-0.6B-4bit for Basalt inference stack 3 days ago
  • config.json
    1.02 kB
    Mirror mlx-community/Qwen3-Reranker-0.6B-4bit for Basalt inference stack 3 days ago
  • generation_config.json
    214 Bytes
    Mirror mlx-community/Qwen3-Reranker-0.6B-4bit for Basalt inference stack 3 days ago
  • model.safetensors
    335 MB
    xet
    Mirror mlx-community/Qwen3-Reranker-0.6B-4bit for Basalt inference stack 3 days ago
  • model.safetensors.index.json
    49.8 kB
    Mirror mlx-community/Qwen3-Reranker-0.6B-4bit for Basalt inference stack 3 days ago
  • tokenizer.json
    11.4 MB
    xet
    Mirror mlx-community/Qwen3-Reranker-0.6B-4bit for Basalt inference stack 3 days ago
  • tokenizer_config.json
    377 Bytes
    Mirror mlx-community/Qwen3-Reranker-0.6B-4bit for Basalt inference stack 3 days ago