Instructions to use Horkios/Qwen3-Reranker-8B-mlx-4Bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Horkios/Qwen3-Reranker-8B-mlx-4Bit with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Horkios/Qwen3-Reranker-8B-mlx-4Bit") model = AutoModelForCausalLM.from_pretrained("Horkios/Qwen3-Reranker-8B-mlx-4Bit", device_map="auto") - MLX
How to use Horkios/Qwen3-Reranker-8B-mlx-4Bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download Horkios/Qwen3-Reranker-8B-mlx-4Bit --local-dir Qwen3-Reranker-8B-mlx-4Bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Commit History
-
Upload README.md with huggingface_hub
Verified signaturec410d77 -
Upload generation_config.json with huggingface_hub
Verified signature5eb4254 -
Upload tokenizer.json with huggingface_hub
Verified signature7377c0f -
Upload merges.txt with huggingface_hub
Verified signature4cf9345 -
Upload vocab.json with huggingface_hub
Verified signaturecc84bcd -
Upload added_tokens.json with huggingface_hub
Verified signature6bf37a7 -
Upload special_tokens_map.json with huggingface_hub
Verified signaturec855ebc -
Upload tokenizer_config.json with huggingface_hub
Verified signature63cad93 -
Upload chat_template.jinja with huggingface_hub
Verified signature6f37de6 -
Upload config.json with huggingface_hub
Verified signature51cb26f -
Upload model.safetensors.index.json with huggingface_hub
Verified signatureab81eb4 -
Upload model.safetensors with huggingface_hub
Verified signature9e138d9 -
initial commit
Verified signatureea41443