Text Generation
Transformers
PyTorch
qwen3_5
image-text-to-text
bf16
clef
full-precision
vllm
xinference
Instructions to use rty813/clef-bf16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use rty813/clef-bf16 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="rty813/clef-bf16")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("rty813/clef-bf16") model = AutoModelForMultimodalLM.from_pretrained("rty813/clef-bf16", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use rty813/clef-bf16 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "rty813/clef-bf16" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "rty813/clef-bf16", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/rty813/clef-bf16
- SGLang
How to use rty813/clef-bf16 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "rty813/clef-bf16" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "rty813/clef-bf16", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "rty813/clef-bf16" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "rty813/clef-bf16", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use rty813/clef-bf16 with Docker Model Runner:
docker model run hf.co/rty813/clef-bf16
|
Download README.md from rty813/clef-bf16: direct link, hf CLI and curl.
- Browser
- Download file 2.19 kB
-
https://huggingface.co/rty813/clef-bf16/resolve/main/README.md
- Command line
-
hf download hf://rty813/clef-bf16/README.md
-
curl -L -o README.md https://huggingface.co/rty813/clef-bf16/resolve/main/README.md
2.19 kB
| license: apache-2.0 | |
| base_model: Cloudflare/clef | |
| pipeline_tag: text-generation | |
| library_name: transformers | |
| tags: | |
| - bf16 | |
| - clef | |
| - full-precision | |
| - transformers | |
| - vllm | |
| - xinference | |
| # clef-bf16 (bf16) | |
| Full-precision (bf16) PyTorch port of [Cloudflare/clef](https://huggingface.co/Cloudflare/clef), | |
| for vLLM / TGI / Xinference / transformers users who don't want the GGUF quant. | |
| - Format: `pytorch_model.bin` (bf16). safetensors conversion in progress. | |
| - Architecture: identical to the original — drop-in for `AutoModelForCausalLM.from_pretrained("rty813/clef-bf16")`. | |
| - Also loads in vLLM (`vllm serve rty813/clef-bf16`) and Xinference (search "clef"). | |
| Original model card: | |
| --- | |
| license: apache-2.0 | |
| library_name: transformers | |
| pipeline_tag: image-text-to-text | |
| base_model: Qwen/Qwen3.8-27B | |
| base_model_relation: finetune | |
| tags: | |
| - clef | |
| - cloudflare | |
| - systemone | |
| - decision-model | |
| - qwen3.8 | |
| - post-train | |
| - image-text-to-typed-output | |
| - multimodal | |
| - structured-output | |
| - classification | |
| - custom-code | |
| --- | |
| # Clef | |
| - **Announcement:** [Clef decision models on the Cloudflare blog](https://blog.cloudflare.com/clef-decision-models) | |
| - **Decision Index leaderboard:** [clef-evals.workers-ai-mle.workers.dev](https://clef-evals.workers-ai-mle.workers.dev) | |
| Clef is a 27B multimodal model that turns a state and a schema of typed | |
| questions into decisions. It reads the state as text, JSON, images, or video, and returns a | |
| probability for every allowed option of every question in a single forward pass. There is no | |
| free-form text generation and no output parsing. | |
| The Clef API is fully compatible with Jev and SystemOne. | |
| Clef is post-trained from [Qwen/Qwen3.8-27B](https://huggingface.co/Qwen/Qwen3.8-27B). See | |
| [Clef-Flash](https://huggingface.co/Cloudflare/clef-flash) for the | |
| smaller, faster variant. | |
| ## Model | |
| - **Backbone:** Qwen/Qwen3.8-27B with its vision encoder, stored as standard sharded safetensors. | |
| - **Joint schema head:** a small transformer head that reads the backbone's final hidden states, | |
| routes evidence from the state to each question, and scores all options of all questions jointly. | |
| - **Output:** one logit per allowed option for each question. Apply a softmax per | |