Zero-Shot Classification
Transformers
Safetensors
qwen3_5
feature-extraction
decision-model
classification
system-one
multimodal
vision
video
quantized
compressed-tensors
fp8
custom_code
Eval Results
Instructions to use vllm-sr/d3-FP8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use vllm-sr/d3-FP8 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("zero-shot-classification", model="vllm-sr/d3-FP8", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModel processor = AutoProcessor.from_pretrained("vllm-sr/d3-FP8", trust_remote_code=True) model = AutoModel.from_pretrained("vllm-sr/d3-FP8", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
29 days ago
-
Revert the merge of discussion #1
Verified signatureRestores README.md, d3q/load.py and MODEL_MANIFEST.json as of b5aebab7f4; the discussion was merged by mistake.8acfecc -
Card: first-start note, same-machine vision baseline, Typed Decisions note; drop unmeasured throughput line (#1)
- Card: first-start note, same-machine vision baseline, Typed Decisions note; drop unmeasured throughput line (98b3e44d8ab4ab05f37430cc1672769b16b44f6d) - Package: drop internal names and stale files; MODEL_MANIFEST.json entries for the changed files (466bad92b791ae516e51481dabc6116849e2e027) Co-authored-by: Hsiung Li Syun <TheoHsiung@users.noreply.huggingface.co>9497574
30 days ago
-
Card: link the merged record on vllm-project/semantic-router main
Verified signature9a83ee5
-
Label the d3 column of the test split table as BF16
Verified signature2fb271a -
Add the Perception Test validation results
Verified signature6f4a524
-
Measure serving latency and memory on MI300X and RTX PRO 6000 as the GPTQ card does
Verified signature781a56f -
Index FP8 activation rows in 64 bits and add Decision Index results
Verified signature5887468
-
Card: serve with vllm-sr serve -e
Verified signature54be3ed -
Card: the revision to serve
Verified signatureab1abc8 -
Upload d3-FP8
Verified signature94c520d