Instructions to use resolvo-cloud/Ornith-1.5-9B-DFlash2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use resolvo-cloud/Ornith-1.5-9B-DFlash2 with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download resolvo-cloud/Ornith-1.5-9B-DFlash2 --local-dir Ornith-1.5-9B-DFlash2
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Ornith-1.5-9B-DFlash2
DFlash2 draft for ornith-ai/Ornith-1.5-9B-MLX-4bit, produced by the
no-op-graft + selector-training recipe:
- Trunk:
ornith-ai/Ornith-1.5-9B-DFlash(DFlashV1) weights, copied verbatim. - Convolutions:
attention_conv/mlp_convgrafted as identity (unit self-tap, zero dynamic corrections) โ the runtime gets identity convs for free. - Candidate selector:
hidden_projection+ predecessor/successor codebooks trained on features captured from the quantized 4-bit target (832 samples, top-16 hard-negative margin, convs frozen).
The selector is the trained component โ trained on the deployed quant's hidden states, not the bf16 target's, which is why it transfers.
Measured (M5 Pro, opencode_sim n=4)
| Draft | serial | packed B4 | speedup |
|---|---|---|---|
| Ornith-1.5-9B-DFlash (V1) | ~132 tok/s | ~161 tok/s | ~1.8x |
| this checkpoint | 161.7 tok/s | 768.7 tok/s | 4.43x |
Diverse-traffic pipeline (file-read prompts, 4 concurrent lanes): ~212 tok/s vs V1's ~161 โ smaller but real on non-repetitive content.
Serving notes
architectures: ["DFlash2DraftModel"], hidden 4096, dynamic 1024, conv_group_size 16, block_size 8, selector top_k 16.- Requires the RichEngine
Hidden4096draft context core (draft_conv_h4096).
- Downloads last month
- -
Model size
1B params
Tensor type
BF16
ยท
Hardware compatibility
Log In to add your hardware
Quantized
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support