| # Serving capabilities |
|
|
| <!-- Generated by crates/ds4-core/examples/serving_docs.rs. Do not edit. --> |
| |
| This table is generated from `ds4_core::serving_caps` and the resolved |
| plan's `controls`, which also supply `ds4-perf serving-controls`. |
| `qualified` describes the recorded artifact and workload scope, not every |
| quantization, context, concurrency, media input or feature combination. |
| `unverified` means implemented (`Support::Present`); `none` means unsupported. |
| Consult the [release ledger](releases/v0.1.3.md) and |
| [family contracts](ds4-dfm-model-families.md) for evidence and limits. |
| |
| ## Execution |
| |
| Cells show the available lane or mode and its qualification. An opt-in |
| capability still requires explicit selection and successful native fitting. |
| The request's effective and qualified plan remains authoritative. |
| |
| | Model | Banks | Prefix reuse | Disk KV | Snapshot | MTP kind / lane / support | |
| |---|---|---|---|---|---| |
| | DeepSeek V4 Flash | persistent / qualified | exact / qualified | qualified | qualified | DeepSeek / bank / qualified | |
| | DeepSeek V4 Pro | persistent / qualified | exact / qualified | qualified | qualified | DeepSeek / bank / qualified | |
| | DeepSeek V4.1 Flash | serial / none | exact / unverified | unverified | none | Embedded / serial / qualified | |
| | Solar Open2 250B | persistent / qualified | partial / qualified | qualified | qualified | None / none / none | |
| | Motif-3 | persistent / qualified | partial / qualified | qualified | qualified | None / none / none | |
| | K-EXAONE 236B A23B | persistent / qualified | partial / unverified | qualified | qualified | None / none / none | |
| | dots3-note-prev | opt_in / unverified | partial / unverified | unverified | qualified | Embedded / serial / unverified | |
| | Qwen3.8-Flash-Next | persistent / qualified | partial / qualified | qualified | qualified | Embedded / bank / qualified | |
| | GLM 5.3 Flash | persistent / unverified | partial / unverified | unverified | unverified | Embedded / serial + bank / unverified | |
| | K2-Horizon 375B A23B | persistent / qualified | exact / qualified | unverified | unverified | None / none / none | |
| | Inkling Small | serial / none | exact / qualified | unverified | unverified | Sidecar / serial / qualified | |
| | Step-3.7-Flash | opt_in / qualified | partial / qualified | qualified | qualified | Sidecar / serial + bank / qualified | |
| | Ling-3.0-flash-VL | persistent / qualified | partial / qualified | qualified | qualified | None / none / none | |
| | MiMo-V2.6-Flash-RL | opt_in / unverified | partial / unverified | unverified | unverified | Embedded / serial / qualified | |
| | Naive-N0.5-Flash | opt_in / qualified | partial / qualified | qualified | qualified | External / serial + bank / unverified | |
| | IQuest-Q1 | persistent / unverified | partial / unverified | unverified | unverified | Embedded / serial + bank / unverified | |
| | Ling-3.1-flash-VQ | persistent / unverified | partial / unverified | unverified | unverified | Embedded / serial + bank / unverified | |
| | Beam-1.0-501B-A23B-VQ | persistent / unverified | partial / unverified | unverified | unverified | Sidecar / serial / unverified | |
| |
| ## Bounds and allocator controls |
| |
| The runtime context cap is an admission bound, not a qualification claim. |
| `—` means the capability table declares no bound or recorded value; it does |
| not mean unlimited capacity. Qualified columns retain their workload scope. |
| |
| | Model | Runtime context cap | Qualified context | Qualified banks | Qualified prompt | Native prefill environment | |
| |---|---:|---:|---:|---:|---| |
| | DeepSeek V4 Flash | — | — | — | — | `DS4_METAL_PREFILL_CHUNK` | |
| | DeepSeek V4 Pro | — | — | — | — | `DS4_METAL_PREFILL_CHUNK` | |
| | DeepSeek V4.1 Flash | — | — | 1 | — | — | |
| | Solar Open2 250B | — | — | — | — | `DS4_METAL_PREFILL_CHUNK` | |
| | Motif-3 | 262144 | — | — | — | `DS4_MOTIF3_PREFILL_CHUNK` | |
| | K-EXAONE 236B A23B | — | — | — | — | `DS4_EXAONE_PREFILL_CHUNK` | |
| | dots3-note-prev | 524288 | — | 1 | — | `DS4_DOTS3_PREFILL_CHUNK` | |
| | Qwen3.8-Flash-Next | 1048576 | 262144 | 2 | — | `DS4_QWEN_PREFILL_CHUNK` | |
| | GLM 5.3 Flash | 1048576 | 2048 | 1 | — | `DS4_GLM53_PREFILL_ROWS` | |
| | K2-Horizon 375B A23B | — | 32768 | 1 | — | `DS4_EXAONE_PREFILL_CHUNK` | |
| | Inkling Small | 1048576 | 1024 | 1 | — | `DS4_INKLING_PREFILL_CHUNK` | |
| | Step-3.7-Flash | 262144 | 65536 | 2 | 6300 | `DS4_STEP37_PREFILL_CHUNK` | |
| | Ling-3.0-flash-VL | 262144 | 65536 | 2 | — | `DS4_LING3VL_PREFILL_CHUNK` | |
| | MiMo-V2.6-Flash-RL | 1048576 | 524288 | 1 | — | `DS4_MIMO2_PREFILL_CHUNK` | |
| | Naive-N0.5-Flash | 1048576 | 8192 | 2 | 702 | `DS4_NAIVE_PREFILL_CHUNK` | |
| | IQuest-Q1 | 524288 | — | — | — | `DS4_IQUEST_PREFILL_CHUNK` | |
| | Ling-3.1-flash-VQ | 262144 | — | — | — | `DS4_LING31_PREFILL_CHUNK` | |
| | Beam-1.0-501B-A23B-VQ | 1048576 | — | — | — | `DS4_BEAM_PREFILL_CHUNK` | |
|
|
| Scheduler chunk candidates: 256, 512, 1024, 2048, 4096, 8192. The resolved plan only offers |
| values at or below its known native capacity. Unknown capacity offers no |
| candidate. These are scheduler controls, not measurements or speed claims. |
|
|
| ## Qualification notes |
|
|
| - **DeepSeek V4.1 Flash:** recorded Spark gates cover greedy single-request embedded speculation with decode graphs (56-token and 1,100-token byte-identical runs and matching engine traces); the sampling profile is not qualified; the artifact fixes the draft block and verification width is scheduled per round (--mtp-draft is unsupported; --dspark-verify pins verification); native prompt-end exact prefix reuse and its KVC disk checkpoint are present, unqualified; --prefix-reuse off|exact|auto controls live and disk reuse (--no-kv-reuse aliases off); partial reuse, banks and session snapshots are unavailable; context comes from model metadata, --ctx is rejected. |
| - **K-EXAONE 236B A23B:** exact reuse qualified; LLLG partial checkpoints await live qualification. |
| - **dots3-note-prev:** text banks, local-window partial reuse and serial MTP are present but unqualified. |
| - **Qwen3.8-Flash-Next:** common UX baseline; configured values and verified combinations differ. |
| - **GLM 5.3 Flash:** compact banks, partial reuse, snapshots and embedded MTP are present; 1M structural capacity and historical 2K qualification are separate. |
| - **K2-Horizon 375B A23B:** 32K one-bank serving is qualified; disk KV and external owner import are not. |
| - **Inkling Small:** serial text snapshots present; media snapshots unsupported. |
| - **Step-3.7-Flash:** text banks are opt-in; Chat restart hits need history-stable identity; images serial. |
| - **MiMo-V2.6-Flash-RL:** 512K serial text and 256K serial media/DFlash are prior gates. With MTP off, 256K two-bank text plus serial media passed bounded checks at chunk 2048 with Q8 repack off, including live partial reuse and restart disk continuation. 1M one-bank text passed a bounded 1,040,506-token prompt; two banks did not fit. 512K two-bank media exceeds Spark memory. |
| - **Naive-N0.5-Flash:** main-only chunk-2048 buffered retrieval and disk continuation: 256K/two banks, 512K/one bank; draft-loaded and other shapes retain the bounded 8K gate; DSpark acceleration unqualified. |
| - **IQuest-Q1:** 8K/two-bank thinking HTTP passed at chunk 128 with short prompts and MTP off/on (draft 3, margin 0); plan bounds stay unqualified because reasoning and margin are not represented; no-thinking output, other shapes and 512K remain unqualified. |
|
|
| Regenerate without loading a model: |
|
|
| ```sh |
| cargo run -q -p ds4-core --example serving_docs > docs/serving-capabilities.md |
| cargo test -p ds4-core --test serving_docs |
| ``` |
|
|
