d3-coreml / README.md
alexwengg's picture
d3 Core ML: README (vllm-sr Decision 3.0 v3.1.0)
6874837 verified
|
Raw History Blame Contribute Delete
1.19 kB
metadata
license: apache-2.0
base_model:
  - vllm-sr/d3-lite
  - vllm-sr/d3-nano
  - vllm-sr/d3-mini
library_name: coreml
pipeline_tag: zero-shot-classification
tags:
  - coreml
  - apple-silicon
  - decision-model
  - vision
  - video

Decision 3.0 — Core ML

Decision 3.0 by the vLLM Semantic Router team, converted to Core ML for Apple silicon: text, image and video requests on device. Same contract as upstream: one forward pass per question, the 255-way FP32 readout at the last prompt token, a probability for every option, no text generated.

Each folder is a full release (text graphs, vision tower, host tables, Python host) with its own README covering files, parity against upstream and speed. Swift: D3VisionManager in FluidUse loads any of them.

License: Apache-2.0, as upstream.