bison-1-MLX-4bit / engine /__init__.py
pratikgx's picture
Add bison-1 MLX 4-bit weights, System One engine, and model card
9eefb05 verified
Raw History Blame Contribute Delete
523 Bytes
"""MLX System One engine for Baseten bison-1 and groundhog-1.
Prompt rendering, slot labels, temperatures and answer assembly follow OneJev/qev
(qev-labels-v2) plus Baseten's serve.patch. Attention and readout follow the
checkpoint: `baseten_modeling_overrides` / `modeling_overrides` and `readout.json`
(block-bidirectional full-attention, causal sliding-window, slot_lm, 256 slots).
"""
from .engine_mlx import DecisionEngine
from .readout import load_readout_config
__all__ = ["DecisionEngine", "load_readout_config"]