clef-p300 / model.py
episod's picture
Upload folder using huggingface_hub
7473749 verified
Raw History Blame Contribute Delete
421 Bytes
"""Thin-bundle runner shim for Qwen3.8-27B on Blackhole (DFlash2 speculative decoding).
The model code itself ships in the `tt-metal-models` wheel (models.demos.blackhole.qwen36); this module only
re-exports the vLLM adapter class so `model:Qwen36DFlashForCausalLM` resolves with PYTHONPATH set to the bundle dir.
"""
from models.demos.blackhole.qwen36.tt.qwen36_vllm_dflash import Qwen36DFlashForCausalLM # noqa: F401