Spaces:
Runtime error
Runtime error
Commit History
-
add fp16 suport for svc
339c325 -
feat: add svc inference code and webui
2566adf
-
Fix LlamaAttention compatibility with transformers 4.53.0
The transformers 4.53 API requires `position_embeddings` (cos/sin rotary tuple) as a positional arg to LlamaAttention.forward() and returns 2 values instead of 3. Update DiffLlama to compute rotary embeddings and pass them through the decoder layers. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>4a3004b -
Upload folder using huggingface_hub
Verified signaturec7f3ffb
