kev-0.8b-vllm-cpp / meta.json
mudler's picture
Add kev-0.8b converted for vllm.cpp (convert-kev.py @ 96788348)
c17e736 verified
Raw History Blame Contribute Delete
258 Bytes
{
"temperature": 2.3510958125672174,
"head_dim": 256,
"base": "Qwen/Qwen3.5-0.8B-Base",
"base_revision": "dc7cdfe2ee4154fa7e30f5b51ca41bfa40174e68",
"lora": 16,
"option_isolation": false,
"special_embeddings": false,
"weights_dtype": "fp32"
}