Sep 22 28 days ago 09:34 Make compatible with Transformers 5.17 (#3 ) poolside-eng +1: Yu-Peng-Poolside - Make compatible with Transformers 5.17 (c452feafee73c20a4b5fbc1ba8ff58a868d95150)
Co-authored-by: Yu-Peng Fu <Yu-Peng-Poolside@users.noreply.huggingface.co> Jul 14 08:34 fix(rope): YaRN attention_factor is (0.1*ln(factor)+1)*attn_factor, not the bare multiplier Jul 3 08:36 Update README.md (#2 ) joerowell +1: baranowskiadam - Update README.md (f40cc57108adf3949107df418a2909984079d522)
Co-authored-by: Adam Baranowski <baranowskiadam@users.noreply.huggingface.co> Jul 1 08:57 Use chat_template.jinja as the single source: drop the {% include %} chat_template field from tokenizer_config.json Jun 18 18:34 small self-contained fixes 09:46 Document SGLang support (sgl-project/sglang#24204) Jun 5 11:04 Note FP8 KV cache needs vLLM 0.22.0; drop scrambled-output workaround (vllm#42650) May 27 09:00 update sampling parameters to match evals May 26 15:24 Update model card for 256K context length 14:59 increase context length to 256k May 20 20:12 Drop VLLM_USE_DEEP_GEMM=0 from vllm serve recipe (DeepGEMM is supported on Hopper and datacenter Blackwell) May 10 15:00 Add base_model (#1 ) joerowell +1: mgoin - Add base_model (e089721ca988e0b97ddebfac2c0511d93dffb5b6)
Co-authored-by: Michael Goin <mgoin@users.noreply.huggingface.co> Apr 29 22:33 Enable thinking by default in non-Hopper FP8-KV serve command Adds --default-chat-template-kwargs '{"enable_thinking": true}' to the workaround command so it matches the main card's recommended invocation. 22:27 Update non-Hopper FP8-KV serve command and link to vLLM recipes page Brings the non-Hopper FP8-KV workaround command in line with the new vllm serve flags from the main model card and adds --moe_backend marlin. Also links to https://recipes.vllm.ai/poolside/Laguna-XS.2. Apr 28 14:18 Laguna XS.2 upload