Commit History

28 days ago

  1. Make compatible with Transformers 5.17 (#3)⁠

    poolside-eng +1: Yu-Peng-Poolside
    4120e63

  1. fix(rope): YaRN attention_factor is (0.1*ln(factor)+1)*attn_factor, not the bare multiplier

    Verified signature
    607820a

  1. Update README.md (#2)⁠

    joerowell +1: baranowskiadam
    39d080b

  1. Use chat_template.jinja as the single source: drop the {% include %} chat_template field from tokenizer_config.json

    Verified signature
    2ce6e7f

  1. small self-contained fixes

    Verified signature
    87833b4
  2. Document SGLang support (sgl-project/sglang#24204)

    Verified signature
    1a9a5d4

  1. Note FP8 KV cache needs vLLM 0.22.0; drop scrambled-output workaround (vllm#42650)

    88ad86d

  1. update sampling parameters to match evals

    f854f41

  1. Update model card for 256K context length

    Verified signature
    039231a
  2. increase context length to 256k

    df25fd0

  1. Drop VLLM_USE_DEEP_GEMM=0 from vllm serve recipe (DeepGEMM is supported on Hopper and datacenter Blackwell)

    Verified signature
    b17bd8d

  1. Add base_model (#1)⁠

    joerowell +1: mgoin
    8655ff1

  1. Enable thinking by default in non-Hopper FP8-KV serve command⁠

    Verified signature
    e8b30a7
  2. Update non-Hopper FP8-KV serve command and link to vLLM recipes page⁠

    Verified signature
    2ad0232

  1. Laguna XS.2 upload

    fba1514