Commit History

  1. Make compatible with Transformers 5.17⁠

    Verified signature
    790bc85

  1. fix(rope): YaRN attention_factor is (0.1*ln(factor)+1)*attn_factor, not the bare multiplier

    Verified signature
    610af28

  1. docs: note INT4 needs vLLM #47154

    Verified signature
    59a6536

  1. Use chat_template.jinja as the single source: drop the {% include %} chat_template field from tokenizer_config.json

    Verified signature
    ebba672

  1. small self-contained fixes

    Verified signature
    e163f76

  1. Note FP8 KV cache needs vLLM 0.22.0; drop scrambled-output workaround (vllm#42650)

    8af858a

  1. update sampling parameters to match evals

    451ad2d

  1. Update model card for 256K context length

    Verified signature
    3219161
  2. increase context length to 256k

    2d55328

  1. Drop VLLM_USE_DEEP_GEMM=0 from vllm serve recipe (DeepGEMM is supported on Hopper and datacenter Blackwell)

    Verified signature
    8c57f62

  1. Add base_model (#1)⁠

    joerowell +1: mgoin
    f14ef97

  1. Enable thinking by default in non-Hopper FP8-KV serve command⁠

    Verified signature
    c7a758e
  2. Update non-Hopper FP8-KV serve command and link to vLLM recipes page⁠

    Verified signature
    2c0d22b

  1. Laguna XS.2 upload

    f82b43d