Commit History

  1. KD-distilled 2-layer Qwen2-MoE from hyper-accel/ci-random-qwen2-moe-a3b against Qwen1.5-MoE-A2.7B teacher (alpaca-cleaned, 1500 steps, T=2.0)

    Verified signature
    ef12344
  2. initial commit

    Verified signature
    583e5f0