Hugging Face's logo

OpenTransformer
/
llama.cpp-prismml

Model card Files
xet
 Community
llama.cpp-prismml / ggml /src /ggml-cpu /arch /x86

Commit History

  1. perf: maddubs kernel + nrc=4 multi-row for Q1_0_g128 (3.5-3.75 t/s)

    OpenTransformer
    Verified signature
    570ff77

  1. perf: optimized AVX2 kernel + COM6-inspired matmul dispatch (0.2 -> 3.43 t/s)

    OpenTransformer
    Verified signature
    8f4b822

  2. Q1_0_g128 CPU kernel fix + AVX2 SIMD (fork of PrismML-Eng/llama.cpp)

    OpenTransformer
    Verified signature
    03ba2cd