Spaces:

Duplicated from spitfire4794/test1111

spitfire4794
/

test1111111

Sleeping

App Files Files Community

test1111111 / native

567 kB

Ctrl+K

Ctrl+K

1 contributor

History: 7 commits

spitfire4794's picture

Serve SurjoLabs/Surjo-50m-SFT-Only (int8, 2T) on 7860

92dcc4e verified 16 days ago

README.md

8.66 kB
Serve SurjoLabs/Surjo-50m-SFT-Only (int8, 2T) on 7860 16 days ago
bindings.cpp

58.4 kB
Serve SurjoLabs/Surjo-50m-SFT-Only (int8, 2T) on 7860 16 days ago
compile_plan.cpp

5.04 kB
CISM remote autobench: full source + fleet runner, serve results on 7860 24 days ago
compile_plan.hpp

1.62 kB
CISM remote autobench: full source + fleet runner, serve results on 7860 24 days ago
kernels.cpp

24.9 kB
Serve SurjoLabs/Surjo-50m-SFT-Only (int8, 2T) on 7860 16 days ago
kernels.hpp

11.4 kB
Serve SurjoLabs/Surjo-50m-SFT-Only (int8, 2T) on 7860 16 days ago
kernels_avx2.cpp

55.2 kB
Serve SurjoLabs/Surjo-50m-SFT-Only (int8, 2T) on 7860 16 days ago
kernels_neon.cpp

44.3 kB
Space: AVX512 kernels (zmm fp32/int8, parallel VNNI-Q8) + 2T cap + NEON int4 fix 22 days ago
kernels_sse.cpp

26.6 kB
Fresh Surjo-50m bench on current code (all 4 quants) + HW inventory 22 days ago
kernels_vnni.cpp

17.8 kB
Space: AVX512 kernels (zmm fp32/int8, parallel VNNI-Q8) + 2T cap + NEON int4 fix 22 days ago
runtime.cpp

271 kB
Serve SurjoLabs/Surjo-50m-SFT-Only (int8, 2T) on 7860 16 days ago
runtime.hpp

41.8 kB
Serve SurjoLabs/Surjo-50m-SFT-Only (int8, 2T) on 7860 16 days ago