llamacpp-binary / README.md
rththr's picture
Upload README.md with huggingface_hub
a4c799c verified
|
Raw History Blame Contribute Delete
705 Bytes

K2Horizon llama.cpp CUDA Binary

Pre-built llama.cpp binary with CUDA support for Linux x86_64.

Repository

Requirements

  • Linux x86_64
  • NVIDIA GPU with CUDA support
  • CUDA 12.8+

Files

File Description
llama-k2horizon-cuda-linux-x64.tar.gz K2Horizon llama.cpp CUDA binary
llama.cpp-b9628-cuda-12.8-amd64.tar.gz llama.cpp build b9628 for CUDA 12.8
sageattention-2.2.0-cp312-cp312-linux_x86_64.whl SageAttention 2.2.0 pre-built wheel

Install

tar xzf llama-k2horizon-cuda-linux-x64.tar.gz