File size: 920 Bytes
b6bc271 2a7da7e d6dca19 b6bc271 0231a2d 712d1ff b6bc271 f4e298f 2a7da7e f4e298f 2a7da7e f4e298f | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 | ---
license: mit
tags:
- llama-cpp
- llama-cpp-python
- wheel
- windows
- cuda-12
- blackwell
- sm_100
- sm_90
- sm_89
- sm_86
- sm_80
- sm_75
- sm_72
- sm_70
- sm_62
- sm_61
- cp312
library_name: llama-cpp-python
---
# llama-cpp-python (Windows CUDA build)
Prebuilt wheel for:
- llama_cpp_python 0.3.16
- Windows x64
- Python 3.12 (cp312)
- CUDA enabled
- AVX512 disabled
- Supports NVIDIA 10 / 20 / 30 / 40 / 50 series GPUs
- Trajis SmartSRT 1.0.0
---
## Install
Direct install:
pip install "https://huggingface.co/trajis-tech/llama-cpp-python-trajis-tech-nonavx512-cuda/resolve/main/llama_cpp_python-0.3.16-cp312-cp312-win_amd64.whl"
Or download manually and install:
pip install llama_cpp_python-0.3.16-cp312-cp312-win_amd64.whl
---
## Uninstall
pip uninstall llama-cpp-python
---
## Requirements
- Windows 64-bit
- Python 3.12
- NVIDIA GPU
- CUDA Toolkit installed
|