llama-cpp-python
llama-cpp
wheel
windows
cuda-12
blackwell
sm_100
sm_90
sm_89
sm_86
sm_80
sm_75
sm_72
sm_70
sm_62
sm_61
cp312
Instructions to use trajis-tech/llama-cpp-python-trajis-tech-nonavx512-cuda with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use trajis-tech/llama-cpp-python-trajis-tech-nonavx512-cuda with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="trajis-tech/llama-cpp-python-trajis-tech-nonavx512-cuda", filename="{{GGUF_FILE}}", )output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
Commit History
-
Update README.md
Verified signatured6dca19 -
Update README.md
Verified signature712d1ff -
Update README.md
Verified signature28b2ff0 -
Update README.md
Verified signature815ada1 -
Update README.md
Verified signature5911f46 -
Update README.md
Verified signaturea9d474c -
Update README.md
Verified signature46682a6 -
Update README.md
Verified signaturef53cbe0 -
Update README.md
Verified signature8a139b9 -
Update README.md
Verified signatureffbddb1 -
Update README.md
Verified signature0231a2d -
Update README.md
Verified signature2a7da7e -
Update README.md
Verified signaturebd77c4d
-
Update README.md
Verified signatureb6bc271 -
Create README.md
Verified signaturef4e298f -
Upload llama_cpp_python-0.3.16-cp312-cp312-win_amd64.whl
Verified signature7f8cbe8 -
initial commit
Verified signature0d59d5d