Jose Esparza commited on
Commit
9b0ddbf
·
unverified ·
1 Parent(s): c5fdab9

Fix OOM build by using CPU wheels for llama-cpp-python and torch

Browse files
Files changed (1) hide show
  1. requirements.txt +6 -0
requirements.txt CHANGED
@@ -1,3 +1,9 @@
 
 
 
 
 
 
1
  faster-whisper>=1.0
2
  llama-cpp-python>=0.3.2
3
  piper-tts>=1.2
 
1
+ # Prebuilt CPU wheel for llama-cpp-python (avoids the source build that OOM'd).
2
+ --extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cpu
3
+ # CPU-only torch (avoids ~3GB of CUDA wheels pulled in by sentence-transformers).
4
+ --extra-index-url https://download.pytorch.org/whl/cpu
5
+
6
+ torch
7
  faster-whisper>=1.0
8
  llama-cpp-python>=0.3.2
9
  piper-tts>=1.2