File size: 511 Bytes
014b14c
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
# Extra deps for the GPU training/inference path (Colab / Modal / RunPod).
# Install on top of requirements.txt on a CUDA box:
#   pip install -r requirements.txt -r requirements-gpu.txt
#
# NOTE: install a CUDA build of torch first (Colab ships one). The CPU box uses
# torch==*+cpu, which cannot run 4-bit QLoRA.
bitsandbytes>=0.43        # 4-bit NF4 kernels for QLoRA (requires CUDA)
# Optional speedup (UNCONFIRMED against transformers 5.13 — pin transformers down if you use it):
#   pip install unsloth