Instructions to use Tiiny/ReluLLaMA-70B-PowerInfer-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Tiiny/ReluLLaMA-70B-PowerInfer-GGUF with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Tiiny/ReluLLaMA-70B-PowerInfer-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
update
syx1aa5747
-
config
syx7838692
-
update 70B model
syxce08c5d
-
add gitignore
syxef1274a -
Merge branch 'main' of hf.co:PowerInfer/ReluLLaMA-70B-PowerInfer-GGUF
syxda1db26 -
add activation
syx2017997
-
Create README.md
9993541 -
upload
syx0109f07 -
initial commit
Yixin Song61a3a9f