Instructions to use Tiiny/ReluLLaMA-7B-PowerInfer-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Tiiny/ReluLLaMA-7B-PowerInfer-GGUF with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Tiiny/ReluLLaMA-7B-PowerInfer-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
add config
syx17b5d8a
-
add gitignore
syx58040af
-
Merge branch 'main' of hf.co:PowerInfer/ReluLLaMA-7B-PowerInfer-GGUF
syx1d445b6 -
add activation
syx24b2289
-
Create model card
1130ca8 -
upload
syxe0ca5ed
-
initial commit
Yixin Songf31d260