File size: 599 Bytes
006d174 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 | # SAGE (Q8_0)
Sage - GPT-Neo 1.3B fine-tuned on educational data
- **Base Model**: EleutherAI/gpt-neo-1.3B
- **Quantization**: Q8_0
- **Format**: GGUF (llama.cpp / LM Studio compatible)
- **Architecture**: GPT-NeoX
## Quick Start
### llama.cpp
```bash
./main -m sage-q8_0.gguf -p "Your prompt here"
```
### LM Studio
1. Download `sage-q8_0.gguf`
2. Open LM Studio
3. Load model and start chatting
### Python
```python
from llama_cpp import Llama
llm = Llama(model_path="sage-q8_0.gguf")
output = llm("Hello", max_tokens=128)
print(output['choices'][0]['text'])
```
|