File size: 599 Bytes
006d174
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
# SAGE (Q8_0)



Sage - GPT-Neo 1.3B fine-tuned on educational data



- **Base Model**: EleutherAI/gpt-neo-1.3B

- **Quantization**: Q8_0
- **Format**: GGUF (llama.cpp / LM Studio compatible)
- **Architecture**: GPT-NeoX

## Quick Start

### llama.cpp
```bash

./main -m sage-q8_0.gguf -p "Your prompt here"

```

### LM Studio
1. Download `sage-q8_0.gguf`
2. Open LM Studio
3. Load model and start chatting

### Python
```python

from llama_cpp import Llama

llm = Llama(model_path="sage-q8_0.gguf")

output = llm("Hello", max_tokens=128)

print(output['choices'][0]['text'])

```