YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

SAGE (Q8_0)

Sage - GPT-Neo 1.3B fine-tuned on educational data

  • Base Model: EleutherAI/gpt-neo-1.3B
  • Quantization: Q8_0
  • Format: GGUF (llama.cpp / LM Studio compatible)
  • Architecture: GPT-NeoX

Quick Start

llama.cpp

./main -m sage-q8_0.gguf -p "Your prompt here"

LM Studio

  1. Download sage-q8_0.gguf
  2. Open LM Studio
  3. Load model and start chatting

Python

from llama_cpp import Llama
llm = Llama(model_path="sage-q8_0.gguf")
output = llm("Hello", max_tokens=128)
print(output['choices'][0]['text'])
Downloads last month
46
GGUF
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support