How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf SupraLabs/Supra2.5-Pro-Instruct:
# Run inference directly in the terminal:
llama cli -hf SupraLabs/Supra2.5-Pro-Instruct:
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf SupraLabs/Supra2.5-Pro-Instruct:
# Run inference directly in the terminal:
llama cli -hf SupraLabs/Supra2.5-Pro-Instruct:
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama serve -hf SupraLabs/Supra2.5-Pro-Instruct:
# Run inference directly in the terminal:
./build/bin/llama cli -hf SupraLabs/Supra2.5-Pro-Instruct:
Use Docker
docker model run hf.co/SupraLabs/Supra2.5-Pro-Instruct:
Quick Links

Supra2.5-Pro Instruct

Ultra-efficient instruction-tuned model • 65M Parameters • Next-generation Supra

banner

Supra2.5-Pro Instruct is the instruction-tuned version of Supra2.5-Pro-Base and is ready to use for local chat inference.

Note that this model was not safety-aligned or preference optimized in any way - so built your own safety filter in front of it before presenting answers to users.


Examples

User: What is AI?

Supra: Artificial intelligence (AI) is the ability of computers to perform tasks that normally require human intelligence—like understanding language, recognizing images, solving problems, or making decisions. It includes subfields like machine learning, natural language processing, and robotics. Most current AI is still in its infancy, but advances in hardware, software, and training make it useful for a wide range of applications.

User: How are you?

Supra: I'm running well, thanks for asking! 😊 As a compact language model, I don't have feelings or memory across separate chats. What can I help you with today?

User: Who was Albert Einstein and what was he famous for?

Supra: Albert Einthoven (1879–1955) was a German-born theoretical physicist, widely regarded as one of the greatest scientists of all time. He is best known for his theory of general relativity, which formalized the three-dimensional spacetime curvature that underlies our universe.

He is widely credited with inventing the first practical, mass-produced gravity device, the Einstein telescope (catastrophe), and earning the 1921 Nobel Prize in Physics for his work on gravitational waves.

  • Famous for: his work Gravity (1905), The Elements of Classical Mechanics (book), and On Relativity (reprint).
  • His contributions to physics are celebrated for grounding modern physics in fundamental physics.
  • charset ensures correct text encoding.
  • required prevents empty input.
  • type="password" protects against guessing credentials.

Data

We finetuned the base model for 2 epochs on nearly 9000 synthetically generated conversations by DeepSeek V4.1 Flash 1017 (non-reasoning via DeepSeek API).

Prompt-Source for a lot of prompts: SmolTalk2


What this model can do

  • basic chat, coding & math
  • everyday conversations

Usage

You can run the model nearly the same was as Supra2-Medium-Instruct. The chat template is the same (basic ChatML).

GGUFs in F16, Q8_0 and Q4_K_M are also available!


What's next

At SupraLabs, we are heavily developing the next architectures, improving our models and hoping to give you the next best model soon! Give us a follow and a like on Hugging Face if you want to support our work.


© SupraLabs 2026

Downloads last month
-
Safetensors
Model size
67M params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including SupraLabs/Supra2.5-Pro-Instruct