Science Pharaoh Mini

Science Pharaoh Mini is a specialized 0.5-parameter language model fine-tuned on scientific reasoning and domain-specific knowledge. Built upon Alibaba Cloud's Qwen2.5-0.5B-Instruct, this model demonstrates optimized performance on graduate-level science reasoning tasks relative to its lightweight footprint.


Key Highlights & Performance

  • Model Size: 0.5B parameters (Compact, edge-ready)
  • Target Domain: General Science, Physics, Chemistry, Biology
  • Benchmark Performance: Reached 34.8% accuracy on the highly challenging GPQA Diamond benchmark using a single-token evaluation harness.

Benchmark Evaluation

Benchmark Setting Score Total Questions Accuracy
GPQA Diamond Single-Token MC (0-Shot) 69 / 198 198 34.8%

Quickstart & Usage

Setup & Directory Layout

The repository artifact package includes all necessary files organized as follows:

.
โ””โ”€โ”€ final_model/
    โ”œโ”€โ”€ config.json
    โ”œโ”€โ”€ model.safetensors
    โ”œโ”€โ”€ tokenizer.json
    โ””โ”€โ”€ tokenizer_config.json
Downloads last month
41
GGUF
Model size
0.5B params
Architecture
qwen2
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Youssef-dev/science-pharaoh-mini-69

Quantized
(314)
this model

Evaluation results