evaluation/README.md

Evaluation summary

summary.json records the completed Sol Nano checkpoint's full zero-shot evaluation on HellaSwag, ARC-Easy, ARC-Challenge, PIQA, and ArithMark-3.0.

The Axiomic Labs Open SLM Intelligence Index is calculated with:

N(s,c) = 100 * (s-c) / (100-c)

ARC = (ARC-Easy + ARC-Challenge) / 2

Index = [N(HellaSwag,25) + N(ARC,25) + N(PIQA,50) + 0.65*N(ArithMark-3,25)] / 3.65

Result: 6.068393579554266 / 100.

This is a local result, not an independently verified leaderboard submission. The original checkpoint path in the summary identifies the Molab training environment; model weights in this repository are exported from that checkpoint.

References: Axiomic index methodology, official ArithMark-3.0 dataset and evaluator.