model,Open Subject Geography EM,Open Subject History EM,Open Subject Social studies EM,Open Subject Geography F1,Open Subject History F1,Open Subject Social studies F1,Open Subject Geography LR,Open Subject History LR,Open Subject Social studies LR,Not open Subject Geography EM,Not open Subject History EM,Not open Subject Social studies EM,Not open Subject Political science EM,Not open Subject Geography IS,Not open Subject History IS,Not open Subject Social studies IS,Not open Subject Political science IS,Not open Subject Geography PM,Not open Subject History PM,Not open Subject Social studies PM,Not open Subject Political science PM,split,RU_adaptation,Access,Team,Country,"n_params, B",source_type,origin_group,model_family,n_items,raw_accuracy
GigaChat-2,48,26,84,57,33,86,66,53,91,74,58,77,67,76,59,79,69,77,64,84,70,open,RU,API,Sber,Russia,,api,russian,gigachat,2840,0.647887323943662
GigaChat-2-Max,55,49,95,65,57,96,73,70,99,93,84,88,72,94,85,90,72,95,88,93,74,open,RU,API,Sber,Russia,,api,russian,gigachat,2840,0.8225352112676056
GigaChat-2-Pro,53,34,87,62,41,89,71,58,91,87,70,87,75,87,71,89,75,89,75,92,76,open,RU,API,Sber,Russia,,api,russian,gigachat,2840,0.7538732394366198
GigaChat-3-Ultra,58,50,92,70,62,94,75,71,96,95,84,88,78,95,85,89,78,96,88,93,80,open,RU,API,Sber,Russia,,api,russian,gigachat,2840,0.826056338028169
aliceai-llm,62,48,95,74,58,96,78,68,97,95,82,90,61,95,82,90,61,96,87,96,64,open,RU,API,Yandex,Russia,,api,russian,aliceai,2840,0.823943661971831
aliceai-llm-flash,62,48,95,74,59,96,77,68,97,94,83,90,61,95,83,90,61,96,87,96,64,open,RU,API,Yandex,Russia,,api,russian,aliceai,2840,0.8235915492957746
claude-sonnet-5,64,59,95,74,68,96,76,75,97,96,93,91,78,96,93,92,78,97,95,94,80,open,,API,Open Source / External,International,,api,international,claude,2840,0.8605633802816901
deepseek-v4-flash-0731,65,55,97,74,63,97,79,74,99,87,76,90,72,87,77,91,72,89,78,93,74,open,,API,Open Source / External,International,,api,international,deepseek,2840,0.7975352112676056
deepseek-v4-pro,67,57,95,77,66,96,79,77,97,92,81,89,76,92,82,91,76,93,84,93,78,open,,API,Open Source / External,International,,api,international,deepseek,2840,0.8165492957746479
gemini-3.5-flash-lite,61,58,100,73,65,100,78,75,100,95,91,87,78,96,92,89,79,96,93,93,81,open,,API,Open Source / External,International,,api,international,gemini,2840,0.844718309859155
gemini-3.6-flash,68,60,97,79,68,99,80,76,99,98,97,95,78,98,97,96,78,98,98,97,80,open,,API,Open Source / External,International,,api,international,gemini,2840,0.907394366197183
glm-5.2,62,54,92,73,61,96,76,74,96,92,79,88,73,93,80,89,73,94,82,92,75,open,,API,Open Source / External,International,,api,international,glm,2840,0.8045774647887324
gpt-5.4,62,53,89,73,62,93,76,75,94,95,94,92,78,95,94,93,78,96,95,95,80,open,,API,Open Source / External,International,,api,international,gpt-5,2840,0.8785211267605634
gpt-5.6-luna-pro,58,47,68,70,58,74,77,71,86,85,77,86,78,85,78,90,78,87,81,91,80,open,,API,Open Source / External,International,,api,international,gpt-5,2840,0.7665492957746479
gpt-5.6-terra,61,52,92,72,60,96,76,76,97,93,89,91,76,93,89,92,76,94,90,95,79,open,,API,Open Source / External,International,,api,international,gpt-5,2840,0.8531690140845071
grok-4.5,68,57,95,75,66,96,79,79,97,99,97,93,79,99,97,94,80,99,98,96,83,open,,API,Open Source / External,International,,api,international,grok,2840,0.9024647887323943
kimi-k2.6,59,44,76,68,53,79,74,64,85,83,67,82,72,84,69,86,72,85,72,89,75,open,,API,Open Source / External,International,,api,international,kimi,2840,0.7211267605633803
mimo-v2.5,55,42,63,65,51,66,70,65,78,88,76,81,70,89,78,85,70,90,79,88,72,open,,API,Open Source / External,International,,api,international,mimo,2840,0.7496478873239436
minimax-m3,62,50,84,73,59,86,75,71,92,83,69,82,72,83,69,84,72,85,73,89,74,open,,API,Open Source / External,International,,api,international,minimax,2840,0.7214788732394366
qwen3.7-flash,47,42,82,60,50,83,69,63,88,87,70,81,72,87,72,83,72,90,75,88,75,open,,API,Open Source / External,International,,api,international,qwen,2840,0.7362676056338028
qwen3.8-max,65,58,89,75,66,94,76,75,96,99,97,93,75,99,97,94,75,99,98,96,78,open,,API,Open Source / External,International,,api,international,qwen,2840,0.8929577464788733
yandexgpt-5.1,47,41,92,64,53,96,70,67,97,93,81,91,58,93,81,91,58,94,85,94,60,open,RU,API,Yandex,Russia,,api,russian,yandexgpt,2840,0.7926056338028169
Qwen/Qwen3.6-27B,61,43,87,69,52,88,78,66,92,90,76,85,75,90,77,88,75,92,81,91,76,full,,OSS,Open Source / External,International,27.0,oss,international,qwen,14199,0.7712514965842665
Qwen/Qwen3.6-35B-A3B,56,43,81,66,54,83,75,67,90,86,72,81,75,87,73,83,76,89,77,87,77,full,,OSS,Open Source / External,International,35.0,oss,international,qwen,14199,0.7387139939432354
ai-sage/GigaChat3.1-10B-A1.8B-bf16,41,32,80,48,42,81,62,58,86,51,40,33,72,51,40,33,72,73,59,79,74,full,RU,OSS,Sber,Russia,10.0,oss,russian,gigachat,14199,0.3874920769068244
allenai/Olmo-3.1-32B-Instruct,30,13,37,38,18,44,54,37,61,42,22,44,63,44,23,49,63,48,28,61,64,full,,OSS,Open Source / External,International,32.0,oss,international,olmo,14199,0.340728220297204
google/gemma-4-12B-it,52,34,73,60,42,77,70,58,86,77,52,75,73,78,54,78,74,81,58,84,75,full,,OSS,Open Source / External,International,12.0,oss,international,gemma,14199,0.6201845200366223
google/gemma-4-26B-A4B-it,56,44,80,65,53,84,73,67,90,85,67,81,75,86,68,83,75,88,72,88,77,full,,OSS,Open Source / External,International,26.0,oss,international,gemma,14199,0.7155433481231073
google/gemma-4-31B-it,63,48,89,72,57,91,77,72,94,92,82,86,77,92,82,87,77,94,86,92,78,full,,OSS,Open Source / External,International,31.0,oss,international,gemma,14199,0.7997042045214452
microsoft/phi-4,25,10,28,46,34,49,58,49,65,45,34,34,67,48,36,37,70,70,56,76,70,full,,OSS,Open Source / External,International,14.0,oss,international,phi,14199,0.3437566025776463
mistralai/Ministral-3-14B-Instruct-2512,51,34,39,63,52,52,72,65,71,75,59,75,72,77,61,79,74,79,66,84,75,full,,OSS,Open Source / External,International,14.0,oss,international,mistral,14199,0.6422987534333404
mistralai/Mistral-Small-3.2-24B-Instruct-2506,64,44,84,71,53,86,77,69,90,75,58,74,69,76,60,79,73,83,69,85,72,full,,OSS,Open Source / External,International,24.0,oss,international,mistral,14199,0.6508909078104091
nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16,3,1,30,6,4,38,18,17,53,35,18,34,56,36,19,39,57,41,24,51,58,full,,OSS,Open Source / External,International,4.0,oss,international,nemotron,14199,0.2688921755053173
t-tech/T-pro-it-2.1,57,35,82,66,44,84,75,62,90,87,69,79,75,87,69,82,75,90,74,87,76,full,RU,OSS,T-Tech,Russia,,oss,russian,t-pro,14199,0.7154729206282132
zai-org/GLM-4.7-Flash,45,33,42,55,42,50,67,59,64,57,44,50,69,59,46,56,69,63,51,67,70,full,,OSS,Open Source / External,International,30.0,oss,international,glm,14199,0.4670047186421579