| model,Open Subject Geography EM,Open Subject History EM,Open Subject Social studies EM,Open Subject Geography F1,Open Subject History F1,Open Subject Social studies F1,Open Subject Geography LR,Open Subject History LR,Open Subject Social studies LR,Not open Subject Geography EM,Not open Subject History EM,Not open Subject Social studies EM,Not open Subject Political science EM,Not open Subject Geography IS,Not open Subject History IS,Not open Subject Social studies IS,Not open Subject Political science IS,Not open Subject Geography PM,Not open Subject History PM,Not open Subject Social studies PM,Not open Subject Political science PM,split,RU_adaptation,Access,Team,Country,"n_params, B",source_type,origin_group,model_family,n_items,raw_accuracy |
| GigaChat-2,48,26,84,57,33,86,66,53,91,74,58,77,67,76,59,79,69,77,64,84,70,open,RU,API,Sber,Russia,,api,russian,gigachat,2840,0.647887323943662 |
| GigaChat-2-Max,55,49,95,65,57,96,73,70,99,93,84,88,72,94,85,90,72,95,88,93,74,open,RU,API,Sber,Russia,,api,russian,gigachat,2840,0.8225352112676056 |
| GigaChat-2-Pro,53,34,87,62,41,89,71,58,91,87,70,87,75,87,71,89,75,89,75,92,76,open,RU,API,Sber,Russia,,api,russian,gigachat,2840,0.7538732394366198 |
| GigaChat-3-Ultra,58,50,92,70,62,94,75,71,96,95,84,88,78,95,85,89,78,96,88,93,80,open,RU,API,Sber,Russia,,api,russian,gigachat,2840,0.826056338028169 |
| aliceai-llm,62,48,95,74,58,96,78,68,97,95,82,90,61,95,82,90,61,96,87,96,64,open,RU,API,Yandex,Russia,,api,russian,aliceai,2840,0.823943661971831 |
| aliceai-llm-flash,62,48,95,74,59,96,77,68,97,94,83,90,61,95,83,90,61,96,87,96,64,open,RU,API,Yandex,Russia,,api,russian,aliceai,2840,0.8235915492957746 |
| claude-sonnet-5,64,59,95,74,68,96,76,75,97,96,93,91,78,96,93,92,78,97,95,94,80,open,,API,Open Source / External,International,,api,international,claude,2840,0.8605633802816901 |
| deepseek-v4-flash-0731,65,55,97,74,63,97,79,74,99,87,76,90,72,87,77,91,72,89,78,93,74,open,,API,Open Source / External,International,,api,international,deepseek,2840,0.7975352112676056 |
| deepseek-v4-pro,67,57,95,77,66,96,79,77,97,92,81,89,76,92,82,91,76,93,84,93,78,open,,API,Open Source / External,International,,api,international,deepseek,2840,0.8165492957746479 |
| gemini-3.5-flash-lite,61,58,100,73,65,100,78,75,100,95,91,87,78,96,92,89,79,96,93,93,81,open,,API,Open Source / External,International,,api,international,gemini,2840,0.844718309859155 |
| gemini-3.6-flash,68,60,97,79,68,99,80,76,99,98,97,95,78,98,97,96,78,98,98,97,80,open,,API,Open Source / External,International,,api,international,gemini,2840,0.907394366197183 |
| glm-5.2,62,54,92,73,61,96,76,74,96,92,79,88,73,93,80,89,73,94,82,92,75,open,,API,Open Source / External,International,,api,international,glm,2840,0.8045774647887324 |
| gpt-5.4,62,53,89,73,62,93,76,75,94,95,94,92,78,95,94,93,78,96,95,95,80,open,,API,Open Source / External,International,,api,international,gpt-5,2840,0.8785211267605634 |
| gpt-5.6-luna-pro,58,47,68,70,58,74,77,71,86,85,77,86,78,85,78,90,78,87,81,91,80,open,,API,Open Source / External,International,,api,international,gpt-5,2840,0.7665492957746479 |
| gpt-5.6-terra,61,52,92,72,60,96,76,76,97,93,89,91,76,93,89,92,76,94,90,95,79,open,,API,Open Source / External,International,,api,international,gpt-5,2840,0.8531690140845071 |
| grok-4.5,68,57,95,75,66,96,79,79,97,99,97,93,79,99,97,94,80,99,98,96,83,open,,API,Open Source / External,International,,api,international,grok,2840,0.9024647887323943 |
| kimi-k2.6,59,44,76,68,53,79,74,64,85,83,67,82,72,84,69,86,72,85,72,89,75,open,,API,Open Source / External,International,,api,international,kimi,2840,0.7211267605633803 |
| mimo-v2.5,55,42,63,65,51,66,70,65,78,88,76,81,70,89,78,85,70,90,79,88,72,open,,API,Open Source / External,International,,api,international,mimo,2840,0.7496478873239436 |
| minimax-m3,62,50,84,73,59,86,75,71,92,83,69,82,72,83,69,84,72,85,73,89,74,open,,API,Open Source / External,International,,api,international,minimax,2840,0.7214788732394366 |
| qwen3.7-flash,47,42,82,60,50,83,69,63,88,87,70,81,72,87,72,83,72,90,75,88,75,open,,API,Open Source / External,International,,api,international,qwen,2840,0.7362676056338028 |
| qwen3.8-max,65,58,89,75,66,94,76,75,96,99,97,93,75,99,97,94,75,99,98,96,78,open,,API,Open Source / External,International,,api,international,qwen,2840,0.8929577464788733 |
| yandexgpt-5.1,47,41,92,64,53,96,70,67,97,93,81,91,58,93,81,91,58,94,85,94,60,open,RU,API,Yandex,Russia,,api,russian,yandexgpt,2840,0.7926056338028169 |
| Qwen/Qwen3.6-27B,61,43,87,69,52,88,78,66,92,90,76,85,75,90,77,88,75,92,81,91,76,full,,OSS,Open Source / External,International,27.0,oss,international,qwen,14199,0.7712514965842665 |
| Qwen/Qwen3.6-35B-A3B,56,43,81,66,54,83,75,67,90,86,72,81,75,87,73,83,76,89,77,87,77,full,,OSS,Open Source / External,International,35.0,oss,international,qwen,14199,0.7387139939432354 |
| ai-sage/GigaChat3.1-10B-A1.8B-bf16,41,32,80,48,42,81,62,58,86,51,40,33,72,51,40,33,72,73,59,79,74,full,RU,OSS,Sber,Russia,10.0,oss,russian,gigachat,14199,0.3874920769068244 |
| allenai/Olmo-3.1-32B-Instruct,30,13,37,38,18,44,54,37,61,42,22,44,63,44,23,49,63,48,28,61,64,full,,OSS,Open Source / External,International,32.0,oss,international,olmo,14199,0.340728220297204 |
| google/gemma-4-12B-it,52,34,73,60,42,77,70,58,86,77,52,75,73,78,54,78,74,81,58,84,75,full,,OSS,Open Source / External,International,12.0,oss,international,gemma,14199,0.6201845200366223 |
| google/gemma-4-26B-A4B-it,56,44,80,65,53,84,73,67,90,85,67,81,75,86,68,83,75,88,72,88,77,full,,OSS,Open Source / External,International,26.0,oss,international,gemma,14199,0.7155433481231073 |
| google/gemma-4-31B-it,63,48,89,72,57,91,77,72,94,92,82,86,77,92,82,87,77,94,86,92,78,full,,OSS,Open Source / External,International,31.0,oss,international,gemma,14199,0.7997042045214452 |
| microsoft/phi-4,25,10,28,46,34,49,58,49,65,45,34,34,67,48,36,37,70,70,56,76,70,full,,OSS,Open Source / External,International,14.0,oss,international,phi,14199,0.3437566025776463 |
| mistralai/Ministral-3-14B-Instruct-2512,51,34,39,63,52,52,72,65,71,75,59,75,72,77,61,79,74,79,66,84,75,full,,OSS,Open Source / External,International,14.0,oss,international,mistral,14199,0.6422987534333404 |
| mistralai/Mistral-Small-3.2-24B-Instruct-2506,64,44,84,71,53,86,77,69,90,75,58,74,69,76,60,79,73,83,69,85,72,full,,OSS,Open Source / External,International,24.0,oss,international,mistral,14199,0.6508909078104091 |
| nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16,3,1,30,6,4,38,18,17,53,35,18,34,56,36,19,39,57,41,24,51,58,full,,OSS,Open Source / External,International,4.0,oss,international,nemotron,14199,0.2688921755053173 |
| t-tech/T-pro-it-2.1,57,35,82,66,44,84,75,62,90,87,69,79,75,87,69,82,75,90,74,87,76,full,RU,OSS,T-Tech,Russia,,oss,russian,t-pro,14199,0.7154729206282132 |
| zai-org/GLM-4.7-Flash,45,33,42,55,42,50,67,59,64,57,44,50,69,59,46,56,69,63,51,67,70,full,,OSS,Open Source / External,International,30.0,oss,international,glm,14199,0.4670047186421579 |
|
|
