Unbind-Flash-V1 / assets /benchmarks /source-data.csv
UnbindAI's picture
Add eight branded benchmark comparisons and animated overview
f23734e verified
Raw History Blame Contribute Delete
9.07 kB
Benchmark,Model,Reported score,Note,Source
DeepSWE v1.1,DeepSeek V4.1 Flash 1017,77.0,Mini-SWE-V2 harness. Publisher-reported benchmark scores.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
DeepSWE v1.1,DeepSeek V4.1 Flash,74.2,Mini-SWE-V2 harness. Publisher-reported benchmark scores.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
DeepSWE v1.1,K3,67.5,Mini-SWE-V2 harness. Publisher-reported benchmark scores.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
DeepSWE v1.1,GLM-5.3,66.9,Mini-SWE-V2 harness. Publisher-reported benchmark scores.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
DeepSWE v1.1,GPT-5.6 Sol,73.0,Mini-SWE-V2 harness. Publisher-reported benchmark scores.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
DeepSWE v1.1,Opus 5,74.0,Mini-SWE-V2 harness. Publisher-reported benchmark scores.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Terminal-Bench 4.0,DeepSeek V4.1 Flash 1017,42.3,Claude Code harness. Publisher-reported benchmark scores.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Terminal-Bench 4.0,DeepSeek V4.1 Flash,31.2,Claude Code harness. Publisher-reported benchmark scores.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Terminal-Bench 4.0,K3,12.6,Claude Code harness. Publisher-reported benchmark scores.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Terminal-Bench 4.0,GLM-5.3,37.9,Claude Code harness. Publisher-reported benchmark scores.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Terminal-Bench 4.0,GPT-5.6 Sol,39.9,Claude Code harness. Publisher-reported benchmark scores.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Terminal-Bench 4.0,Opus 5,51.8,Claude Code harness. Publisher-reported benchmark scores.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
HLE without tools,DeepSeek V4.1 Flash 1017,42.6,Full HLE figures only. GLM-5.3 omitted: the source gives a text-only subset score.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
HLE without tools,DeepSeek V4.1 Flash,36.8,Full HLE figures only. GLM-5.3 omitted: the source gives a text-only subset score.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
HLE without tools,K3,43.5,Full HLE figures only. GLM-5.3 omitted: the source gives a text-only subset score.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
HLE without tools,GPT-5.6 Sol,44.5,Full HLE figures only. GLM-5.3 omitted: the source gives a text-only subset score.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
HLE without tools,Opus 5,56.3,Full HLE figures only. GLM-5.3 omitted: the source gives a text-only subset score.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
ProgramBench,DeepSeek V4.1 Flash 1017,29.1,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
ProgramBench,DeepSeek V4.1 Flash,20.3,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
ProgramBench,K3,17.5,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
ProgramBench,GLM-5.3,19.0,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
ProgramBench,GPT-5.6 Sol,23.0,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
ProgramBench,Opus 5,37.0,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
NL2Repo-Bench,DeepSeek V4.1 Flash 1017,68.2,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
NL2Repo-Bench,DeepSeek V4.1 Flash,65.4,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
NL2Repo-Bench,K3,58.0,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
NL2Repo-Bench,GLM-5.3,58.0,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
NL2Repo-Bench,GPT-5.6 Sol,56.8,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
NL2Repo-Bench,Opus 5,75.3,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Automation-Bench v1.0.6,DeepSeek V4.1 Flash 1017,60.5,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Automation-Bench v1.0.6,DeepSeek V4.1 Flash,54.8,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Automation-Bench v1.0.6,K3,46.7,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Automation-Bench v1.0.6,GLM-5.3,48.8,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Automation-Bench v1.0.6,GPT-5.6 Sol,45.8,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Automation-Bench v1.0.6,Opus 5,50.3,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Agents’ Last Exam,DeepSeek V4.1 Flash 1017,35.4,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Agents’ Last Exam,DeepSeek V4.1 Flash,31.8,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Agents’ Last Exam,K3,27.6,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Agents’ Last Exam,GLM-5.3,28.5,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Agents’ Last Exam,GPT-5.6 Sol,26.7,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Agents’ Last Exam,Opus 5,28.6,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Apex Bench v1.1,DeepSeek V4.1 Flash 1017,72.1,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Apex Bench v1.1,DeepSeek V4.1 Flash,64.6,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Apex Bench v1.1,K3,47.8,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Apex Bench v1.1,GLM-5.3,56.6,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Apex Bench v1.1,GPT-5.6 Sol,54.3,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md
Apex Bench v1.1,Opus 5,65.8,Publisher-reported benchmark scores. Additional per-row settings are not specified.,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/raw/main/README.md