XiaomiMiMo/MiMo-V2.6-RL-oss
Viewer • Updated • 7.78k • 22.6k • 483
Pranay Kundu
pranay5255
AI & ML interests
None yet
Recent Activity
liked a dataset about 2 hours ago
XiaomiMiMo/MiMo-V2.6-RL-oss liked a model about 3 hours ago
XiaomiMiMo/MiMo-V2.6-Pro-RL liked a model 17 days ago
deepseek-ai/DeepSeek-V4.1-FlashOrganizations
liked a
dataset about 2 hours ago
liked a
model about 3 hours ago
liked a
model 17 days ago
liked a
Space 22 days ago
liked 2
models about 1 month ago
upvoted an article about 1 month ago
Article
ML Intern Takes Our Post-Training Internship Test
cmpatino
• • 34 updated a
Space about 2 months ago
published a
Space about 2 months ago
updated a
Space about 2 months ago
published a
Space about 2 months ago
liked a
model 2 months ago
reacted to ucr-max's post with 🔥 2 months ago
Post
2987
We have released the first version of CompactLMIndex UniversalComputingResearch/clmi, a curated benchmark for smaller language models.
The index evaluates models across six benchmarks covering commonsense, science and world knowledge, and grammatical competence. Scores are normalized for random chance, so results are easier to compare across tasks with different baselines.
The composite gives 50% weight to commonsense, 25% to science and world knowledge, and 25% to grammatical competence. BLiMP is macro-averaged across its 12 linguistic categories. Every result includes 95% bootstrap intervals, and rank ranges reflect paired comparisons on matched evaluation items.
The goal is to compare compact models under one fixed, zero-shot evaluation protocol and make differences in architecture, training, and inference visible without treating parameter count as a substitute for quality.
If you have results for a model that fits the benchmark scope, please open a discussion on the Space.
The index evaluates models across six benchmarks covering commonsense, science and world knowledge, and grammatical competence. Scores are normalized for random chance, so results are easier to compare across tasks with different baselines.
The composite gives 50% weight to commonsense, 25% to science and world knowledge, and 25% to grammatical competence. BLiMP is macro-averaged across its 12 linguistic categories. Every result includes 95% bootstrap intervals, and rank ranges reflect paired comparisons on matched evaluation items.
The goal is to compare compact models under one fixed, zero-shot evaluation protocol and make differences in architecture, training, and inference visible without treating parameter count as a substitute for quality.
If you have results for a model that fits the benchmark scope, please open a discussion on the Space.
- 6 replies
liked a
Space 2 months ago
updated a
bucket 3 months ago
liked a
dataset 3 months ago
updated a
model 3 months ago
published a
model 3 months ago
updated a
model 3 months ago
published a
model 3 months ago