nonsodev commited on
Commit
a26f296
·
verified ·
1 Parent(s): b6a1d47

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +30 -0
README.md ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ language: en
4
+ tags:
5
+ - education
6
+ - mathematics
7
+ - misconceptions
8
+ - deberta-v3
9
+ ---
10
+
11
+ # Why did I get this wrong?
12
+
13
+ Reads a student's own explanation of a multiple-choice maths answer and names the misconception behind it.
14
+
15
+ Trained on MAP (Charting Student Math Misunderstandings, Kaggle 2025, by Eedi and The Learning Agency), licensed
16
+ CC BY-NC 4.0. These weights carry the same licence: non-commercial use only, with attribution. No student rows are
17
+ included here; `val_preds.csv` files hold row ids and labels only.
18
+
19
+ ## Runs
20
+
21
+ - `runs/pair-v1-fold0`: deberta-v3-base cross-encoder, (question + chosen answer + explanation, misconception
22
+ description) scored listwise. Fold 0 of 5: MAP@3 0.9135, top-1 0.84, misconception recall 0.91. This is the served model.
23
+ - `runs/pair-v1-newq`: same recipe with two questions held out entirely. MAP@3 0.646, misconception recall 0.06.
24
+ It does not transfer: 32 of the 35 misconceptions in MAP occur on exactly one question, so there is nothing to
25
+ transfer from.
26
+ - `runs/pair-smoke`: a 1,500-row smoke test, ignore.
27
+
28
+ Each run has `model.safetensors`, `tokenizer/`, `config.json` (classes, descriptions, questions, log) and `log.jsonl`.
29
+ The model takes a text pair: the prompt (question, choices, chosen answer, whether it is right, explanation) and one
30
+ misconception description from `config.json["descs"]`; the highest logit over the question's classes wins.