Feature Extraction
Transformers
Safetensors
modernbert
typed-decisions
decision-index
decision-model
cross-encoder
text-embeddings-inference
sileod commited on
Commit
5ee8d27
·
verified ·
1 Parent(s): 79468f5

correct Tasksource rows to heterogeneous-split probes

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -31,8 +31,8 @@ It is LateOn (~149M parameters) fine-tuned on 512k real decisions covering three
31
 
32
  | Benchmark (1k examples each, same samples for every model) | v0 |
33
  |---|---|
34
- | Tasksource, unseen tasks | 58.9% |
35
- | Tasksource, unseen test tasks | 53.0% |
36
  | Typed Decisions | 42.6% |
37
  | AG News | 73.8% |
38
  | Emotion | 49.0% |
 
31
 
32
  | Benchmark (1k examples each, same samples for every model) | v0 |
33
  |---|---|
34
+ | Tasksource, unseen tasks (all three judgment types) | 46.8% |
35
+ | Tasksource, unseen test tasks (all three judgment types) | 49.7% |
36
  | Typed Decisions | 42.6% |
37
  | AG News | 73.8% |
38
  | Emotion | 49.0% |