dzhang50 commited on
Commit
77e2749
·
verified ·
1 Parent(s): 642dd88

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -2
README.md CHANGED
@@ -94,7 +94,6 @@ Therefore, our results represent a best-effort attempt at a fair comparison.
94
  | Total params | 65B | 550B | **975B** | 816B | 501B |
95
  | Active params | **65B** | 55B | 41B | 42B | 23B |
96
  | Pre-training tokens | 12T | 20T | **45T** | N/A | 23.8T |
97
- | Training FLOPs (6ND) | 4.7e24 | 6.6e24 | **1.1e25** | N/A | 3.3e24 |
98
  | **Knowledge** | | | | | |
99
  | MMLU | 89.6 | *92.0* | *91.3* | ***92.6*** | *92.4* |
100
  | MMLU-Pro | 84.2 | 86.8 | *87.3* | ***88.0*** | *76.5* |
@@ -153,7 +152,6 @@ For our own model and for missing evals, we use our internal fork of [Olmes](htt
153
  | Total params | — | 65B | 225B | **671B** | 284B | 550B |
154
  | Active params | — | **65B** | 23B | 37B | 13B | 55B |
155
  | Training tokens (T) | — | 12T | 30T+ | 15.6T | **32T+** | 20T |
156
- | Training FLOPs (6ND) | — | 4.7e24 | 4.2e24 | 3.5e24 | 2.5e24 | **6.6e24** |
157
  | **World Knowledge** | | | | | | |
158
  | MMLU (MC acc) | 5-shot | *83.7* | *76.6* | *88.3* | 88.7 | **89.1** |
159
  | MMLU-Pro (CoT EM) | 5-shot | *61.5* | *52.2* | *57.8* | 68.3 | **79.1** |
 
94
  | Total params | 65B | 550B | **975B** | 816B | 501B |
95
  | Active params | **65B** | 55B | 41B | 42B | 23B |
96
  | Pre-training tokens | 12T | 20T | **45T** | N/A | 23.8T |
 
97
  | **Knowledge** | | | | | |
98
  | MMLU | 89.6 | *92.0* | *91.3* | ***92.6*** | *92.4* |
99
  | MMLU-Pro | 84.2 | 86.8 | *87.3* | ***88.0*** | *76.5* |
 
152
  | Total params | — | 65B | 225B | **671B** | 284B | 550B |
153
  | Active params | — | **65B** | 23B | 37B | 13B | 55B |
154
  | Training tokens (T) | — | 12T | 30T+ | 15.6T | **32T+** | 20T |
 
155
  | **World Knowledge** | | | | | | |
156
  | MMLU (MC acc) | 5-shot | *83.7* | *76.6* | *88.3* | 88.7 | **89.1** |
157
  | MMLU-Pro (CoT EM) | 5-shot | *61.5* | *52.2* | *57.8* | 68.3 | **79.1** |