jondurbin commited on
Commit
99f061c
·
verified ·
1 Parent(s): 20552ae

Update model card and export table

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -65,8 +65,8 @@ never modified or removed.
65
 
66
  | Export | Tokens | Step | Size | Exported (UTC) |
67
  |---|---:|---:|---:|---|
68
- | [`901B-tokens_step73973_6a749265`](https://huggingface.co/chutesai/parallax-8b-lambda/tree/main/exports/901B-tokens_step73973_6a749265) | 901.5B | 73973 | 2.43 GB | 2026-10-10 02:45 |
69
  | [`901B-tokens_step73973_fc88abba`](https://huggingface.co/chutesai/parallax-8b-lambda/tree/main/exports/901B-tokens_step73973_fc88abba) | 901.5B | 73973 | 2.43 GB | 2026-10-10 01:44 |
 
70
  | [`901B-tokens_step73973_b08bb757`](https://huggingface.co/chutesai/parallax-8b-lambda/tree/main/exports/901B-tokens_step73973_b08bb757) | 901.5B | 73973 | 2.43 GB | 2026-10-10 02:18 |
71
  | [`901B-tokens_step73973`](https://huggingface.co/chutesai/parallax-8b-lambda/tree/main/exports/901B-tokens_step73973) | 901.5B | 73973 | 2.43 GB | 2026-10-10 01:17 |
72
  | [`900B-tokens_step73973`](https://huggingface.co/chutesai/parallax-8b-lambda/tree/main/exports/900B-tokens_step73973) **final** | 900.8B | 73973 | 2.43 GB | 2026-10-10 00:45 |
@@ -342,7 +342,7 @@ never modified or removed.
342
  | [`13B-tokens_step1419`](https://huggingface.co/chutesai/parallax-8b-lambda/tree/main/exports/13B-tokens_step1419) | 13.3B | 1419 | 2.50 GB | 2026-10-04 09:42 |
343
  | [`6B-tokens_step635`](https://huggingface.co/chutesai/parallax-8b-lambda/tree/main/exports/6B-tokens_step635) | 6.6B | 635 | 2.50 GB | 2026-10-04 08:41 |
344
 
345
- - This table lists the exports only. Validation loss and benchmark results for this run are shown on the live training dashboard.
346
 
347
  ## Final checkpoint
348
 
@@ -504,7 +504,7 @@ quantizes expert lookup tables to 8 bits and is slightly approximate; `lut` and
504
  ## Tech report
505
 
506
  The Parallax tech report: [https://parallax.chutes.ai/tech-report.pdf](https://parallax.chutes.ai/tech-report.pdf). It is AI-generated from the project's
507
- measurements and logs, and it is a living document that changes as the run progresses. The report currently published there describes an earlier run of the same system; lambda's architecture and training recipe are as described on this card.
508
 
509
  ## Limitations
510
 
@@ -515,4 +515,4 @@ alignment or safety tuning, and it is small and far from converged.
515
 
516
  MIT.
517
 
518
- <sub>Table updated 2026-10-10 02:53 UTC.</sub>
 
65
 
66
  | Export | Tokens | Step | Size | Exported (UTC) |
67
  |---|---:|---:|---:|---|
 
68
  | [`901B-tokens_step73973_fc88abba`](https://huggingface.co/chutesai/parallax-8b-lambda/tree/main/exports/901B-tokens_step73973_fc88abba) | 901.5B | 73973 | 2.43 GB | 2026-10-10 01:44 |
69
+ | [`901B-tokens_step73973_6a749265`](https://huggingface.co/chutesai/parallax-8b-lambda/tree/main/exports/901B-tokens_step73973_6a749265) | 901.5B | 73973 | 2.43 GB | 2026-10-10 02:45 |
70
  | [`901B-tokens_step73973_b08bb757`](https://huggingface.co/chutesai/parallax-8b-lambda/tree/main/exports/901B-tokens_step73973_b08bb757) | 901.5B | 73973 | 2.43 GB | 2026-10-10 02:18 |
71
  | [`901B-tokens_step73973`](https://huggingface.co/chutesai/parallax-8b-lambda/tree/main/exports/901B-tokens_step73973) | 901.5B | 73973 | 2.43 GB | 2026-10-10 01:17 |
72
  | [`900B-tokens_step73973`](https://huggingface.co/chutesai/parallax-8b-lambda/tree/main/exports/900B-tokens_step73973) **final** | 900.8B | 73973 | 2.43 GB | 2026-10-10 00:45 |
 
342
  | [`13B-tokens_step1419`](https://huggingface.co/chutesai/parallax-8b-lambda/tree/main/exports/13B-tokens_step1419) | 13.3B | 1419 | 2.50 GB | 2026-10-04 09:42 |
343
  | [`6B-tokens_step635`](https://huggingface.co/chutesai/parallax-8b-lambda/tree/main/exports/6B-tokens_step635) | 6.6B | 635 | 2.50 GB | 2026-10-04 08:41 |
344
 
345
+ - This table lists the exports only. Final benchmarks of the final checkpoint, in percent, from the same lm-eval harness used for every model in the comparison: 35.4 on MMLU (cloze, 5-shot), 46.5 on ARC-Challenge (5-shot), 59.8 on HellaSwag (0-shot), and, on the full generative test splits, 14.3 on GSM8K (5-shot), 15.4 on MBPP (3-shot) and 12.2 on HumanEval (pass@1). No statistically significant aggregate difference was detected among the three late exports (paired 95% confidence intervals). The tech report has the full comparison, including other public base models.
346
 
347
  ## Final checkpoint
348
 
 
504
  ## Tech report
505
 
506
  The Parallax tech report: [https://parallax.chutes.ai/tech-report.pdf](https://parallax.chutes.ai/tech-report.pdf). It is AI-generated from the project's
507
+ measurements and logs, and it is a living document that changes as the run progresses. It describes lambda, including the end of training and the final benchmark comparison.
508
 
509
  ## Limitations
510
 
 
515
 
516
  MIT.
517
 
518
+ <sub>Table updated 2026-10-10 11:19 UTC.</sub>