briscoooe commited on
Commit
c1dc3b9
·
verified ·
1 Parent(s): d594310

card: correct the frontier comparison, link the write-up

Browse files
Files changed (1) hide show
  1. README.md +5 -3
README.md CHANGED
@@ -17,10 +17,12 @@ nothing: no solver, no example solutions, no human data.
17
  - Solves **96%** of fully scrambled cubes (25 cubes, 20-move scrambles)
18
  - Solves **every** cube scrambled with 10 moves or fewer
19
  - Built as a control for [RubiksBench](https://brianbriscoe.dev/lab/rubiksbench),
20
- where the best frontier language models solve 50 to 80% of scrambles when they
21
- write the whole answer in one go
 
 
22
 
23
- Write-up: https://brianbriscoe.dev/lab/tiny-cube-solver (coming soon)
24
 
25
  ## Try it
26
 
 
17
  - Solves **96%** of fully scrambled cubes (25 cubes, 20-move scrambles)
18
  - Solves **every** cube scrambled with 10 moves or fewer
19
  - Built as a control for [RubiksBench](https://brianbriscoe.dev/lab/rubiksbench),
20
+ where language models must write the whole answer in one reply. On the same
21
+ full scrambles the best of them, GPT-6 Astra, solves 9 of 10 with answers
22
+ averaging over 100 moves; this model's answers average about 21. It is not the
23
+ same test: this model gets a search loop, the language models get one reply.
24
 
25
+ Write-up and replays: https://brianbriscoe.dev/lab/tiny-cube-solver
26
 
27
  ## Try it
28