husky8 commited on
Commit
0ad76d0
路
verified 路
1 Parent(s): 3606260

Use the Browser Use repository name and link the verified reruns

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -11,17 +11,17 @@ tags:
11
  # Inkling 2 Mini Fast Browser Use
12
 
13
  <!-- ordered-browser-release -->
14
- **8.95脳 faster on WebArena鈥檚 completed-order lookup.** On an M5 Max MacBook Pro, stock took 45.89 s and the four-row edit took 5.13 s. Both returned $65.32 with the same clicks. Of the 40.76 seconds saved, 40.19 came from inference. Reversing the run order gave 8.00脳. A clean checkout measured 6.26脳 and 5.64脳. We developed the edit on this task. On RTX 5090 it passed 0/2. [Download the four-row checkpoint](https://huggingface.co/husky8/Inkling-2-Fast-Computer-Use/tree/686faa4d1748f0120008ec007dc97677678e1643) 路 [Paired runs and weight audit](https://github.com/jtc268/inkling-2-fast-computer-use/blob/main/benchmark/WEBARENA-ORDER-CHECKPOINTS.md).
15
 
16
  **Default download.** The main revision swaps the answer and thinking output rows. It passed 6/20 MiniWoB++ cases. Stock passed 11/20. [Task scores](https://github.com/jtc268/inkling-2-fast-computer-use#browsergym-accuracy).
17
 
18
- Across 13 selected tasks that stock and an edited checkpoint both completed, mean time fell from 21.74 s to 9.64 s (2.25脳). The video uses several edits. [Watch the 68-second demo](https://jtc268.github.io/inkling-2-fast-computer-use/) 路 [Timings](https://huggingface.co/husky8/Inkling-2-Fast-Computer-Use/blob/main/benchmark/speedups-timings.json) 路 [All filmed outcomes](https://jtc268.github.io/inkling-2-fast-computer-use/all-runs.html).
19
 
20
- On RTX 5090, stock and the search-submit edit each passed 6/6 runs across three WebArena tasks. Mean time fell from 6.14 s to 3.66 s (1.67脳). [Download the search-submit checkpoint](https://huggingface.co/husky8/Inkling-2-Fast-Computer-Use/tree/89ab0e2a2e260fdb9252702a6509b8a4490884cd).
21
  <!-- /ordered-browser-release -->
22
 
23
  ## Reproduce the results
24
 
25
- The public harness sends visible text and numbered controls to Inkling and executes its commands in Brave. WebArena grades each run. Stock and edited weights use greedy decoding with reasoning effort set to `none`. [Setup, pinned downloads and clean-checkout results](https://github.com/jtc268/inkling-2-fast-computer-use/blob/95306dcbfbafb58a99f018c169943e6fdd01f6e4/benchmark/REPRODUCE-BROWSER.md).
26
 
27
- Independent modification of Thinking Machines Lab鈥檚 Inkling 2 Mini, distributed under Apache 2.0. [Original model](https://huggingface.co/thinkingmachines/Inkling-2-Mini) 路 [Model use policy](https://thinkingmachines.ai/model-acceptable-use-policy/) 路 [Modification notice](https://huggingface.co/husky8/Inkling-2-Fast-Computer-Use/blob/main/NOTICE)
 
11
  # Inkling 2 Mini Fast Browser Use
12
 
13
  <!-- ordered-browser-release -->
14
+ **8.95脳 faster on WebArena鈥檚 completed-order lookup.** On an M5 Max MacBook Pro, stock took 45.89 s and the four-row edit took 5.13 s. Both returned $65.32 with the same clicks. Of the 40.76 seconds saved, 40.19 came from inference. Reversing the run order gave 8.00脳. A clean checkout measured 6.26脳 and 5.64脳. We developed the edit on this task. On RTX 5090 it passed 0/2. [Download the four-row checkpoint](https://huggingface.co/husky8/Inkling-2-Fast-Browser-Use/tree/686faa4d1748f0120008ec007dc97677678e1643) 路 [Paired runs and weight audit](https://github.com/jtc268/inkling-2-fast-computer-use/blob/main/benchmark/WEBARENA-ORDER-CHECKPOINTS.md).
15
 
16
  **Default download.** The main revision swaps the answer and thinking output rows. It passed 6/20 MiniWoB++ cases. Stock passed 11/20. [Task scores](https://github.com/jtc268/inkling-2-fast-computer-use#browsergym-accuracy).
17
 
18
+ Across 13 selected tasks that stock and an edited checkpoint both completed, mean time fell from 21.74 s to 9.64 s (2.25脳). The video uses several edits. [Watch the 68-second demo](https://jtc268.github.io/inkling-2-fast-computer-use/) 路 [Timings](https://huggingface.co/husky8/Inkling-2-Fast-Browser-Use/blob/main/benchmark/speedups-timings.json) 路 [All filmed outcomes](https://jtc268.github.io/inkling-2-fast-computer-use/all-runs.html).
19
 
20
+ On RTX 5090, stock and the search-submit edit each passed 6/6 runs across three WebArena tasks. Mean time fell from 6.14 s to 3.66 s (1.67脳). [Download the search-submit checkpoint](https://huggingface.co/husky8/Inkling-2-Fast-Browser-Use/tree/89ab0e2a2e260fdb9252702a6509b8a4490884cd).
21
  <!-- /ordered-browser-release -->
22
 
23
  ## Reproduce the results
24
 
25
+ The public harness sends visible text and numbered controls to Inkling and executes its commands in Brave. WebArena grades each run. Stock and edited weights use greedy decoding with reasoning effort set to `none`. [Setup, pinned downloads and clean-checkout results](https://github.com/jtc268/inkling-2-fast-computer-use/blob/ab2a1781eb3d60b22cd32aa69e9bcf908b759fa7/benchmark/REPRODUCE-BROWSER.md).
26
 
27
+ Independent modification of Thinking Machines Lab鈥檚 Inkling 2 Mini, distributed under Apache 2.0. [Original model](https://huggingface.co/thinkingmachines/Inkling-2-Mini) 路 [Model use policy](https://thinkingmachines.ai/model-acceptable-use-policy/) 路 [Modification notice](https://huggingface.co/husky8/Inkling-2-Fast-Browser-Use/blob/main/NOTICE)