husky8 commited on
Commit
077902e
路
verified 路
1 Parent(s): ded2ef4

Embed the benchmark film and rank five verified browser tasks

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -12,15 +12,15 @@ tags:
12
 
13
  ## Five fastest browser tasks
14
 
15
- Fastest verified run per task on an M5 Max MacBook Pro. Both models earned full credit. Edited times link to the weights used for each run.
16
 
17
  | Task | Original Inkling 2 Mini | Edited Inkling 2 Mini | Speedup |
18
  |---|---:|---:|---:|
19
  | Latest completed order total 路 WebArena 190 | 45.89 s | [5.13 s](https://huggingface.co/husky8/Inkling-2-Mini-Fast-Browser-Use/tree/686faa4d1748f0120008ec007dc97677678e1643) | **8.95脳** |
20
  | Latest canceled order total 路 WebArena 188 | 45.75 s | [6.44 s](https://huggingface.co/husky8/Inkling-2-Mini-Fast-Browser-Use/tree/cd27dd36403a165685abd5bf202c326ec9590b20) | **7.10脳** |
21
  | Latest pending order total 路 WebArena 189 | 33.13 s | [5.25 s](https://huggingface.co/husky8/Inkling-2-Mini-Fast-Browser-Use/tree/686faa4d1748f0120008ec007dc97677678e1643) | **6.31脳** |
22
- | Complete an autocomplete field 路 MiniWoB++ 103 | 19.86 s | [3.84 s](https://huggingface.co/husky8/Inkling-2-Mini-Fast-Browser-Use/tree/d4562716ff6d8d0281bf09814a1df0db570f6be3) | **5.18脳** |
23
- | Reply to an email 路 MiniWoB++ 104 | 26.01 s | [5.98 s](https://huggingface.co/husky8/Inkling-2-Mini-Fast-Browser-Use/tree/d4562716ff6d8d0281bf09814a1df0db570f6be3) | **4.35脳** |
24
 
25
  On the completed-order lookup, inference fell from 43.03 s to 2.84 s. The original model generated 1,509 thinking tokens. The edit generated zero. Both made the same clicks and returned $65.32.
26
 
 
12
 
13
  ## Five fastest browser tasks
14
 
15
+ The video shows 13 browser tasks. The table ranks the fastest passing pair for each task across the released checkpoints on an M5 Max MacBook Pro. Both models earned full credit in every row. Each edited time links to its weights.
16
 
17
  | Task | Original Inkling 2 Mini | Edited Inkling 2 Mini | Speedup |
18
  |---|---:|---:|---:|
19
  | Latest completed order total 路 WebArena 190 | 45.89 s | [5.13 s](https://huggingface.co/husky8/Inkling-2-Mini-Fast-Browser-Use/tree/686faa4d1748f0120008ec007dc97677678e1643) | **8.95脳** |
20
  | Latest canceled order total 路 WebArena 188 | 45.75 s | [6.44 s](https://huggingface.co/husky8/Inkling-2-Mini-Fast-Browser-Use/tree/cd27dd36403a165685abd5bf202c326ec9590b20) | **7.10脳** |
21
  | Latest pending order total 路 WebArena 189 | 33.13 s | [5.25 s](https://huggingface.co/husky8/Inkling-2-Mini-Fast-Browser-Use/tree/686faa4d1748f0120008ec007dc97677678e1643) | **6.31脳** |
22
+ | Complete an autocomplete field 路 MiniWoB++ seed 103 | 19.86 s | [3.84 s](https://huggingface.co/husky8/Inkling-2-Mini-Fast-Browser-Use/tree/d4562716ff6d8d0281bf09814a1df0db570f6be3) | **5.18脳** |
23
+ | Reply to an email 路 MiniWoB++ seed 104 | 26.01 s | [5.98 s](https://huggingface.co/husky8/Inkling-2-Mini-Fast-Browser-Use/tree/d4562716ff6d8d0281bf09814a1df0db570f6be3) | **4.35脳** |
24
 
25
  On the completed-order lookup, inference fell from 43.03 s to 2.84 s. The original model generated 1,509 thinking tokens. The edit generated zero. Both made the same clicks and returned $65.32.
26