husky8 commited on
Commit
fcd9449
路
verified 路
1 Parent(s): 91ad325

Add the form and cart replication and three-device search results

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -10,6 +10,10 @@ tags:
10
 
11
  # Inkling 2 Fast Browser Use
12
 
 
 
 
 
13
  This project measures browser tasks in Brave. The Mac form-and-cart checkpoint and the RTX 5090 WebArena checkpoint are separate edits. [Ten WebArena results](https://github.com/jtc268/inkling-2-fast-computer-use/blob/main/benchmark/WEBARENA-10.md).
14
 
15
  This checkpoint swaps two rows in Inkling 2 Mini鈥檚 output layer. On six paired Brave runs, the model filled a form and added the requested quantity to a cart in a median of **7.93 seconds**, down from **20.34 seconds**. Both checkpoints completed all six runs with identical commands. The test ran on a MacBook Pro using MLX and text descriptions of visible controls. Screenshot-based control and other browsers are untested.
 
10
 
11
  # Inkling 2 Fast Browser Use
12
 
13
+ A fresh six-case run of this two-row checkpoint on the MacBook Pro measured **2.39脳** end to end, compared with **2.56脳** in the first run. On the repeat the edit passed 6/6, the original passed 4/6, and median time on the four common successes fell from 16.62 s to 6.96 s. The same filmed case measured 1.03脳 on one RTX 5090. [All attempts and fresh video](https://github.com/jtc268/inkling-2-fast-computer-use/blob/main/benchmark/FORM-CART-RECHECK.md)
14
+
15
+ A separate four-row checkpoint passed WebArena search task 274 on three different RTX 5090s, with observed wall-time speedups of 1.52脳, 1.54脳 and 1.55脳. [Search results](https://github.com/jtc268/inkling-2-fast-computer-use/blob/main/benchmark/WEBARENA-SEARCH.md) 路 [Four-row checkpoint](https://huggingface.co/husky8/Inkling-2-Fast-Computer-Use/tree/fa1ef63d66ec9d489dc185cd0a8ca5452a28bfe9)
16
+
17
  This project measures browser tasks in Brave. The Mac form-and-cart checkpoint and the RTX 5090 WebArena checkpoint are separate edits. [Ten WebArena results](https://github.com/jtc268/inkling-2-fast-computer-use/blob/main/benchmark/WEBARENA-10.md).
18
 
19
  This checkpoint swaps two rows in Inkling 2 Mini鈥檚 output layer. On six paired Brave runs, the model filled a form and added the requested quantity to a cart in a median of **7.93 seconds**, down from **20.34 seconds**. Both checkpoints completed all six runs with identical commands. The test ran on a MacBook Pro using MLX and text descriptions of visible controls. Screenshot-based control and other browsers are untested.