husky8 commited on
Commit
76e38e9
·
verified ·
1 Parent(s): 4dd50ab

Add five-environment BrowserGym results

Browse files
Files changed (1) hide show
  1. README.md +5 -1
README.md CHANGED
@@ -12,13 +12,17 @@ tags:
12
 
13
  This checkpoint swaps two rows in Inkling 2 Mini’s output layer. On six paired Brave runs, the model filled a form and added the requested quantity to a cart in a median of **7.93 seconds**, down from **20.34 seconds**. Both checkpoints completed all six runs with identical commands. The test ran on a MacBook Pro using MLX and text descriptions of visible controls. Screenshot-based control and other browsers are untested.
14
 
 
 
 
 
15
  ## Download
16
 
17
  ```sh
18
  hf download husky8/Inkling-2-Fast-Computer-Use --local-dir inkling-browser
19
  ```
20
 
21
- The full checkpoint is about 20 GB. Load the directory with a runtime that supports the original Inkling 2 Mini format. [Benchmark, video and runnable example](https://github.com/jtc268/inkling-2-fast-computer-use)
22
 
23
  ## Weight change
24
 
 
12
 
13
  This checkpoint swaps two rows in Inkling 2 Mini’s output layer. On six paired Brave runs, the model filled a form and added the requested quantity to a cart in a median of **7.93 seconds**, down from **20.34 seconds**. Both checkpoints completed all six runs with identical commands. The test ran on a MacBook Pro using MLX and text descriptions of visible controls. Screenshot-based control and other browsers are untested.
14
 
15
+ ## BrowserGym
16
+
17
+ The original passed 11/20 cases and the edit passed 6/20. Both passed 5. The original alone passed 6, the edit alone passed 1, and both failed 8. Across the 5 joint successes, median completion time was 19.86 s original and 3.84 s edited. Four paired seeds per environment. [Task scores and receipts](https://github.com/jtc268/inkling-2-fast-computer-use#browsergym-accuracy)
18
+
19
  ## Download
20
 
21
  ```sh
22
  hf download husky8/Inkling-2-Fast-Computer-Use --local-dir inkling-browser
23
  ```
24
 
25
+ In an Inkling-compatible computer-use agent, select `husky8/Inkling-2-Fast-Computer-Use` as the model. The agent still supplies observations and executes actions. The full checkpoint is about 20 GB. Load the directory with a runtime that supports the original Inkling 2 Mini format. [Benchmark, video and runnable example](https://github.com/jtc268/inkling-2-fast-computer-use)
26
 
27
  ## Weight change
28