mlboydaisuke commited on
Commit
c27b49c
Β·
verified Β·
1 Parent(s): ccbb2e9

gen-cards: regenerate Use-it block

Browse files
Files changed (1) hide show
  1. README.md +12 -7
README.md CHANGED
@@ -38,19 +38,24 @@ Qwen3-VL pipeline. The zoo's **first GUI-grounding / computer-use model**.
38
  <!-- gen-cards:use-it begin id=holo2-4b (managed by scripts/gen-cards β€” edit cards.json / QuickStart.swift, not this block) -->
39
  ## Use it
40
 
41
- ▢️ **Run it (source)** β€” the [VLChat runner](https://github.com/john-rocky/coreai-kit/tree/main/Examples/VLChat)
 
 
42
  (GUI + CLI, one app for every vision-language model in the catalog):
43
 
44
  ```bash
45
- git clone https://github.com/john-rocky/coreai-kit
46
- open coreai-kit/Examples/VLChat/VLChat.xcodeproj
 
47
  # β†’ Run, then pick "Holo2 4B" in the model picker
48
 
49
  # agents / headless (macOS):
50
  cd coreai-kit/Examples/VLChat
51
- swift run vlchat-cli --model holo2-4b --image screenshot.png --prompt "Localize an element on the GUI image according to my instructions and output a click position as Click(x, y) with x num pixels from the left edge and y num pixels from the top edge. Instruction: click the Submit button."
52
  ```
53
 
 
 
54
  πŸ’» **Build with it** β€” complete; the glue is kit API, copy-paste runs:
55
 
56
  ```swift
@@ -68,7 +73,7 @@ let reply = try await session.respond(to: Prompt {
68
  // or a plain answer for a normal question - all generated on-device
69
  ```
70
 
71
- The take-home is [`Examples/VLChat/Sources/QuickStart.swift`](https://github.com/john-rocky/coreai-kit/blob/main/Examples/VLChat/Sources/QuickStart.swift)
72
  β€” this exact code as one typed function, no UI; the CLI is an argument shell over it, and
73
  the GUI drives the same `KitVisionModel(catalog:)` behind a `LanguageModelSession`.
74
  Holo2 is a GUI-grounding model: feed a screenshot and H Company's localization prompt
@@ -78,10 +83,10 @@ questions like its Qwen3-VL base.
78
 
79
  **Integration checklist**
80
 
81
- - SPM: `https://github.com/john-rocky/coreai-kit` β†’ product **CoreAIKit**
82
  - Info.plist: `NSPhotoLibraryUsageDescription` β€” only if you use PhotosPicker
83
  - Entitlements (iOS): `com.apple.developer.kernel.increased-memory-limit`
84
- - First run downloads the model β€” 5.5 GB (Mac) / 5.5 GB (iPhone) β€” then it loads from the
85
  local cache (Application Support; progress via the `downloadProgress` callback)
86
  - Measure in Release β€” Debug is ~3Γ— slower on per-token host work
87
  <!-- gen-cards:use-it end -->
 
38
  <!-- gen-cards:use-it begin id=holo2-4b (managed by scripts/gen-cards β€” edit cards.json / QuickStart.swift, not this block) -->
39
  ## Use it
40
 
41
+ **New to Core AI? [Start with CoreAIKit 0.7.1](https://github.com/john-rocky/coreai-kit#readme).** Follow its requirements and first-run steps for `qwen3-0.6b`, then open the same release's [ChatDemo](https://github.com/john-rocky/coreai-kit/tree/0.7.1/Examples/ChatDemo). The README records the tested OS/SDK and download size; model and device coverage is stated per example.
42
+
43
+ ▢️ **Run it (source)** β€” the [VLChat runner](https://github.com/john-rocky/coreai-kit/tree/0.7.1/Examples/VLChat)
44
  (GUI + CLI, one app for every vision-language model in the catalog):
45
 
46
  ```bash
47
+ git clone --branch 0.7.1 --depth 1 https://github.com/john-rocky/coreai-kit
48
+ export DEVELOPER_DIR=/Applications/Xcode-27.0.0-RC.app/Contents/Developer
49
+ open -a /Applications/Xcode-27.0.0-RC.app coreai-kit/Examples/VLChat/VLChat.xcodeproj
50
  # β†’ Run, then pick "Holo2 4B" in the model picker
51
 
52
  # agents / headless (macOS):
53
  cd coreai-kit/Examples/VLChat
54
+ swift run -c release vlchat-cli --model holo2-4b --image screenshot.png --prompt "Localize an element on the GUI image according to my instructions and output a click position as Click(x, y) with x num pixels from the left edge and y num pixels from the top edge. Instruction: click the Submit button."
55
  ```
56
 
57
+ Use Xcode build **27A266a** from the release's `.xcode-pin`; adjust the app path if your installation is named differently.
58
+
59
  πŸ’» **Build with it** β€” complete; the glue is kit API, copy-paste runs:
60
 
61
  ```swift
 
73
  // or a plain answer for a normal question - all generated on-device
74
  ```
75
 
76
+ The take-home is [`Examples/VLChat/Sources/QuickStart.swift`](https://github.com/john-rocky/coreai-kit/blob/0.7.1/Examples/VLChat/Sources/QuickStart.swift)
77
  β€” this exact code as one typed function, no UI; the CLI is an argument shell over it, and
78
  the GUI drives the same `KitVisionModel(catalog:)` behind a `LanguageModelSession`.
79
  Holo2 is a GUI-grounding model: feed a screenshot and H Company's localization prompt
 
83
 
84
  **Integration checklist**
85
 
86
+ - SPM: `https://github.com/john-rocky/coreai-kit` (exact **0.7.1**) β†’ product **CoreAIKit**
87
  - Info.plist: `NSPhotoLibraryUsageDescription` β€” only if you use PhotosPicker
88
  - Entitlements (iOS): `com.apple.developer.kernel.increased-memory-limit`
89
+ - First run downloads the model β€” ~5,484 MB (Mac) / ~5,484 MB (iPhone) β€” then it loads from the
90
  local cache (Application Support; progress via the `downloadProgress` callback)
91
  - Measure in Release β€” Debug is ~3Γ— slower on per-token host work
92
  <!-- gen-cards:use-it end -->