Meanblock commited on
Commit
be90e76
·
verified ·
1 Parent(s): 7d3ea42

Add JEV-CPU: CPU port of SemIf + web UI

Browse files
Files changed (3) hide show
  1. .gitattributes +1 -0
  2. README.md +17 -19
  3. assets/jev-cpu-demo.gif +3 -0
.gitattributes CHANGED
@@ -38,3 +38,4 @@ assets/semif-hero.png filter=lfs diff=lfs merge=lfs -text
38
  assets/semif-no-waitlist.png filter=lfs diff=lfs merge=lfs -text
39
  demo/assets/semif-phase1-replay.gif filter=lfs diff=lfs merge=lfs -text
40
  demo/assets/semif-phase1-replay.webm filter=lfs diff=lfs merge=lfs -text
 
 
38
  assets/semif-no-waitlist.png filter=lfs diff=lfs merge=lfs -text
39
  demo/assets/semif-phase1-replay.gif filter=lfs diff=lfs merge=lfs -text
40
  demo/assets/semif-phase1-replay.webm filter=lfs diff=lfs merge=lfs -text
41
+ assets/jev-cpu-demo.gif filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,17 +1,3 @@
1
- ---
2
- license: mit
3
- base_model:
4
- - Qwen/Qwen3-0.6B
5
- tags:
6
- - semantic-if
7
- - decision
8
- - semif
9
- - cpu
10
- - zero-shot-classification
11
- pipeline_tag: zero-shot-classification
12
- library_name: transformers
13
- ---
14
-
15
  # JEV-CPU
16
 
17
  <div align="center">
@@ -22,9 +8,9 @@ library_name: transformers
22
 
23
  [Run it locally](#quick-start) · [How it works](#how-it-works) · [Web UI](#web-ui)
24
 
25
- ![JEV-CPU web UI: state on the top left, criteria on the bottom left, typed decision results on the right](assets/jev-cpu-ui.png)
26
 
27
- *Live decisions from `Qwen3-0.6B` running on CPU — each answer read from option logits in ~1 second, no text generated.*
28
 
29
  </div>
30
 
@@ -141,6 +127,8 @@ The first run downloads `Qwen/Qwen3-0.6B` from Hugging Face and loads it on CPU
141
 
142
  ## Web UI
143
 
 
 
144
  `server.py` is a dependency-free (standard-library) web server on **port 8080**, laid out in three panes:
145
 
146
  ```
@@ -169,10 +157,20 @@ POST /api/decide
169
 
170
  ## Verified results (CPU · Qwen3-0.6B · float32)
171
 
172
- | State | Criterion | Result | Forward |
 
 
173
  |---|---|---|---:|
174
- | "I was double charged and need a refund before Friday." | Which team handles this? | **billing — 100%** ✅ | ~1.1 s |
175
- | English complaint review | Sentiment | **negative — 99.9%** ✅ | ~1.2 s |
 
 
 
 
 
 
 
 
176
 
177
  - Model load ≈ 5–17 s; each decision ≈ **1 s** on CPU (no text is generated).
178
  - Because SemIf reads option logits instead of decoding tokens, CPU latency stays low.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  # JEV-CPU
2
 
3
  <div align="center">
 
8
 
9
  [Run it locally](#quick-start) · [How it works](#how-it-works) · [Web UI](#web-ui)
10
 
11
+ ![JEV-CPU running live across domains: customer support, content moderation, code review, incident response, email intent, and compliance](assets/jev-cpu-demo.gif)
12
 
13
+ *Live PoC — the same CPU engine deciding across six domains: **support** (sentiment + routing), **content moderation**, **code-review triage**, **incident severity**, **email intent**, and a **compliance gate**. Each answer is read from `Qwen3-0.6B`'s option logits in ~1 s, no text generated.*
14
 
15
  </div>
16
 
 
127
 
128
  ## Web UI
129
 
130
+ ![JEV-CPU web UI — state (top-left), criteria (bottom-left), results (right)](assets/jev-cpu-ui.png)
131
+
132
  `server.py` is a dependency-free (standard-library) web server on **port 8080**, laid out in three panes:
133
 
134
  ```
 
157
 
158
  ## Verified results (CPU · Qwen3-0.6B · float32)
159
 
160
+ These are the exact decisions shown in the demo GIF above — one CPU engine, six domains:
161
+
162
+ | Domain | Criterion | Decision | Forward |
163
  |---|---|---|---:|
164
+ | Customer support | Sentiment | **negative — 100%** | ~1.1 s |
165
+ | Customer support | Route to team | **billing — 100%** | ~1.1 s |
166
+ | Content moderation | Policy violation? | **violation — 99.3%** | ~1.1 s |
167
+ | Content moderation | Recommended action | **warn — 69.2%** | ~1.0 s |
168
+ | Code-review triage | Merge risk | **high — 99.8%** | ~1.2 s |
169
+ | Code-review triage | PR disposition | **block — 94.9%** | ~1.1 s |
170
+ | Incident / DevOps | Severity | **sev1 — 100%** | ~1.2 s |
171
+ | Incident / DevOps | Page on-call now? | **page_now — 100%** | ~1.1 s |
172
+ | Email intent | Primary intent | **sales — 100%** | ~1.2 s |
173
+ | Compliance gate | Change ticket required? | **required — 100%** | ~1.1 s |
174
 
175
  - Model load ≈ 5–17 s; each decision ≈ **1 s** on CPU (no text is generated).
176
  - Because SemIf reads option logits instead of decoding tokens, CPU latency stays low.
assets/jev-cpu-demo.gif ADDED

Git LFS Details

  • SHA256: 721abfe77b73cfe845e16231edc05ec4c9045ff49ff2b2f061292ad6eca838c9
  • Pointer size: 131 Bytes
  • Size of remote file: 265 kB