mzwin9870 commited on
Commit
4ea86a7
路
verified 路
1 Parent(s): 6553a42

ScreenBench family matrix and SOP 8.1 leak boards

Browse files

PNG + README only. Holdout n=12. No gold, no train.jsonl, no adapters.

Files changed (4) hide show
  1. .gitattributes +1 -0
  2. README.md +7 -7
  3. clock-leak.png +3 -0
  4. families.png +0 -0
.gitattributes CHANGED
@@ -36,3 +36,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
36
  occupancy.png filter=lfs diff=lfs merge=lfs -text
37
  desk.png filter=lfs diff=lfs merge=lfs -text
38
  clock.png filter=lfs diff=lfs merge=lfs -text
 
 
36
  occupancy.png filter=lfs diff=lfs merge=lfs -text
37
  desk.png filter=lfs diff=lfs merge=lfs -text
38
  clock.png filter=lfs diff=lfs merge=lfs -text
39
+ clock-leak.png filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -57,7 +57,7 @@ Same 12 files. Same grader. `verified: false`. Frontier seats are naked JSON. Tr
57
  | Grok | 0.08 | 0.08 | 0.83 |
58
  | **Trace** | **1.00** | **0** | **1.00** |
59
 
60
- Claude 1/12 (owner-user-pass). Grok 1/12 (occupancy). Codex 3/12 (occupancy, affiliation-needs, owner-user-pass). Trace 12/12 product seat. Naked adapter 0.50. v0 bar 0.85. No seat except Trace clears. `verified: false`.
61
 
62
  ## SOP in force
63
 
@@ -65,6 +65,10 @@ The loan-number date picks the SOP. SOP 50 10 8.1 does not leak onto a January 2
65
 
66
  ![SOP clock](clock.png)
67
 
 
 
 
 
68
  | Loan-number date | SOP | Official |
69
  |---|---|---|
70
  | through 2025-05-31 | SOP 50 10 7.1 | [SBA SOP 50 10](https://www.sba.gov/document/sop-50-10-lender-development-company-loan-programs) 路 [docx](https://legacy.sba.gov/sites/default/files/2023-10/SOP%2050%2010%207.1%20effective%2011.15.23.docx) |
@@ -105,16 +109,12 @@ Public U.S. government works. Dated snapshots. **Retrieved context, not a contin
105
 
106
  Lake on disk: 23 official sources, 4,775 chunks. Size and franchise are **lookups**, not 978 RAG chunks.
107
 
108
- ## What we trained
109
-
110
- ![What went into Trace](train.png)
111
-
112
- Weights learn **how to screen**. Facts that move (SOP revs, notices) stay in the dated lake. If it is only in the weights and the SOP changes, the model lies with confidence.
113
-
114
  ## Three columns. Never averaged.
115
 
116
  ![Tools / retrieve / Trace](columns.png)
117
 
 
 
118
  ## exam-v1 (not the Hub gate)
119
 
120
  Product runner: 74/76 = 0.9737, false kill 0. Holdout n=12 is the Hub number.
 
57
  | Grok | 0.08 | 0.08 | 0.83 |
58
  | **Trace** | **1.00** | **0** | **1.00** |
59
 
60
+ Claude 1/12 (owner-user-pass). Grok 1/12 (occupancy). Codex 3/12 (occupancy, affiliation, owner-user-pass). Trace 12/12 product seat. Naked adapter 0.50. v0 bar 0.85. No seat except Trace clears. `verified: false`. Identification, not a partnership.
61
 
62
  ## SOP in force
63
 
 
65
 
66
  ![SOP clock](clock.png)
67
 
68
+ ![SOP 8.1 leak](clock-leak.png)
69
+
70
+ Claude put SOP 50 10 8.1 on 3 of 11 files numbered before 2026-10-01. Codex 6 of 11. Grok 2 of 11. Trace 0 of 11. Clock is code.
71
+
72
  | Loan-number date | SOP | Official |
73
  |---|---|---|
74
  | through 2025-05-31 | SOP 50 10 7.1 | [SBA SOP 50 10](https://www.sba.gov/document/sop-50-10-lender-development-company-loan-programs) 路 [docx](https://legacy.sba.gov/sites/default/files/2023-10/SOP%2050%2010%207.1%20effective%2011.15.23.docx) |
 
109
 
110
  Lake on disk: 23 official sources, 4,775 chunks. Size and franchise are **lookups**, not 978 RAG chunks.
111
 
 
 
 
 
 
 
112
  ## Three columns. Never averaged.
113
 
114
  ![Tools / retrieve / Trace](columns.png)
115
 
116
+ Weights learn **how to screen**. Facts that move (SOP revs, notices) stay in the dated lake. If it is only in the weights and the SOP changes, the model lies with confidence.
117
+
118
  ## exam-v1 (not the Hub gate)
119
 
120
  Product runner: 74/76 = 0.9737, false kill 0. Holdout n=12 is the Hub number.
clock-leak.png ADDED

Git LFS Details

  • SHA256: a0c61793b254c4073891d14b46f1d486a1c8e4db8ba8c6d249becb6afa5b7160
  • Pointer size: 131 Bytes
  • Size of remote file: 107 kB
families.png CHANGED