stephenlb commited on
Commit
c491ec5
·
verified ·
1 Parent(s): e112dc9

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +5 -4
README.md CHANGED
@@ -11,10 +11,11 @@ tags:
11
 
12
  # System One Model (using Gemma 4 12B)
13
 
14
- `google/gemma-4-12B` with its 262k-token language-model head replaced by a
15
- low dimentional vector that outputs one logit per answer. The decoder is
16
- unchanged. One forward pass gives the 26 logits; questions (`noul`, `choice`,
17
- `score`) are answered by softmax over the logits each question.
 
18
 
19
  Requires `transformers>=5.17`. The repo ships custom code, so pass
20
  `trust_remote_code=True`.
 
11
 
12
  # System One Model (using Gemma 4 12B)
13
 
14
+ Using encoder and decoder from `google/gemma-4-12B` with its 262k-token
15
+ language-model head replaced by a low dimentional vector
16
+ that outputs one logit per answer. One forward pass gives the 26 logits;
17
+ questions (`noul`, `choice`, `score`) are answered by softmax
18
+ over the logits each question.
19
 
20
  Requires `transformers>=5.17`. The repo ships custom code, so pass
21
  `trust_remote_code=True`.