krishna765 commited on
Commit
a81d81b
·
verified ·
1 Parent(s): 260c909

Add the deck31b model card. Weights stay on google/gemma-4-31B-it.

Browse files
Files changed (2) hide show
  1. README.md +33 -0
  2. config.json +11 -0
README.md ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: google/gemma-4-31B-it
4
+ tags:
5
+ - decision
6
+ - text-classification
7
+ ---
8
+
9
+ # deck31b
10
+
11
+ deck31b serves frozen `google/gemma-4-31B-it` at revision
12
+ `842da3794eaa0b77d5f08bae87a17459d91ff475`. This repository does not contain
13
+ those weights. The server downloads them and quantizes linear layers to FP8
14
+ e4m3 weights and activations at startup.
15
+
16
+ We did not train the checkpoint. The prompt and letter readout follow the
17
+ public Cygnet recipe (`blockbrain-ai/cygnet-recipe` at
18
+ `81974de878a7385f878be828205c02064f8bc045`), with temperature `3.4`.
19
+
20
+ Code: https://github.com/krishna-gogineni-765/deck31b
21
+
22
+ ```bash
23
+ git clone https://github.com/krishna-gogineni-765/deck31b
24
+ cd deck31b
25
+ python -m venv .venv && source .venv/bin/activate
26
+ python -m pip install --upgrade pip
27
+ python -m pip install --index-url https://download.pytorch.org/whl/cu128 torch==2.11.0
28
+ python -m pip install -e .
29
+ deck31b-serve --host 0.0.0.0 --port 8090
30
+ ```
31
+
32
+ `POST /v1/systemone` supports `noul`, `choice`, and `score`. The base weights
33
+ remain under the Gemma Terms of Use. This server code is Apache-2.0.
config.json ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model_name": "deck31b",
3
+ "base_model": "google/gemma-4-31B-it",
4
+ "base_revision": "842da3794eaa0b77d5f08bae87a17459d91ff475",
5
+ "quantization": "torchao.Float8DynamicActivationFloat8WeightConfig float8_e4m3fn",
6
+ "temperature": 3.4,
7
+ "max_context_tokens": 16384,
8
+ "max_options": 26,
9
+ "readout": "cygnet letter mass, full softmax, p^(1/T)",
10
+ "trained": false
11
+ }