Add the deck31b model card. Weights stay on google/gemma-4-31B-it.
Browse files- README.md +33 -0
- config.json +11 -0
README.md
ADDED
|
@@ -0,0 +1,33 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
base_model: google/gemma-4-31B-it
|
| 4 |
+
tags:
|
| 5 |
+
- decision
|
| 6 |
+
- text-classification
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# deck31b
|
| 10 |
+
|
| 11 |
+
deck31b serves frozen `google/gemma-4-31B-it` at revision
|
| 12 |
+
`842da3794eaa0b77d5f08bae87a17459d91ff475`. This repository does not contain
|
| 13 |
+
those weights. The server downloads them and quantizes linear layers to FP8
|
| 14 |
+
e4m3 weights and activations at startup.
|
| 15 |
+
|
| 16 |
+
We did not train the checkpoint. The prompt and letter readout follow the
|
| 17 |
+
public Cygnet recipe (`blockbrain-ai/cygnet-recipe` at
|
| 18 |
+
`81974de878a7385f878be828205c02064f8bc045`), with temperature `3.4`.
|
| 19 |
+
|
| 20 |
+
Code: https://github.com/krishna-gogineni-765/deck31b
|
| 21 |
+
|
| 22 |
+
```bash
|
| 23 |
+
git clone https://github.com/krishna-gogineni-765/deck31b
|
| 24 |
+
cd deck31b
|
| 25 |
+
python -m venv .venv && source .venv/bin/activate
|
| 26 |
+
python -m pip install --upgrade pip
|
| 27 |
+
python -m pip install --index-url https://download.pytorch.org/whl/cu128 torch==2.11.0
|
| 28 |
+
python -m pip install -e .
|
| 29 |
+
deck31b-serve --host 0.0.0.0 --port 8090
|
| 30 |
+
```
|
| 31 |
+
|
| 32 |
+
`POST /v1/systemone` supports `noul`, `choice`, and `score`. The base weights
|
| 33 |
+
remain under the Gemma Terms of Use. This server code is Apache-2.0.
|
config.json
ADDED
|
@@ -0,0 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model_name": "deck31b",
|
| 3 |
+
"base_model": "google/gemma-4-31B-it",
|
| 4 |
+
"base_revision": "842da3794eaa0b77d5f08bae87a17459d91ff475",
|
| 5 |
+
"quantization": "torchao.Float8DynamicActivationFloat8WeightConfig float8_e4m3fn",
|
| 6 |
+
"temperature": 3.4,
|
| 7 |
+
"max_context_tokens": 16384,
|
| 8 |
+
"max_options": 26,
|
| 9 |
+
"readout": "cygnet letter mass, full softmax, p^(1/T)",
|
| 10 |
+
"trained": false
|
| 11 |
+
}
|