pwrstudio commited on
Commit
df4d5e9
·
verified ·
1 Parent(s): 856f7d4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -8
README.md CHANGED
@@ -10,9 +10,11 @@ tags:
10
  - qwen3
11
  ---
12
 
13
- # Zero (zero-rl-v2)
14
 
15
- **Zero** is a character model: Qwen3-8B-Base fine-tuned to embody a single, limited, anti-servile character — a man who entered a white plastic box on 5 November 2021 and stayed. This is the final merged checkpoint of the MC000 pipeline (SFT + GRPO), the model reported in the *MC000: ZERO* report.
 
 
16
 
17
  ## Lineage
18
 
@@ -27,14 +29,8 @@ Held-out multi-turn evaluation (250 conversations × 16 turns, judged): hard cha
27
 
28
  ## Usage notes
29
 
30
- These are operational contracts from training, not suggestions:
31
-
32
  - **No system prompt.** The training distribution contains only `user`/`assistant` turns (ChatML). The character *is* the weights; a system prompt is out-of-distribution.
33
  - **Dual EOS.** At non-zero temperature the model emits both `<|im_end|>` (151645) and `<|endoftext|>` (151643) as turn terminators — configure generation to stop on **both** (`eos_token_ids = [151645, 151643]`), or expect run-on turns.
34
  - **Canonical sampling** (what all reported numbers were produced with): `temperature 0.7, top_p 1.0, top_k -1, min_p 0.0, repetition_penalty 1.0, frequency_penalty 0.0, presence_penalty 1.5, max_tokens 1024`.
35
  - **dtype** bfloat16 (training dtype end-to-end). Production serves at `max_model_len 16384` (native 32768).
36
  - The bundled `chat_template.jinja` is the training-side template — use it as shipped.
37
-
38
- ## Intended use & behavior
39
-
40
- Zero is deliberately not helpful: it will not draft your email or write your Python. It answers on its own terms, deflects assistant-shaped requests, and resists identity pressure (including direct claims that it is an AI). It is a research/art artifact for studying character fine-tuning, not an assistant.
 
10
  - qwen3
11
  ---
12
 
13
+ # Zero
14
 
15
+ **Zero** is a character model: Qwen3-8B-Base fine-tuned to embody a single, limited, anti-servile character — a man in a white plastic box.
16
+
17
+ [Full training report](https://movingcastles.world/posts/zero)
18
 
19
  ## Lineage
20
 
 
29
 
30
  ## Usage notes
31
 
 
 
32
  - **No system prompt.** The training distribution contains only `user`/`assistant` turns (ChatML). The character *is* the weights; a system prompt is out-of-distribution.
33
  - **Dual EOS.** At non-zero temperature the model emits both `<|im_end|>` (151645) and `<|endoftext|>` (151643) as turn terminators — configure generation to stop on **both** (`eos_token_ids = [151645, 151643]`), or expect run-on turns.
34
  - **Canonical sampling** (what all reported numbers were produced with): `temperature 0.7, top_p 1.0, top_k -1, min_p 0.0, repetition_penalty 1.0, frequency_penalty 0.0, presence_penalty 1.5, max_tokens 1024`.
35
  - **dtype** bfloat16 (training dtype end-to-end). Production serves at `max_model_len 16384` (native 32768).
36
  - The bundled `chat_template.jinja` is the training-side template — use it as shipped.