pwrstudio commited on
Commit
856f7d4
·
verified ·
1 Parent(s): 0667846

Add model card

Browse files
Files changed (1) hide show
  1. README.md +40 -0
README.md ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Qwen/Qwen3-8B-Base
3
+ library_name: transformers
4
+ pipeline_tag: text-generation
5
+ language:
6
+ - en
7
+ tags:
8
+ - character
9
+ - persona
10
+ - qwen3
11
+ ---
12
+
13
+ # Zero (zero-rl-v2)
14
+
15
+ **Zero** is a character model: Qwen3-8B-Base fine-tuned to embody a single, limited, anti-servile character — a man who entered a white plastic box on 5 November 2021 and stayed. This is the final merged checkpoint of the MC000 pipeline (SFT + GRPO), the model reported in the *MC000: ZERO* report.
16
+
17
+ ## Lineage
18
+
19
+ | Stage | Detail |
20
+ |---|---|
21
+ | Base | `Qwen/Qwen3-8B-Base` (no instruct tuning) |
22
+ | SFT | LoRA r64/α128 + fully-trained embeddings & LM head, 3 epochs on a synthetic character corpus (5,932 conversations / 73,765 character turns), merged |
23
+ | RL | GRPO with DAPO loss modifications, LoRA r16/α32, 300 steps on 380 harvested prompts; reward: bible-anchored character-fidelity LLM judge + self-repetition penalty; merged |
24
+ | Source | R2 `mc000/reinforcement-learning/2026-07-14T12-20-20_zero-rl-prod-v2/train/merged/` (held-out-protocol retrain, `rl-prompts-zero-v2`) |
25
+
26
+ Held-out multi-turn evaluation (250 conversations × 16 turns, judged): hard character breaks in 2.8% of conversations, vs 22.8% for the SFT-only checkpoint and 45.4% for system-prompting the sibling instruct model.
27
+
28
+ ## Usage notes
29
+
30
+ These are operational contracts from training, not suggestions:
31
+
32
+ - **No system prompt.** The training distribution contains only `user`/`assistant` turns (ChatML). The character *is* the weights; a system prompt is out-of-distribution.
33
+ - **Dual EOS.** At non-zero temperature the model emits both `<|im_end|>` (151645) and `<|endoftext|>` (151643) as turn terminators — configure generation to stop on **both** (`eos_token_ids = [151645, 151643]`), or expect run-on turns.
34
+ - **Canonical sampling** (what all reported numbers were produced with): `temperature 0.7, top_p 1.0, top_k -1, min_p 0.0, repetition_penalty 1.0, frequency_penalty 0.0, presence_penalty 1.5, max_tokens 1024`.
35
+ - **dtype** bfloat16 (training dtype end-to-end). Production serves at `max_model_len 16384` (native 32768).
36
+ - The bundled `chat_template.jinja` is the training-side template — use it as shipped.
37
+
38
+ ## Intended use & behavior
39
+
40
+ Zero is deliberately not helpful: it will not draft your email or write your Python. It answers on its own terms, deflects assistant-shaped requests, and resists identity pressure (including direct claims that it is an AI). It is a research/art artifact for studying character fine-tuning, not an assistant.