TanmaySah commited on
Commit
bb6f1c5
·
verified ·
1 Parent(s): 68eff24

docs: convert LaTeX syntax to clean Unicode for Hugging Face Markdown rendering

Browse files
Files changed (2) hide show
  1. MODEL_CARD.md +35 -34
  2. README.md +35 -34
MODEL_CARD.md CHANGED
@@ -1,10 +1,11 @@
 
1
  # Model Card: InvariantOne-v1
2
 
3
  **Release Version:** `InvariantOne-v1` (Frozen Release)
4
  **Date:** September 24, 2026
5
  **License:** Apache-2.0
6
  **Base Backbone:** `Qwen/Qwen3.5-4B-Base` (Revision `1001bb4d826a52d1f399e183466143f4da7b741b`, Native BF16)
7
- **Primary Checkpoint:** $D_5$-L4 ($N_{\text{op}}=16$, Seed 42 Primary; Replicated across Seeds 43, 44)
8
 
9
  ---
10
 
@@ -14,8 +15,8 @@
14
 
15
  Standard autoregressive language models suffer from severe position, length, and order biases when evaluating multiple-choice candidate decisions. `InvariantOne-v1` solves this structural failure through a decoupled comparative architecture:
16
  1. **Candidate-Independent Scoring:** Each candidate action is scored independently conditioned on context, eliminating candidate order sensitivity and cross-option attention artifacts.
17
- 2. **Analytic Distributional Equivariance:** Option-span pooled representations pass through a lightweight direct comparative projection head, producing logits normalized via softmax to guarantee exact permutation equivariance over candidate distributions ($\text{Mean TVD} = 0.000000$).
18
- 3. **Upper-Layer Relational Pre-Adaptation:** Parameter-efficient adaptation (LoRA on layers 28–31) trained across a diverse relational operator universe ($N_{\text{op}}=16$) instills strong, transferable relational reasoning capabilities into the comparative readout.
19
 
20
  ```
21
  Context + Option_i ---> [Qwen3.5-4B (Frozen Layers 0-27 + LoRA Layers 28-31)]
@@ -35,28 +36,28 @@ Context + Option_i ---> [Qwen3.5-4B (Frozen Layers 0-27 + LoRA Layers 28-31)]
35
 
36
  | Parameter | Specification |
37
  | :--- | :--- |
38
- | **Base Model** | `Qwen/Qwen3.5-4B-Base` (32 transformer layers, $d_{\text{model}} = 2560$) |
39
  | **Backbone Status** | Layers 0–27 strictly frozen (zero parameter updates) |
40
- | **Adaptation** | Low-Rank Adaptation (LoRA) on upper layers 28–31: $r = 8, \alpha = 16$ (layers 28–30: `in_proj_qkv`, `out_proj`; layer 31: `q_proj`, `v_proj`, `o_proj`) |
41
  | **Active LoRA Parameters** | 585,728 parameters |
42
- | **Readout Head** | `DirectComparativeHead`: Linear($2560 \to 256$) $\to$ GELU $\to$ LayerNorm($256$) $\to$ Linear($256 \to 1$) |
43
  | **Active Head Parameters** | 722,177 parameters |
44
- | **Total Active Adapted Parameters** | 1,307,905 parameters ($<0.05\%$ of base model) |
45
  | **Pooling Method** | Option-span mean pooling over candidate option token span |
46
- | **Scoring Scheme** | Independent candidate scoring with comparative readout: $P(y = i \mid x, \{o_k\}) = \frac{\exp(s_i / \tau^*)}{\sum_{j=1}^K \exp(s_j / \tau^*)}$ |
47
- | **Calibration Temperature** | $\tau^* = 1.0091$ (pre-calibrated on validation split) |
48
 
49
  ### Cryptographic Checkpoint Signatures
50
 
51
- * **Primary Checkpoint (`Seed 42`, $N_{\text{op}}=16$)**:
52
  - LoRA Weights: `checkpoints/invariantone-v1/adapter_model.pt` (Frozen Phase 7R research checkpoint)
53
  - SHA-256: `a0000d3ec984d155fbad5abc854556904ecffe78b997900b677a8d8d5811e4d2`
54
  - Head Weights: `checkpoints/invariantone-v1/head.pt` (Frozen Phase 7R research checkpoint)
55
  - SHA-256: `190d867dc302a89d420d19a8374a5db252ea2e71e4f40c68064ded23fc321384`
56
- * **Replication Checkpoint (`Seed 43`, $N_{\text{op}}=16$)**:
57
  - LoRA: `checkpoints/invariantone-v1/adapter_model_seed43.pt` (Frozen Phase 7R research checkpoint)
58
  - Head: `checkpoints/invariantone-v1/head_seed43.pt` (Frozen Phase 7R research checkpoint)
59
- * **Replication Checkpoint (`Seed 44`, $N_{\text{op}}=16$)**:
60
  - LoRA: `checkpoints/invariantone-v1/adapter_model_seed44.pt` (Frozen Phase 7R research checkpoint)
61
  - Head: `checkpoints/invariantone-v1/head_seed44.pt` (Frozen Phase 7R research checkpoint)
62
 
@@ -64,21 +65,21 @@ Context + Option_i ---> [Qwen3.5-4B (Frozen Layers 0-27 + LoRA Layers 28-31)]
64
 
65
  ## 3. Verified Performance & Benchmark Evaluation
66
 
67
- `InvariantOne-v1` was evaluated on `FINAL-HOLDOUT-V2` ($1,536$ four-choice items) under strict preregistered one-shot governance. Prior to inference, SHA-256 checksums of all strata were verified against the locked manifest (`final_holdout_v2_manifest.json`).
68
 
69
- > **Scope Note on Candidate Options Count ($K$):**
70
- > The runtime supports arbitrary $K \ge 2$; the reported scientific evaluation results are for $K=4$ unless otherwise stated. Experimental generalization to arbitrary $K$ has not been independently established in the scientific benchmarks.
71
 
72
  ### Definitive Benchmark Summary
73
 
74
- | Stratum | Evaluation Focus | $D_0$ (Baseline) | $B_1$-Raw | $B_1$-Sym (24-Perm) | `InvariantOne-v1` (Seed 42) | `InvariantOne-v1` (Mean $\pm$ SD) |
75
  | :--- | :--- | :---: | :---: | :---: | :---: | :---: |
76
- | **`FINAL-REAL`** | Real operational control tasks ($N=256$) | 89.45% | 91.41% | 92.58% | **94.14%** | **93.36% $\pm$ 1.35%** |
77
- | **`FINAL-L1`** | Familiar-Operator Compositional Recombination ($N=256$) | 32.81% | 38.28% | 43.75% | **89.84%** | **89.32% $\pm$ 0.45%** |
78
- | **`FINAL-L2a`** | Semantic Extrapolation ($N=256$) | 28.12% | 45.31% | 50.39% | **86.33%** | **87.76% $\pm$ 2.48%** |
79
- | **`FINAL-L2b`** | Relational Extrapolation ($N=256$) | 22.27% | 62.50% | **65.23%** | 55.08% | 53.91% $\pm$ 2.03% |
80
- | **`FINAL-L3`** | Double Extrapolation ($N=512$) | 25.20% | 60.94% | **65.43%** | 56.84% | 54.10% $\pm$ 4.91% |
81
- | **`Aggregate`** | Total locked holdout pool ($N=1,536$) | 37.17% | 59.90% | 63.80% | **73.18%** (1,124/1,536) | **71.74% $\pm$ 1.97%** |
82
 
83
  ### Counterfactual Sensitivity & Minimal-Pair Tracking
84
 
@@ -94,30 +95,30 @@ Context + Option_i ---> [Qwen3.5-4B (Frozen Layers 0-27 + LoRA Layers 28-31)]
94
  ## 4. Invariance Guarantees & Systems Efficiency
95
 
96
  ### Structural Invariance Audit
97
- * **Distributional Equivariance**: Mean TVD = **$0.000000$**, Max TVD = **$0.000000$** across all 24 option permutations on 128 samples ($3,072$ evaluations).
98
- * **Top-1 Tie-Breaking Instability**: $1.56\%$ top-choice flips under permutation, caused strictly by floating-point precision ties at decision boundaries under argmax selection. The underlying probabilistic output distribution is strictly equivariant.
99
 
100
  ### Computational Efficiency (Measured on NVIDIA A100-SXM4-40GB)
101
  * **Benchmark Provenance Note:** A100 performance figures are from the frozen FINAL-HOLDOUT-V2 benchmarking run; release-wheel functionality was independently smoke-tested in a fresh Python 3.12 environment.
102
- * **Forward Passes**: 4 candidate forward passes per sample vs 24 full-context forward passes for $B_1$-Sym ($6.0\times$ reduction).
103
- * **Wall-Clock Latency**: **$83.71\text{ ms}$** vs **$425.31\text{ ms}$** ($B_1$-Sym) $\implies$ **$5.08\times$ speedup**.
104
- * **Throughput**: **$11.95\text{ samples/sec}$** vs **$2.35\text{ samples/sec}$** ($B_1$-Sym).
105
- * **Peak VRAM**: **$8,941.2\text{ MB}$** vs **$14,614.2\text{ MB}$** ($B_1$-Sym) $\implies$ **$38.8\%$ memory footprint reduction**.
106
 
107
  ---
108
 
109
  ## 5. Capabilities vs Frontier Boundaries
110
 
111
  ### Confirmed Capabilities
112
- 1. **Real-Task Decision Accuracy**: Outperforms unadapted baselines and 24-permutation causal scoring on real operational decision tasks ($94.14\%$).
113
- 2. **Compositional Recombination**: Excels at counterfactual state tracking and rule execution for learned operator families ($89.84\%$ accuracy, $99.12\%$ override switch rate).
114
- 3. **Semantic Domain Generalization**: Robustly transfers learned relational operators to completely novel technical and engineering domains ($86.33\%$, $+35.94$ points over $B_1$-Sym).
115
- 4. **Order-Equivariant Efficiency**: Eliminates position bias with zero prompt permutation overhead, achieving $5.08\times$ lower latency than permutation averaging.
116
 
117
  ### Localized Frontier Limitations
118
- 1. **Zero-Shot Novel Operator Grammars**: Performance drops to $55.08\%$ on $L_{2b}$ and $56.84\%$ on $L_3$. While $D_5$ rescues independent candidate comparative scoring from near-chance baseline failure ($D_0 = 25.20\%$, $\Delta = +31.64$ points), exhaustive permutation-averaged full-context causal inference ($B_1$-Sym $= 65.43\%$) retains an $8.59$-point advantage on completely novel relational operators.
119
  2. **Mechanistic Hypothesis**: The observed advantage is consistent with a benefit from joint full-context token processing, but the evaluation does not establish this as the unique causal mechanism.
120
- 3. **Capacity Ceiling ($N_{\text{op}}=16$ vs $N_{\text{op}}=32$)**: Training with 32 operator families saturates held-out transfer ($+1.37\%$ on $L_3$, $p=0.2075$) while causing substantial in-distribution catastrophic degradation on $L_1$ ($75.52\%$ vs $89.32\%$). $N_{\text{op}}=16$ was selected as the frozen Pareto operating point under the fixed D5-L4 adaptation budget.
121
 
122
  ---
123
 
 
1
+
2
  # Model Card: InvariantOne-v1
3
 
4
  **Release Version:** `InvariantOne-v1` (Frozen Release)
5
  **Date:** September 24, 2026
6
  **License:** Apache-2.0
7
  **Base Backbone:** `Qwen/Qwen3.5-4B-Base` (Revision `1001bb4d826a52d1f399e183466143f4da7b741b`, Native BF16)
8
+ **Primary Checkpoint:** D5-L4 (N_op=16, Seed 42 Primary; Replicated across Seeds 43, 44)
9
 
10
  ---
11
 
 
15
 
16
  Standard autoregressive language models suffer from severe position, length, and order biases when evaluating multiple-choice candidate decisions. `InvariantOne-v1` solves this structural failure through a decoupled comparative architecture:
17
  1. **Candidate-Independent Scoring:** Each candidate action is scored independently conditioned on context, eliminating candidate order sensitivity and cross-option attention artifacts.
18
+ 2. **Analytic Distributional Equivariance:** Option-span pooled representations pass through a lightweight direct comparative projection head, producing logits normalized via softmax to guarantee exact permutation equivariance over candidate distributions (Mean TVD = 0.000000).
19
+ 3. **Upper-Layer Relational Pre-Adaptation:** Parameter-efficient adaptation (LoRA on layers 28–31) trained across a diverse relational operator universe (N_op=16) instills strong, transferable relational reasoning capabilities into the comparative readout.
20
 
21
  ```
22
  Context + Option_i ---> [Qwen3.5-4B (Frozen Layers 0-27 + LoRA Layers 28-31)]
 
36
 
37
  | Parameter | Specification |
38
  | :--- | :--- |
39
+ | **Base Model** | `Qwen/Qwen3.5-4B-Base` (32 transformer layers, d_model = 2560) |
40
  | **Backbone Status** | Layers 0–27 strictly frozen (zero parameter updates) |
41
+ | **Adaptation** | Low-Rank Adaptation (LoRA) on upper layers 28–31: r = 8, α = 16 (layers 28–30: `in_proj_qkv`, `out_proj`; layer 31: `q_proj`, `v_proj`, `o_proj`) |
42
  | **Active LoRA Parameters** | 585,728 parameters |
43
+ | **Readout Head** | `DirectComparativeHead`: Linear(2560 → 256) → GELU → LayerNorm(256) → Linear(256 → 1) |
44
  | **Active Head Parameters** | 722,177 parameters |
45
+ | **Total Active Adapted Parameters** | 1,307,905 parameters (<0.05% of base model) |
46
  | **Pooling Method** | Option-span mean pooling over candidate option token span |
47
+ | **Scoring Scheme** | Independent candidate scoring with comparative readout: `P(y = i | x, {o_k}) = exp(s_i / τ*) / Σ_j exp(s_j / τ*)` |
48
+ | **Calibration Temperature** | τ* = 1.0091 (pre-calibrated on validation split) |
49
 
50
  ### Cryptographic Checkpoint Signatures
51
 
52
+ * **Primary Checkpoint (`Seed 42`, N_op=16)**:
53
  - LoRA Weights: `checkpoints/invariantone-v1/adapter_model.pt` (Frozen Phase 7R research checkpoint)
54
  - SHA-256: `a0000d3ec984d155fbad5abc854556904ecffe78b997900b677a8d8d5811e4d2`
55
  - Head Weights: `checkpoints/invariantone-v1/head.pt` (Frozen Phase 7R research checkpoint)
56
  - SHA-256: `190d867dc302a89d420d19a8374a5db252ea2e71e4f40c68064ded23fc321384`
57
+ * **Replication Checkpoint (`Seed 43`, N_op=16)**:
58
  - LoRA: `checkpoints/invariantone-v1/adapter_model_seed43.pt` (Frozen Phase 7R research checkpoint)
59
  - Head: `checkpoints/invariantone-v1/head_seed43.pt` (Frozen Phase 7R research checkpoint)
60
+ * **Replication Checkpoint (`Seed 44`, N_op=16)**:
61
  - LoRA: `checkpoints/invariantone-v1/adapter_model_seed44.pt` (Frozen Phase 7R research checkpoint)
62
  - Head: `checkpoints/invariantone-v1/head_seed44.pt` (Frozen Phase 7R research checkpoint)
63
 
 
65
 
66
  ## 3. Verified Performance & Benchmark Evaluation
67
 
68
+ `InvariantOne-v1` was evaluated on `FINAL-HOLDOUT-V2` (1,536 four-choice items) under strict preregistered one-shot governance. Prior to inference, SHA-256 checksums of all strata were verified against the locked manifest (`final_holdout_v2_manifest.json`).
69
 
70
+ > **Scope Note on Candidate Options Count (K):**
71
+ > The runtime supports arbitrary K ≥ 2; the reported scientific evaluation results are for K=4 unless otherwise stated. Experimental generalization to arbitrary K has not been independently established in the scientific benchmarks.
72
 
73
  ### Definitive Benchmark Summary
74
 
75
+ | Stratum | Evaluation Focus | D0 (Baseline) | B1-Raw | B1-Sym (24-Perm) | `InvariantOne-v1` (Seed 42) | `InvariantOne-v1` (Mean ± SD) |
76
  | :--- | :--- | :---: | :---: | :---: | :---: | :---: |
77
+ | **`FINAL-REAL`** | Real operational control tasks (N=256) | 89.45% | 91.41% | 92.58% | **94.14%** | **93.36% ± 1.35%** |
78
+ | **`FINAL-L1`** | Familiar-Operator Compositional Recombination (N=256) | 32.81% | 38.28% | 43.75% | **89.84%** | **89.32% ± 0.45%** |
79
+ | **`FINAL-L2a`** | Semantic Extrapolation (N=256) | 28.12% | 45.31% | 50.39% | **86.33%** | **87.76% ± 2.48%** |
80
+ | **`FINAL-L2b`** | Relational Extrapolation (N=256) | 22.27% | 62.50% | **65.23%** | 55.08% | 53.91% ± 2.03% |
81
+ | **`FINAL-L3`** | Double Extrapolation (N=512) | 25.20% | 60.94% | **65.43%** | 56.84% | 54.10% ± 4.91% |
82
+ | **`Aggregate`** | Total locked holdout pool (N=1,536) | 37.17% | 59.90% | 63.80% | **73.18%** (1,124/1,536) | **71.74% ± 1.97%** |
83
 
84
  ### Counterfactual Sensitivity & Minimal-Pair Tracking
85
 
 
95
  ## 4. Invariance Guarantees & Systems Efficiency
96
 
97
  ### Structural Invariance Audit
98
+ * **Distributional Equivariance**: Mean TVD = **0.000000**, Max TVD = **0.000000** across all 24 option permutations on 128 samples (3,072 evaluations).
99
+ * **Top-1 Tie-Breaking Instability**: 1.56% top-choice flips under permutation, caused strictly by floating-point precision ties at decision boundaries under argmax selection. The underlying probabilistic output distribution is strictly equivariant.
100
 
101
  ### Computational Efficiency (Measured on NVIDIA A100-SXM4-40GB)
102
  * **Benchmark Provenance Note:** A100 performance figures are from the frozen FINAL-HOLDOUT-V2 benchmarking run; release-wheel functionality was independently smoke-tested in a fresh Python 3.12 environment.
103
+ * **Forward Passes**: 4 candidate forward passes per sample vs 24 full-context forward passes for B1-Sym (6.0× reduction).
104
+ * **Wall-Clock Latency**: **83.71 ms** vs **425.31 ms** (B1-Sym) ⟹ **5.08× speedup**.
105
+ * **Throughput**: **11.95 samples/sec** vs **2.35 samples/sec** (B1-Sym).
106
+ * **Peak VRAM**: **8,941.2 MB** vs **14,614.2 MB** (B1-Sym) ⟹ **38.8% memory footprint reduction**.
107
 
108
  ---
109
 
110
  ## 5. Capabilities vs Frontier Boundaries
111
 
112
  ### Confirmed Capabilities
113
+ 1. **Real-Task Decision Accuracy**: Outperforms unadapted baselines and 24-permutation causal scoring on real operational decision tasks (94.14%).
114
+ 2. **Compositional Recombination**: Excels at counterfactual state tracking and rule execution for learned operator families (89.84% accuracy, 99.12% override switch rate).
115
+ 3. **Semantic Domain Generalization**: Robustly transfers learned relational operators to completely novel technical and engineering domains (86.33%, +35.94 points over B1-Sym).
116
+ 4. **Order-Equivariant Efficiency**: Eliminates position bias with zero prompt permutation overhead, achieving 5.08× lower latency than permutation averaging.
117
 
118
  ### Localized Frontier Limitations
119
+ 1. **Zero-Shot Novel Operator Grammars**: Performance drops to 55.08% on L_2b and 56.84% on L_3. While D5 rescues independent candidate comparative scoring from near-chance baseline failure (D0 = 25.20%, Δ = +31.64 points), exhaustive permutation-averaged full-context causal inference (B1-Sym = 65.43%) retains an 8.59-point advantage on completely novel relational operators.
120
  2. **Mechanistic Hypothesis**: The observed advantage is consistent with a benefit from joint full-context token processing, but the evaluation does not establish this as the unique causal mechanism.
121
+ 3. **Capacity Ceiling (N_op=16 vs N_op=32)**: Training with 32 operator families saturates held-out transfer (+1.37% on L_3, p=0.2075) while causing substantial in-distribution catastrophic degradation on L_1 (75.52% vs 89.32%). N_op=16 was selected as the frozen Pareto operating point under the fixed D5-L4 adaptation budget.
122
 
123
  ---
124
 
README.md CHANGED
@@ -12,13 +12,14 @@ tags:
12
  - qwen
13
  ---
14
 
 
15
  # Model Card: InvariantOne-v1
16
 
17
  **Release Version:** `InvariantOne-v1` (Frozen Release)
18
  **Date:** September 24, 2026
19
  **License:** Apache-2.0
20
  **Base Backbone:** `Qwen/Qwen3.5-4B-Base` (Revision `1001bb4d826a52d1f399e183466143f4da7b741b`, Native BF16)
21
- **Primary Checkpoint:** $D_5$-L4 ($N_{\text{op}}=16$, Seed 42 Primary; Replicated across Seeds 43, 44)
22
 
23
  ---
24
 
@@ -28,8 +29,8 @@ tags:
28
 
29
  Standard autoregressive language models suffer from severe position, length, and order biases when evaluating multiple-choice candidate decisions. `InvariantOne-v1` solves this structural failure through a decoupled comparative architecture:
30
  1. **Candidate-Independent Scoring:** Each candidate action is scored independently conditioned on context, eliminating candidate order sensitivity and cross-option attention artifacts.
31
- 2. **Analytic Distributional Equivariance:** Option-span pooled representations pass through a lightweight direct comparative projection head, producing logits normalized via softmax to guarantee exact permutation equivariance over candidate distributions ($\text{Mean TVD} = 0.000000$).
32
- 3. **Upper-Layer Relational Pre-Adaptation:** Parameter-efficient adaptation (LoRA on layers 28–31) trained across a diverse relational operator universe ($N_{\text{op}}=16$) instills strong, transferable relational reasoning capabilities into the comparative readout.
33
 
34
  ```
35
  Context + Option_i ---> [Qwen3.5-4B (Frozen Layers 0-27 + LoRA Layers 28-31)]
@@ -49,28 +50,28 @@ Context + Option_i ---> [Qwen3.5-4B (Frozen Layers 0-27 + LoRA Layers 28-31)]
49
 
50
  | Parameter | Specification |
51
  | :--- | :--- |
52
- | **Base Model** | `Qwen/Qwen3.5-4B-Base` (32 transformer layers, $d_{\text{model}} = 2560$) |
53
  | **Backbone Status** | Layers 0–27 strictly frozen (zero parameter updates) |
54
- | **Adaptation** | Low-Rank Adaptation (LoRA) on upper layers 28–31: $r = 8, \alpha = 16$ (layers 28–30: `in_proj_qkv`, `out_proj`; layer 31: `q_proj`, `v_proj`, `o_proj`) |
55
  | **Active LoRA Parameters** | 585,728 parameters |
56
- | **Readout Head** | `DirectComparativeHead`: Linear($2560 \to 256$) $\to$ GELU $\to$ LayerNorm($256$) $\to$ Linear($256 \to 1$) |
57
  | **Active Head Parameters** | 722,177 parameters |
58
- | **Total Active Adapted Parameters** | 1,307,905 parameters ($<0.05\%$ of base model) |
59
  | **Pooling Method** | Option-span mean pooling over candidate option token span |
60
- | **Scoring Scheme** | Independent candidate scoring with comparative readout: $P(y = i \mid x, \{o_k\}) = \frac{\exp(s_i / \tau^*)}{\sum_{j=1}^K \exp(s_j / \tau^*)}$ |
61
- | **Calibration Temperature** | $\tau^* = 1.0091$ (pre-calibrated on validation split) |
62
 
63
  ### Cryptographic Checkpoint Signatures
64
 
65
- * **Primary Checkpoint (`Seed 42`, $N_{\text{op}}=16$)**:
66
  - LoRA Weights: `checkpoints/invariantone-v1/adapter_model.pt` (Frozen Phase 7R research checkpoint)
67
  - SHA-256: `a0000d3ec984d155fbad5abc854556904ecffe78b997900b677a8d8d5811e4d2`
68
  - Head Weights: `checkpoints/invariantone-v1/head.pt` (Frozen Phase 7R research checkpoint)
69
  - SHA-256: `190d867dc302a89d420d19a8374a5db252ea2e71e4f40c68064ded23fc321384`
70
- * **Replication Checkpoint (`Seed 43`, $N_{\text{op}}=16$)**:
71
  - LoRA: `checkpoints/invariantone-v1/adapter_model_seed43.pt` (Frozen Phase 7R research checkpoint)
72
  - Head: `checkpoints/invariantone-v1/head_seed43.pt` (Frozen Phase 7R research checkpoint)
73
- * **Replication Checkpoint (`Seed 44`, $N_{\text{op}}=16$)**:
74
  - LoRA: `checkpoints/invariantone-v1/adapter_model_seed44.pt` (Frozen Phase 7R research checkpoint)
75
  - Head: `checkpoints/invariantone-v1/head_seed44.pt` (Frozen Phase 7R research checkpoint)
76
 
@@ -78,21 +79,21 @@ Context + Option_i ---> [Qwen3.5-4B (Frozen Layers 0-27 + LoRA Layers 28-31)]
78
 
79
  ## 3. Verified Performance & Benchmark Evaluation
80
 
81
- `InvariantOne-v1` was evaluated on `FINAL-HOLDOUT-V2` ($1,536$ four-choice items) under strict preregistered one-shot governance. Prior to inference, SHA-256 checksums of all strata were verified against the locked manifest (`final_holdout_v2_manifest.json`).
82
 
83
- > **Scope Note on Candidate Options Count ($K$):**
84
- > The runtime supports arbitrary $K \ge 2$; the reported scientific evaluation results are for $K=4$ unless otherwise stated. Experimental generalization to arbitrary $K$ has not been independently established in the scientific benchmarks.
85
 
86
  ### Definitive Benchmark Summary
87
 
88
- | Stratum | Evaluation Focus | $D_0$ (Baseline) | $B_1$-Raw | $B_1$-Sym (24-Perm) | `InvariantOne-v1` (Seed 42) | `InvariantOne-v1` (Mean $\pm$ SD) |
89
  | :--- | :--- | :---: | :---: | :---: | :---: | :---: |
90
- | **`FINAL-REAL`** | Real operational control tasks ($N=256$) | 89.45% | 91.41% | 92.58% | **94.14%** | **93.36% $\pm$ 1.35%** |
91
- | **`FINAL-L1`** | Familiar-Operator Compositional Recombination ($N=256$) | 32.81% | 38.28% | 43.75% | **89.84%** | **89.32% $\pm$ 0.45%** |
92
- | **`FINAL-L2a`** | Semantic Extrapolation ($N=256$) | 28.12% | 45.31% | 50.39% | **86.33%** | **87.76% $\pm$ 2.48%** |
93
- | **`FINAL-L2b`** | Relational Extrapolation ($N=256$) | 22.27% | 62.50% | **65.23%** | 55.08% | 53.91% $\pm$ 2.03% |
94
- | **`FINAL-L3`** | Double Extrapolation ($N=512$) | 25.20% | 60.94% | **65.43%** | 56.84% | 54.10% $\pm$ 4.91% |
95
- | **`Aggregate`** | Total locked holdout pool ($N=1,536$) | 37.17% | 59.90% | 63.80% | **73.18%** (1,124/1,536) | **71.74% $\pm$ 1.97%** |
96
 
97
  ### Counterfactual Sensitivity & Minimal-Pair Tracking
98
 
@@ -108,30 +109,30 @@ Context + Option_i ---> [Qwen3.5-4B (Frozen Layers 0-27 + LoRA Layers 28-31)]
108
  ## 4. Invariance Guarantees & Systems Efficiency
109
 
110
  ### Structural Invariance Audit
111
- * **Distributional Equivariance**: Mean TVD = **$0.000000$**, Max TVD = **$0.000000$** across all 24 option permutations on 128 samples ($3,072$ evaluations).
112
- * **Top-1 Tie-Breaking Instability**: $1.56\%$ top-choice flips under permutation, caused strictly by floating-point precision ties at decision boundaries under argmax selection. The underlying probabilistic output distribution is strictly equivariant.
113
 
114
  ### Computational Efficiency (Measured on NVIDIA A100-SXM4-40GB)
115
  * **Benchmark Provenance Note:** A100 performance figures are from the frozen FINAL-HOLDOUT-V2 benchmarking run; release-wheel functionality was independently smoke-tested in a fresh Python 3.12 environment.
116
- * **Forward Passes**: 4 candidate forward passes per sample vs 24 full-context forward passes for $B_1$-Sym ($6.0\times$ reduction).
117
- * **Wall-Clock Latency**: **$83.71\text{ ms}$** vs **$425.31\text{ ms}$** ($B_1$-Sym) $\implies$ **$5.08\times$ speedup**.
118
- * **Throughput**: **$11.95\text{ samples/sec}$** vs **$2.35\text{ samples/sec}$** ($B_1$-Sym).
119
- * **Peak VRAM**: **$8,941.2\text{ MB}$** vs **$14,614.2\text{ MB}$** ($B_1$-Sym) $\implies$ **$38.8\%$ memory footprint reduction**.
120
 
121
  ---
122
 
123
  ## 5. Capabilities vs Frontier Boundaries
124
 
125
  ### Confirmed Capabilities
126
- 1. **Real-Task Decision Accuracy**: Outperforms unadapted baselines and 24-permutation causal scoring on real operational decision tasks ($94.14\%$).
127
- 2. **Compositional Recombination**: Excels at counterfactual state tracking and rule execution for learned operator families ($89.84\%$ accuracy, $99.12\%$ override switch rate).
128
- 3. **Semantic Domain Generalization**: Robustly transfers learned relational operators to completely novel technical and engineering domains ($86.33\%$, $+35.94$ points over $B_1$-Sym).
129
- 4. **Order-Equivariant Efficiency**: Eliminates position bias with zero prompt permutation overhead, achieving $5.08\times$ lower latency than permutation averaging.
130
 
131
  ### Localized Frontier Limitations
132
- 1. **Zero-Shot Novel Operator Grammars**: Performance drops to $55.08\%$ on $L_{2b}$ and $56.84\%$ on $L_3$. While $D_5$ rescues independent candidate comparative scoring from near-chance baseline failure ($D_0 = 25.20\%$, $\Delta = +31.64$ points), exhaustive permutation-averaged full-context causal inference ($B_1$-Sym $= 65.43\%$) retains an $8.59$-point advantage on completely novel relational operators.
133
  2. **Mechanistic Hypothesis**: The observed advantage is consistent with a benefit from joint full-context token processing, but the evaluation does not establish this as the unique causal mechanism.
134
- 3. **Capacity Ceiling ($N_{\text{op}}=16$ vs $N_{\text{op}}=32$)**: Training with 32 operator families saturates held-out transfer ($+1.37\%$ on $L_3$, $p=0.2075$) while causing substantial in-distribution catastrophic degradation on $L_1$ ($75.52\%$ vs $89.32\%$). $N_{\text{op}}=16$ was selected as the frozen Pareto operating point under the fixed D5-L4 adaptation budget.
135
 
136
  ---
137
 
 
12
  - qwen
13
  ---
14
 
15
+
16
  # Model Card: InvariantOne-v1
17
 
18
  **Release Version:** `InvariantOne-v1` (Frozen Release)
19
  **Date:** September 24, 2026
20
  **License:** Apache-2.0
21
  **Base Backbone:** `Qwen/Qwen3.5-4B-Base` (Revision `1001bb4d826a52d1f399e183466143f4da7b741b`, Native BF16)
22
+ **Primary Checkpoint:** D5-L4 (N_op=16, Seed 42 Primary; Replicated across Seeds 43, 44)
23
 
24
  ---
25
 
 
29
 
30
  Standard autoregressive language models suffer from severe position, length, and order biases when evaluating multiple-choice candidate decisions. `InvariantOne-v1` solves this structural failure through a decoupled comparative architecture:
31
  1. **Candidate-Independent Scoring:** Each candidate action is scored independently conditioned on context, eliminating candidate order sensitivity and cross-option attention artifacts.
32
+ 2. **Analytic Distributional Equivariance:** Option-span pooled representations pass through a lightweight direct comparative projection head, producing logits normalized via softmax to guarantee exact permutation equivariance over candidate distributions (Mean TVD = 0.000000).
33
+ 3. **Upper-Layer Relational Pre-Adaptation:** Parameter-efficient adaptation (LoRA on layers 28–31) trained across a diverse relational operator universe (N_op=16) instills strong, transferable relational reasoning capabilities into the comparative readout.
34
 
35
  ```
36
  Context + Option_i ---> [Qwen3.5-4B (Frozen Layers 0-27 + LoRA Layers 28-31)]
 
50
 
51
  | Parameter | Specification |
52
  | :--- | :--- |
53
+ | **Base Model** | `Qwen/Qwen3.5-4B-Base` (32 transformer layers, d_model = 2560) |
54
  | **Backbone Status** | Layers 0–27 strictly frozen (zero parameter updates) |
55
+ | **Adaptation** | Low-Rank Adaptation (LoRA) on upper layers 28–31: r = 8, α = 16 (layers 28–30: `in_proj_qkv`, `out_proj`; layer 31: `q_proj`, `v_proj`, `o_proj`) |
56
  | **Active LoRA Parameters** | 585,728 parameters |
57
+ | **Readout Head** | `DirectComparativeHead`: Linear(2560 → 256) → GELU → LayerNorm(256) → Linear(256 → 1) |
58
  | **Active Head Parameters** | 722,177 parameters |
59
+ | **Total Active Adapted Parameters** | 1,307,905 parameters (<0.05% of base model) |
60
  | **Pooling Method** | Option-span mean pooling over candidate option token span |
61
+ | **Scoring Scheme** | Independent candidate scoring with comparative readout: `P(y = i | x, {o_k}) = exp(s_i / τ*) / Σ_j exp(s_j / τ*)` |
62
+ | **Calibration Temperature** | τ* = 1.0091 (pre-calibrated on validation split) |
63
 
64
  ### Cryptographic Checkpoint Signatures
65
 
66
+ * **Primary Checkpoint (`Seed 42`, N_op=16)**:
67
  - LoRA Weights: `checkpoints/invariantone-v1/adapter_model.pt` (Frozen Phase 7R research checkpoint)
68
  - SHA-256: `a0000d3ec984d155fbad5abc854556904ecffe78b997900b677a8d8d5811e4d2`
69
  - Head Weights: `checkpoints/invariantone-v1/head.pt` (Frozen Phase 7R research checkpoint)
70
  - SHA-256: `190d867dc302a89d420d19a8374a5db252ea2e71e4f40c68064ded23fc321384`
71
+ * **Replication Checkpoint (`Seed 43`, N_op=16)**:
72
  - LoRA: `checkpoints/invariantone-v1/adapter_model_seed43.pt` (Frozen Phase 7R research checkpoint)
73
  - Head: `checkpoints/invariantone-v1/head_seed43.pt` (Frozen Phase 7R research checkpoint)
74
+ * **Replication Checkpoint (`Seed 44`, N_op=16)**:
75
  - LoRA: `checkpoints/invariantone-v1/adapter_model_seed44.pt` (Frozen Phase 7R research checkpoint)
76
  - Head: `checkpoints/invariantone-v1/head_seed44.pt` (Frozen Phase 7R research checkpoint)
77
 
 
79
 
80
  ## 3. Verified Performance & Benchmark Evaluation
81
 
82
+ `InvariantOne-v1` was evaluated on `FINAL-HOLDOUT-V2` (1,536 four-choice items) under strict preregistered one-shot governance. Prior to inference, SHA-256 checksums of all strata were verified against the locked manifest (`final_holdout_v2_manifest.json`).
83
 
84
+ > **Scope Note on Candidate Options Count (K):**
85
+ > The runtime supports arbitrary K ≥ 2; the reported scientific evaluation results are for K=4 unless otherwise stated. Experimental generalization to arbitrary K has not been independently established in the scientific benchmarks.
86
 
87
  ### Definitive Benchmark Summary
88
 
89
+ | Stratum | Evaluation Focus | D0 (Baseline) | B1-Raw | B1-Sym (24-Perm) | `InvariantOne-v1` (Seed 42) | `InvariantOne-v1` (Mean ± SD) |
90
  | :--- | :--- | :---: | :---: | :---: | :---: | :---: |
91
+ | **`FINAL-REAL`** | Real operational control tasks (N=256) | 89.45% | 91.41% | 92.58% | **94.14%** | **93.36% ± 1.35%** |
92
+ | **`FINAL-L1`** | Familiar-Operator Compositional Recombination (N=256) | 32.81% | 38.28% | 43.75% | **89.84%** | **89.32% ± 0.45%** |
93
+ | **`FINAL-L2a`** | Semantic Extrapolation (N=256) | 28.12% | 45.31% | 50.39% | **86.33%** | **87.76% ± 2.48%** |
94
+ | **`FINAL-L2b`** | Relational Extrapolation (N=256) | 22.27% | 62.50% | **65.23%** | 55.08% | 53.91% ± 2.03% |
95
+ | **`FINAL-L3`** | Double Extrapolation (N=512) | 25.20% | 60.94% | **65.43%** | 56.84% | 54.10% ± 4.91% |
96
+ | **`Aggregate`** | Total locked holdout pool (N=1,536) | 37.17% | 59.90% | 63.80% | **73.18%** (1,124/1,536) | **71.74% ± 1.97%** |
97
 
98
  ### Counterfactual Sensitivity & Minimal-Pair Tracking
99
 
 
109
  ## 4. Invariance Guarantees & Systems Efficiency
110
 
111
  ### Structural Invariance Audit
112
+ * **Distributional Equivariance**: Mean TVD = **0.000000**, Max TVD = **0.000000** across all 24 option permutations on 128 samples (3,072 evaluations).
113
+ * **Top-1 Tie-Breaking Instability**: 1.56% top-choice flips under permutation, caused strictly by floating-point precision ties at decision boundaries under argmax selection. The underlying probabilistic output distribution is strictly equivariant.
114
 
115
  ### Computational Efficiency (Measured on NVIDIA A100-SXM4-40GB)
116
  * **Benchmark Provenance Note:** A100 performance figures are from the frozen FINAL-HOLDOUT-V2 benchmarking run; release-wheel functionality was independently smoke-tested in a fresh Python 3.12 environment.
117
+ * **Forward Passes**: 4 candidate forward passes per sample vs 24 full-context forward passes for B1-Sym (6.0× reduction).
118
+ * **Wall-Clock Latency**: **83.71 ms** vs **425.31 ms** (B1-Sym) ⟹ **5.08× speedup**.
119
+ * **Throughput**: **11.95 samples/sec** vs **2.35 samples/sec** (B1-Sym).
120
+ * **Peak VRAM**: **8,941.2 MB** vs **14,614.2 MB** (B1-Sym) ⟹ **38.8% memory footprint reduction**.
121
 
122
  ---
123
 
124
  ## 5. Capabilities vs Frontier Boundaries
125
 
126
  ### Confirmed Capabilities
127
+ 1. **Real-Task Decision Accuracy**: Outperforms unadapted baselines and 24-permutation causal scoring on real operational decision tasks (94.14%).
128
+ 2. **Compositional Recombination**: Excels at counterfactual state tracking and rule execution for learned operator families (89.84% accuracy, 99.12% override switch rate).
129
+ 3. **Semantic Domain Generalization**: Robustly transfers learned relational operators to completely novel technical and engineering domains (86.33%, +35.94 points over B1-Sym).
130
+ 4. **Order-Equivariant Efficiency**: Eliminates position bias with zero prompt permutation overhead, achieving 5.08× lower latency than permutation averaging.
131
 
132
  ### Localized Frontier Limitations
133
+ 1. **Zero-Shot Novel Operator Grammars**: Performance drops to 55.08% on L_2b and 56.84% on L_3. While D5 rescues independent candidate comparative scoring from near-chance baseline failure (D0 = 25.20%, Δ = +31.64 points), exhaustive permutation-averaged full-context causal inference (B1-Sym = 65.43%) retains an 8.59-point advantage on completely novel relational operators.
134
  2. **Mechanistic Hypothesis**: The observed advantage is consistent with a benefit from joint full-context token processing, but the evaluation does not establish this as the unique causal mechanism.
135
+ 3. **Capacity Ceiling (N_op=16 vs N_op=32)**: Training with 32 operator families saturates held-out transfer (+1.37% on L_3, p=0.2075) while causing substantial in-distribution catastrophic degradation on L_1 (75.52% vs 89.32%). N_op=16 was selected as the frozen Pareto operating point under the fixed D5-L4 adaptation budget.
136
 
137
  ---
138