Document crown licenses and add device-first quickstart

#1
by bitzic - opened
Files changed (4) hide show
  1. LICENSE +202 -0
  2. NOTICE +163 -0
  3. README.md +131 -28
  4. crowns.json +65 -49
LICENSE ADDED
@@ -0,0 +1,202 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ Apache License
3
+ Version 2.0, January 2004
4
+ http://www.apache.org/licenses/
5
+
6
+ TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
7
+
8
+ 1. Definitions.
9
+
10
+ "License" shall mean the terms and conditions for use, reproduction,
11
+ and distribution as defined by Sections 1 through 9 of this document.
12
+
13
+ "Licensor" shall mean the copyright owner or entity authorized by
14
+ the copyright owner that is granting the License.
15
+
16
+ "Legal Entity" shall mean the union of the acting entity and all
17
+ other entities that control, are controlled by, or are under common
18
+ control with that entity. For the purposes of this definition,
19
+ "control" means (i) the power, direct or indirect, to cause the
20
+ direction or management of such entity, whether by contract or
21
+ otherwise, or (ii) ownership of fifty percent (50%) or more of the
22
+ outstanding shares, or (iii) beneficial ownership of such entity.
23
+
24
+ "You" (or "Your") shall mean an individual or Legal Entity
25
+ exercising permissions granted by this License.
26
+
27
+ "Source" form shall mean the preferred form for making modifications,
28
+ including but not limited to software source code, documentation
29
+ source, and configuration files.
30
+
31
+ "Object" form shall mean any form resulting from mechanical
32
+ transformation or translation of a Source form, including but
33
+ not limited to compiled object code, generated documentation,
34
+ and conversions to other media types.
35
+
36
+ "Work" shall mean the work of authorship, whether in Source or
37
+ Object form, made available under the License, as indicated by a
38
+ copyright notice that is included in or attached to the work
39
+ (an example is provided in the Appendix below).
40
+
41
+ "Derivative Works" shall mean any work, whether in Source or Object
42
+ form, that is based on (or derived from) the Work and for which the
43
+ editorial revisions, annotations, elaborations, or other modifications
44
+ represent, as a whole, an original work of authorship. For the purposes
45
+ of this License, Derivative Works shall not include works that remain
46
+ separable from, or merely link (or bind by name) to the interfaces of,
47
+ the Work and Derivative Works thereof.
48
+
49
+ "Contribution" shall mean any work of authorship, including
50
+ the original version of the Work and any modifications or additions
51
+ to that Work or Derivative Works thereof, that is intentionally
52
+ submitted to Licensor for inclusion in the Work by the copyright owner
53
+ or by an individual or Legal Entity authorized to submit on behalf of
54
+ the copyright owner. For the purposes of this definition, "submitted"
55
+ means any form of electronic, verbal, or written communication sent
56
+ to the Licensor or its representatives, including but not limited to
57
+ communication on electronic mailing lists, source code control systems,
58
+ and issue tracking systems that are managed by, or on behalf of, the
59
+ Licensor for the purpose of discussing and improving the Work, but
60
+ excluding communication that is conspicuously marked or otherwise
61
+ designated in writing by the copyright owner as "Not a Contribution."
62
+
63
+ "Contributor" shall mean Licensor and any individual or Legal Entity
64
+ on behalf of whom a Contribution has been received by Licensor and
65
+ subsequently incorporated within the Work.
66
+
67
+ 2. Grant of Copyright License. Subject to the terms and conditions of
68
+ this License, each Contributor hereby grants to You a perpetual,
69
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
70
+ copyright license to reproduce, prepare Derivative Works of,
71
+ publicly display, publicly perform, sublicense, and distribute the
72
+ Work and such Derivative Works in Source or Object form.
73
+
74
+ 3. Grant of Patent License. Subject to the terms and conditions of
75
+ this License, each Contributor hereby grants to You a perpetual,
76
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
77
+ (except as stated in this section) patent license to make, have made,
78
+ use, offer to sell, sell, import, and otherwise transfer the Work,
79
+ where such license applies only to those patent claims licensable
80
+ by such Contributor that are necessarily infringed by their
81
+ Contribution(s) alone or by combination of their Contribution(s)
82
+ with the Work to which such Contribution(s) was submitted. If You
83
+ institute patent litigation against any entity (including a
84
+ cross-claim or counterclaim in a lawsuit) alleging that the Work
85
+ or a Contribution incorporated within the Work constitutes direct
86
+ or contributory patent infringement, then any patent licenses
87
+ granted to You under this License for that Work shall terminate
88
+ as of the date such litigation is filed.
89
+
90
+ 4. Redistribution. You may reproduce and distribute copies of the
91
+ Work or Derivative Works thereof in any medium, with or without
92
+ modifications, and in Source or Object form, provided that You
93
+ meet the following conditions:
94
+
95
+ (a) You must give any other recipients of the Work or
96
+ Derivative Works a copy of this License; and
97
+
98
+ (b) You must cause any modified files to carry prominent notices
99
+ stating that You changed the files; and
100
+
101
+ (c) You must retain, in the Source form of any Derivative Works
102
+ that You distribute, all copyright, patent, trademark, and
103
+ attribution notices from the Source form of the Work,
104
+ excluding those notices that do not pertain to any part of
105
+ the Derivative Works; and
106
+
107
+ (d) If the Work includes a "NOTICE" text file as part of its
108
+ distribution, then any Derivative Works that You distribute must
109
+ include a readable copy of the attribution notices contained
110
+ within such NOTICE file, excluding those notices that do not
111
+ pertain to any part of the Derivative Works, in at least one
112
+ of the following places: within a NOTICE text file distributed
113
+ as part of the Derivative Works; within the Source form or
114
+ documentation, if provided along with the Derivative Works; or,
115
+ within a display generated by the Derivative Works, if and
116
+ wherever such third-party notices normally appear. The contents
117
+ of the NOTICE file are for informational purposes only and
118
+ do not modify the License. You may add Your own attribution
119
+ notices within Derivative Works that You distribute, alongside
120
+ or as an addendum to the NOTICE text from the Work, provided
121
+ that such additional attribution notices cannot be construed
122
+ as modifying the License.
123
+
124
+ You may add Your own copyright statement to Your modifications and
125
+ may provide additional or different license terms and conditions
126
+ for use, reproduction, or distribution of Your modifications, or
127
+ for any such Derivative Works as a whole, provided Your use,
128
+ reproduction, and distribution of the Work otherwise complies with
129
+ the conditions stated in this License.
130
+
131
+ 5. Submission of Contributions. Unless You explicitly state otherwise,
132
+ any Contribution intentionally submitted for inclusion in the Work
133
+ by You to the Licensor shall be under the terms and conditions of
134
+ this License, without any additional terms or conditions.
135
+ Notwithstanding the above, nothing herein shall supersede or modify
136
+ the terms of any separate license agreement you may have executed
137
+ with Licensor regarding such Contributions.
138
+
139
+ 6. Trademarks. This License does not grant permission to use the trade
140
+ names, trademarks, service marks, or product names of the Licensor,
141
+ except as required for reasonable and customary use in describing the
142
+ origin of the Work and reproducing the content of the NOTICE file.
143
+
144
+ 7. Disclaimer of Warranty. Unless required by applicable law or
145
+ agreed to in writing, Licensor provides the Work (and each
146
+ Contributor provides its Contributions) on an "AS IS" BASIS,
147
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
148
+ implied, including, without limitation, any warranties or conditions
149
+ of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
150
+ PARTICULAR PURPOSE. You are solely responsible for determining the
151
+ appropriateness of using or redistributing the Work and assume any
152
+ risks associated with Your exercise of permissions under this License.
153
+
154
+ 8. Limitation of Liability. In no event and under no legal theory,
155
+ whether in tort (including negligence), contract, or otherwise,
156
+ unless required by applicable law (such as deliberate and grossly
157
+ negligent acts) or agreed to in writing, shall any Contributor be
158
+ liable to You for damages, including any direct, indirect, special,
159
+ incidental, or consequential damages of any character arising as a
160
+ result of this License or out of the use or inability to use the
161
+ Work (including but not limited to damages for loss of goodwill,
162
+ work stoppage, computer failure or malfunction, or any and all
163
+ other commercial damages or losses), even if such Contributor
164
+ has been advised of the possibility of such damages.
165
+
166
+ 9. Accepting Warranty or Additional Liability. While redistributing
167
+ the Work or Derivative Works thereof, You may choose to offer,
168
+ and charge a fee for, acceptance of support, warranty, indemnity,
169
+ or other liability obligations and/or rights consistent with this
170
+ License. However, in accepting such obligations, You may act only
171
+ on Your own behalf and on Your sole responsibility, not on behalf
172
+ of any other Contributor, and only if You agree to indemnify,
173
+ defend, and hold each Contributor harmless for any liability
174
+ incurred by, or claims asserted against, such Contributor by reason
175
+ of your accepting any such warranty or additional liability.
176
+
177
+ END OF TERMS AND CONDITIONS
178
+
179
+ APPENDIX: How to apply the Apache License to your work.
180
+
181
+ To apply the Apache License to your work, attach the following
182
+ boilerplate notice, with the fields enclosed by brackets "[]"
183
+ replaced with your own identifying information. (Don't include
184
+ the brackets!) The text should be enclosed in the appropriate
185
+ comment syntax for the file format. We also recommend that a
186
+ file or class name and description of purpose be included on the
187
+ same "printed page" as the copyright notice for easier
188
+ identification within third-party archives.
189
+
190
+ Copyright 2024 Alibaba Cloud
191
+
192
+ Licensed under the Apache License, Version 2.0 (the "License");
193
+ you may not use this file except in compliance with the License.
194
+ You may obtain a copy of the License at
195
+
196
+ http://www.apache.org/licenses/LICENSE-2.0
197
+
198
+ Unless required by applicable law or agreed to in writing, software
199
+ distributed under the License is distributed on an "AS IS" BASIS,
200
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
201
+ See the License for the specific language governing permissions and
202
+ limitations under the License.
NOTICE ADDED
@@ -0,0 +1,163 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ RalphLabsAI/ralph-crowns
2
+
3
+ This repository is a verified mirror of four independently built Ralph crown artifacts. The
4
+ license and notices below apply to the exact GGUF filenames and SHA-256 hashes listed in README.md
5
+ and crowns.json. A later crown replacement is not covered automatically.
6
+
7
+ The source NOTICE files are reproduced below from fixed documentation revisions. The GGUF at each
8
+ documentation revision is byte-identical to the scored source revision and the corresponding file
9
+ in this mirror.
10
+
11
+ ===== BEGIN BINARY SOURCE NOTICE =====
12
+ Source: https://huggingface.co/ArizonaZZZ/ralph-v2-qwen3-8b-binary-p2A2-step500-05c56816
13
+ Scored revision: 29c525c5c3166df2d62d5e180d09255199f778fe
14
+ License-document revision: 74bb2415a8467f56f5d1c89c98f90dfcb4a5f2ac
15
+ Mirrored file: ralph-qwen3-8b-binary.gguf
16
+ SHA-256: 05c568169fc180067172cbdd38c1a9f5c249a556ffdef1dacd7172bad40fab58
17
+
18
+ ralph-v2-qwen3-8b-binary-p2A2-step500 — Copyright (c) 2026 the ArizonaZZZ miner. Apache License 2.0.
19
+
20
+ This artifact incorporates or derives from:
21
+ - Qwen3-8B (Alibaba Cloud), Apache License 2.0 — https://huggingface.co/Qwen/Qwen3-8B/blob/main/LICENSE
22
+ - Bonsai-8B (PrismML), Apache License 2.0 — https://huggingface.co/prism-ml/Bonsai-8B-unpacked
23
+ Scales/norms were fitted on Qwen3-8B generations over prompts from: nvidia/OpenMathReasoning (CC-BY-4.0),
24
+ zake7749/OpenScience-Chinese-Reasoning-SFT (CC-BY-4.0), glaiveai/reasoning-v1-20m (Apache-2.0),
25
+ sarvamai/samvaad-hi-v1 (Apache-2.0), ricdomolm/mini-coder-trajs-400k (MIT). No dataset text is embedded.
26
+ ===== END BINARY SOURCE NOTICE =====
27
+
28
+ ===== BEGIN TERNARY SOURCE NOTICE =====
29
+ Source: https://huggingface.co/tensor-tailor/ralph-qwen3-8b-ternary-r5
30
+ Scored revision: 3e4096acf9ce1eb270ba3897b5d8396425a18884
31
+ License-document revision: 36696e802e237f39a3ec6b15e8aef1596348e069
32
+ Mirrored file: ralph-qwen3-8b-ternary.gguf
33
+ SHA-256: c643cb42575a7a85b7518fd935973202c5686db270ef8b593afa8616a986154a
34
+
35
+ tensor-tailor/ralph-qwen3-8b-ternary-r5
36
+
37
+ This repository contains a bit-compressed derivative of:
38
+
39
+ Qwen3-8B
40
+ Copyright (c) Alibaba Cloud / the Qwen Team
41
+ Licensed under the Apache License, Version 2.0
42
+ https://huggingface.co/Qwen/Qwen3-8B
43
+
44
+ Modifications made by tensor-tailor:
45
+ - Architecture and parameter count unchanged from the parent (8,190,735,360 weight-bearing
46
+ parameters), matching the pinned Ralph SN-40 v2 ParentSpec for the qwen3-8b tier.
47
+ - Weights re-stored in GGUF ternary format, quantized using an importance-matrix (imatrix)
48
+ calibration with llama.cpp's quantization tooling.
49
+ - No retraining, distillation, or architectural modification was performed; this is a
50
+ post-training weight re-storage of the parent's own weights at reduced bit-width.
51
+
52
+ Third-party tooling used:
53
+ - llama.cpp (GGUF format, imatrix-based quantization)
54
+ Licensed under the MIT License - https://github.com/ggml-org/llama.cpp/blob/master/LICENSE
55
+
56
+ Provided per Apache License 2.0 4(d) to preserve the parent's attribution notices. See LICENSE
57
+ for the full license text governing this repository's contents.
58
+ ===== END TERNARY SOURCE NOTICE =====
59
+
60
+ ===== BEGIN SUB2 SOURCE NOTICE =====
61
+ Source: https://huggingface.co/boweizh1204/ralph-qwen3-8b-sub2-qat5
62
+ Scored revision: 261d535f67ba8e59f5d96ce7deeed98243ad8892
63
+ License-document revision: ae95da44fa31dcaedaa77729ae34e00deaf3ff8f
64
+ Mirrored file: ralph-qwen3-8b-sub2.gguf
65
+ SHA-256: 9c45bf0ac486e793bd761a99ce4b9d965ec12e70f2d420e02af16797c71f6b50
66
+
67
+ boweizh1204/ralph-qwen3-8b-sub2-qat5
68
+
69
+ This repository contains a bit-compressed derivative of:
70
+
71
+ Qwen3-8B (Hugging Face revision b968826d9c46dd6066d109eabc6255188de91218)
72
+ Copyright 2024 Alibaba Cloud
73
+ Licensed under the Apache License, Version 2.0
74
+ https://huggingface.co/Qwen/Qwen3-8B
75
+
76
+ Exact artifact covered by this notice:
77
+ model.gguf — 2,937,263,168 bytes, SHA-256 9c45bf0ac486e793bd761a99ce4b9d965ec12e70f2d420e02af16797c71f6b50
78
+ manifest.json — as committed at the revision below
79
+ Hugging Face revision 261d535f67ba8e59f5d96ce7deeed98243ad8892
80
+ Ralph content hash 72136433b8f4613cf794a642b664b28dcbdf054f3e6499f8a6127f490da8cac1
81
+
82
+ Modifications made by boweizh1204 (September 2026):
83
+ - Quantization-aware distillation: rank-64 LoRA adapters on all attention and MLP projections were trained
84
+ through a fake-quantized copy of the model (llama.cpp K-quant grids), with unmodified Qwen3-8B as the
85
+ teacher. Loss: forward KL on the teacher's logits plus 0.3 x cross-entropy on the teacher's greedy token.
86
+ The adapters were merged into the weights.
87
+ - Quantization with llama.cpp llama-quantize: Q2_K for attention q/k, FFN and token embedding; Q4_K for
88
+ attention v and the output head; Q3_K for attention output. The importance matrix was computed on
89
+ Qwen3-8B's own generations.
90
+ - Architecture, tokenizer, chat template and parameter count (8,190,427,136) are unchanged.
91
+ - Ralph SN-40 v2 sub2 tier (caps: 2.3 code bits/weight, 3.0 container bits/weight).
92
+ Measured: 2.2626 code bits/weight, 2.81 container bits/weight.
93
+
94
+ Data used:
95
+ - Training targets and importance-matrix text are Qwen3-8B's own outputs (teacher logits and greedy
96
+ continuations). No third-party model weights or model outputs were used.
97
+ - Training prompts (conversation prefixes) were sampled from the five datasets below. They were used only as
98
+ model inputs and are not redistributed in this repository. These five are the complete list for this artifact.
99
+ 1. glaiveai/reasoning-v1-20m (split train) — Apache-2.0
100
+ https://huggingface.co/datasets/glaiveai/reasoning-v1-20m
101
+ 2. nvidia/OpenMathReasoning (split tir) — CC BY 4.0
102
+ https://huggingface.co/datasets/nvidia/OpenMathReasoning
103
+ 3. ricdomolm/mini-coder-trajs-400k (split train) — MIT
104
+ https://huggingface.co/datasets/ricdomolm/mini-coder-trajs-400k
105
+ 4. sarvamai/samvaad-hi-v1 (split train) — Apache-2.0
106
+ https://huggingface.co/datasets/sarvamai/samvaad-hi-v1
107
+ 5. zake7749/OpenScience-Chinese-Reasoning-SFT (split train) — CC BY 4.0
108
+ https://huggingface.co/datasets/zake7749/OpenScience-Chinese-Reasoning-SFT
109
+ - Attribution: "OpenMathReasoning" by NVIDIA and "OpenScience-Chinese-Reasoning-SFT" by zake7749 are licensed
110
+ under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Excerpts were used as training prompts only;
111
+ the datasets themselves were not modified or redistributed.
112
+
113
+ Third-party tooling used (no tooling code is included in this repository):
114
+ - llama.cpp (conversion, importance matrix, quantization, GGUF runtime) — MIT License
115
+ https://github.com/ggml-org/llama.cpp/blob/master/LICENSE
116
+ - PyTorch (BSD-3-Clause) and Hugging Face Transformers (Apache-2.0) for training
117
+
118
+ Provided per Apache License 2.0 section 4(d) to preserve the parent's attribution notices. See LICENSE
119
+ for the full license text governing this repository's contents.
120
+ ===== END SUB2 SOURCE NOTICE =====
121
+
122
+ ===== BEGIN SUB4 SOURCE NOTICE =====
123
+ Source: https://huggingface.co/boweizh1204/qwen3-8b-ralph-sub4-c1b-20260910
124
+ Scored revision: 3c21306c630dac6440b37ad67b965a4b9b787cf9
125
+ License-document revision: 449619c6f50da88222e86867554cfcd759692661
126
+ Mirrored file: ralph-qwen3-8b-sub4.gguf
127
+ SHA-256: b2ec80dce90258bbe9555a67983dea595d91f35cae48ca0d54c714eae8100edf
128
+
129
+ boweizh1204/qwen3-8b-ralph-sub4-c1b-20260910
130
+
131
+ This repository contains a bit-compressed derivative of:
132
+
133
+ Qwen3-8B
134
+ Copyright 2024 Alibaba Cloud
135
+ Licensed under the Apache License, Version 2.0
136
+ https://huggingface.co/Qwen/Qwen3-8B
137
+
138
+ Exact artifact covered by this notice:
139
+ model.gguf — 4,614,304,896 bytes, SHA-256 b2ec80dce90258bbe9555a67983dea595d91f35cae48ca0d54c714eae8100edf
140
+ Hugging Face revision 3c21306c630dac6440b37ad67b965a4b9b787cf9
141
+
142
+ Modifications made by boweizh1204:
143
+ - Post-training weight re-storage of the parent's own weights: llama.cpp pure Q4_K quantization with an importance-matrix (imatrix) calibration computed on the bf16 parent at 2048-token context over an exam-proportional sample of public trajectory datasets. No retraining, distillation or architectural change.
144
+ - Bit tier: Ralph SN-40 v2 sub4 (gate: code bits <= 4.0 and container bits <= 5.0); validator-measured 4.0 code bits and 4.5 container bits per weight.
145
+
146
+ Data used:
147
+ - Calibration (imatrix activation statistics only; no weights were trained on it and no dataset text is contained in
148
+ model.gguf): calib/mix_exam.txt, 1.2M Qwen3 tokens sampled from rows at index 4,000 onward of exactly five public
149
+ datasets, by token share:
150
+ glaiveai/reasoning-v1-20m (Apache-2.0) ............................ 34%
151
+ nvidia/OpenMathReasoning, tir split (CC-BY-4.0) .................... 20%
152
+ ricdomolm/mini-coder-trajs-400k (MIT) .............................. 13%
153
+ sarvamai/samvaad-hi-v1 (Apache-2.0) ................................ 17%
154
+ zake7749/OpenScience-Chinese-Reasoning-SFT (CC-BY-4.0) ............. 16%
155
+ nvidia/Nemotron-Post-Training-Dataset-v1, AlienKevin/SWE-ZERO-12M-trajectories and open-thoughts/AgentTrove were
156
+ NOT used to produce this artifact.
157
+
158
+ Third-party tooling used:
159
+ - llama.cpp (GGUF format, imatrix and Q4_K quantization) — MIT License, https://github.com/ggml-org/llama.cpp/blob/master/LICENSE
160
+
161
+ Provided per Apache License 2.0 section 4(d) to preserve the parent's attribution notices. See LICENSE
162
+ for the full license text governing this repository's contents.
163
+ ===== END SUB4 SOURCE NOTICE =====
README.md CHANGED
@@ -6,42 +6,145 @@ base_model: Qwen/Qwen3-8B
6
  tags: [gguf, conversational, qwen3, quantized, compression, bittensor]
7
  ---
8
 
9
- # Ralph crowns — Qwen3-8B
 
 
 
10
 
11
- The **reigning crowned compressions** from [Bittensor netuid 40](https://github.com/RalphLabsAI/ralph-v2),
12
- one file per bit tier. Every round re-scores the incumbents against a fresh exam; when a crown
13
- changes hands, the file here changes with it.
14
 
15
- | file | tier | bits/weight | size | retention | round | scored artifact |
16
- |---|---|---|---|---|---|---|
17
- | `ralph-qwen3-8b-binary.gguf` | binary | 1.0 | 1.15 GB | 0.263616 | 7 | [`ArizonaZZZ/ralph-v2-qwen3-8b-binary-p2A2-step500-05c56816`](https://huggingface.co/ArizonaZZZ/ralph-v2-qwen3-8b-binary-p2A2-step500-05c56816) @`29c525c5c316` |
18
- | `ralph-qwen3-8b-ternary.gguf` | ternary | 1.714 | 2.46 GB | 0.253732 | 5 | [`tensor-tailor/ralph-qwen3-8b-ternary-r5`](https://huggingface.co/tensor-tailor/ralph-qwen3-8b-ternary-r5) @`3e4096acf9ce` |
19
- | `ralph-qwen3-8b-sub2.gguf` | sub2 | 2.2626 | 2.88 GB | 0.282457 | 7 | [`boweizh1204/ralph-qwen3-8b-sub2-qat5`](https://huggingface.co/boweizh1204/ralph-qwen3-8b-sub2-qat5) @`261d535f67ba` |
20
- | `ralph-qwen3-8b-sub4.gguf` | sub4 | 4.0 | 4.61 GB | 0.320923 | 7 | [`boweizh1204/qwen3-8b-ralph-sub4-c1b-20260910`](https://huggingface.co/boweizh1204/qwen3-8b-ralph-sub4-c1b-20260910) @`3c21306c630d` |
21
 
22
- ## What "retention" is, and what it is not
 
23
 
24
- Retention measures how much of the **pinned parent's** effect on a third-party observer model each
25
- compression reproduces, aggregated over its **worst** slice of (observer x language x depth) rather
26
- than its average. It is a compression-fidelity measure. **It is not a capability benchmark**, and a
27
- high retention does not by itself mean a model is good at anything in particular.
28
 
29
- Round record, with the exam, every per-sample measurement and the crown decision:
30
- https://huggingface.co/datasets/RalphLabsAI/ralph-v2-rounds/resolve/main/rounds/round-00000007-f42ae20c6ed2a796.json
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
31
 
32
  ## Provenance
33
 
34
- Each file is byte-identical to the artifact the round actually scored: it is downloaded from the
35
- miner's own repo at the **pinned commit** named in the signed record, re-hashed, and published only
36
- if the hash matches the `model_id` in that record. `crowns.json` carries the source repo and
37
- revision for every file, so you can fetch the original and check it yourself.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
38
 
39
- Credit for the weights belongs to the miners named in `crowns.json`. This repo is a verified
40
- mirror with a stable name, not the origin.
41
 
42
- ## Running them
 
 
 
 
 
43
 
44
- Any llama.cpp-based runner. On iPhone, [PocketPal AI](https://github.com/a-ghorbani/pocketpal-ai)
45
- and Enclave AI both load GGUF straight from the Hub — search this repo and pick a file by size.
46
- Note that an 8B at ~4.6 GB is close to the per-app memory ceiling on iOS and needs a Pro device;
47
- the smaller tiers are the ones that fit comfortably.
 
6
  tags: [gguf, conversational, qwen3, quantized, compression, bittensor]
7
  ---
8
 
9
+ <p align="center">
10
+ <img src="https://raw.githubusercontent.com/RalphLabsAI/ralph/main/docs/assets/ralph-banner.png"
11
+ alt="Ralph — open model compression on Bittensor SN40" width="100%">
12
+ </p>
13
 
14
+ # Ralph crowns — Qwen3-8B compressed in public
 
 
15
 
16
+ **Four downloadable GGUFs. One admitted Qwen3-8B architecture. Each file holds a current bit-tier
17
+ crown in Ralph, the open model-compression tournament on Bittensor SN40.**
 
 
 
 
18
 
19
+ The files are published together so users have one stable place to download the current crowns,
20
+ while the source builders and exact scored revisions remain visible.
21
 
22
+ ## Start here: the 2.94 GB sub2 crown
 
 
 
23
 
24
+ `ralph-qwen3-8b-sub2.gguf` is the first file we recommend for a phone test.
25
+
26
+ | | |
27
+ |---|---|
28
+ | Exact size | 2,937,263,168 bytes (2.94 GB decimal) |
29
+ | Code bits / weight | 2.2626 |
30
+ | Crowned | Round 7 |
31
+ | Embedded chat-template key | Yes |
32
+ | SHA-256 | `9c45bf0ac486e793bd761a99ce4b9d965ec12e70f2d420e02af16797c71f6b50` |
33
+
34
+ ```bash
35
+ hf download RalphLabsAI/ralph-crowns ralph-qwen3-8b-sub2.gguf --local-dir ./ralph-crowns
36
+ llama-cli -m ./ralph-crowns/ralph-qwen3-8b-sub2.gguf -cnv --jinja -p "Explain one practical use of low-bit quantization."
37
+ ```
38
+
39
+ ### Find it in PocketPal
40
+
41
+ 1. Open **Models → Add from Hugging Face**.
42
+ 2. Search for **RalphLabsAI**, then open **ralph-crowns**.
43
+ 3. Choose **ralph-qwen3-8b-sub2.gguf**.
44
+
45
+ The repository is discoverable in PocketPal, but discoverability and an embedded template do not
46
+ prove that a file will load, fit, or run well on every device. No official iPhone speed or broad
47
+ compatibility claim is made yet. We are collecting reproducible successes and failures.
48
+
49
+ ## Current crowns — through Round 7
50
+
51
+ | File | Tier | Code bits / weight | Exact size | Crown status | Retention at crown | Builder | Chat-template key |
52
+ |---|---|---:|---:|---|---:|---|---|
53
+ | `ralph-qwen3-8b-binary.gguf` | binary | 1.0 | 1,158,964,160 B | New in Round 7 | 0.263616 | [ArizonaZZZ](https://huggingface.co/ArizonaZZZ) | No |
54
+ | `ralph-qwen3-8b-ternary.gguf` | ternary | 1.714 | 2,477,212,736 B | Crowned in Round 5; held in Round 7 | 0.253732 | [tensor-tailor](https://huggingface.co/tensor-tailor) | Yes |
55
+ | `ralph-qwen3-8b-sub2.gguf` | sub2 | 2.2626 | 2,937,263,168 B | New in Round 7 | 0.282457 | [boweizh1204](https://huggingface.co/boweizh1204) | Yes |
56
+ | `ralph-qwen3-8b-sub4.gguf` | sub4 | 4.0 | 4,614,304,896 B | New in Round 7 | 0.320923 | [boweizh1204](https://huggingface.co/boweizh1204) | Yes |
57
+
58
+ ### Exact checksums
59
+
60
+ ```text
61
+ 05c568169fc180067172cbdd38c1a9f5c249a556ffdef1dacd7172bad40fab58 ralph-qwen3-8b-binary.gguf
62
+ c643cb42575a7a85b7518fd935973202c5686db270ef8b593afa8616a986154a ralph-qwen3-8b-ternary.gguf
63
+ 9c45bf0ac486e793bd761a99ce4b9d965ec12e70f2d420e02af16797c71f6b50 ralph-qwen3-8b-sub2.gguf
64
+ b2ec80dce90258bbe9555a67983dea595d91f35cae48ca0d54c714eae8100edf ralph-qwen3-8b-sub4.gguf
65
+ ```
66
+
67
+ The same filenames, byte counts, hashes, pinned sources, and chat-template flags are available in
68
+ [`crowns.json`](./crowns.json).
69
+
70
+ ## What the crown means
71
+
72
+ Ralph retention is a within-protocol compression-fidelity measurement: it measures how closely an
73
+ artifact reproduces the pinned comparison parent's effect on configured judge models, including
74
+ the protocol's live language/depth floors. It is **not** a general capability benchmark, an
75
+ intelligence percentage, or evidence of device speed.
76
+
77
+ Round 7 uses three recorded judges and a fresh public exam. A challenger takes a crown only through
78
+ the protocol's recorded point-estimate margin or persistence path and must satisfy the per-judge
79
+ floor rule. A positive paired-bootstrap lower bound can affect the candidate weight vector without
80
+ changing the crown.
81
+
82
+ - [Round 7 signed record](https://huggingface.co/datasets/RalphLabsAI/ralph-v2-rounds/resolve/main/rounds/round-00000007-f42ae20c6ed2a796.json)
83
+ - [Round 5 record that crowned the current ternary](https://huggingface.co/datasets/RalphLabsAI/ralph-v2-rounds/resolve/main/rounds/round-00000005-25e6fd0528a93e74.json)
84
+ - [Ralph protocol and verifier](https://github.com/RalphLabsAI/ralph)
85
 
86
  ## Provenance
87
 
88
+ The crown publisher fetches the miner's full behavior-affecting package at the **pinned revision**
89
+ in the round record and recomputes its content hash. It mirrors the GGUF only when that hash matches
90
+ the record's `model_id`; the GGUF is uploaded without conversion or repacking.
91
+
92
+ For this release, the source owners subsequently added artifact-level Apache-2.0 declarations and
93
+ notices. Hugging Face LFS metadata was checked again on 2026-09-14: every current source GGUF, scored
94
+ revision, and mirrored file has the same SHA-256 shown above. The documentation commits did not
95
+ change the models.
96
+
97
+ Credit for the weights belongs to the builders named above and the miner hotkeys recorded in
98
+ `crowns.json`. Ralph provides a content-verified mirror and tournament record; it is not the origin
99
+ of the weights.
100
+
101
+ Admission checks architecture and tensor shapes against `Qwen/Qwen3-8B`. They do not
102
+ cryptographically prove lineage from the parent's weights; `base_model` identifies the pinned
103
+ comparison and admission target.
104
+
105
+ ## License
106
+
107
+ Each exact GGUF listed by checksum above is released under the **Apache License 2.0** by its source
108
+ owner. This repository includes the license text in [`LICENSE`](./LICENSE) and preserves the four
109
+ source notices in [`NOTICE`](./NOTICE).
110
+
111
+ All four are compressed derivatives of [Qwen/Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B),
112
+ Copyright 2024 Alibaba Cloud, Apache-2.0. The binary crown also incorporates bit-exact signs from
113
+ [prism-ml/Bonsai-8B-unpacked](https://huggingface.co/prism-ml/Bonsai-8B-unpacked), Apache-2.0.
114
+ The source notices describe each modification, data provenance, and MIT-licensed `llama.cpp`
115
+ tooling. Preserve `LICENSE`, `NOTICE`, source attribution, and modification statements when
116
+ redistributing these files.
117
+
118
+ The grant is tied here to the exact listed files and hashes. A future crown change requires a new
119
+ artifact-level license check; this card does not grant terms on behalf of a future builder.
120
+
121
+ ## Running the other crowns
122
+
123
+ For the ternary and sub4 files, replace the filename in the sub2 commands above. Runtime support
124
+ depends on the exact quantization type, runtime build, backend, available memory, and context
125
+ settings. Test the exact file on the target hardware before making compatibility or performance
126
+ claims.
127
+
128
+ The binary file has no embedded chat-template key, so this card does not prescribe a canonical
129
+ chat command for it. Establish and report a tested external template/runtime combination without
130
+ repacking or replacing the canonical bytes.
131
+
132
+ ## Help build the device evidence
133
+
134
+ If you test a crown, share both successes and failures in the repository's **Community** tab. A
135
+ useful receipt includes device model, OS and app version, exact GGUF filename, checksum status,
136
+ context size, runtime settings, load result, prompt-processing speed, generation speed, and the
137
+ exact failure if it did not run. Remove notifications, account identifiers, serial numbers, and
138
+ other private device information from screenshots.
139
 
140
+ ## Audit levels
 
141
 
142
+ - **L0** verifies signatures and recomputes arithmetic, crown decisions, and candidate vectors from
143
+ published measurements.
144
+ - **L1** re-derives item selection and checks the pinned pool.
145
+ - **L2** re-runs a recorded judge over frozen text; complete multi-judge coverage requires every
146
+ recorded judge.
147
+ - **L3** loads artifacts and regenerates their steps, binding frozen text to model execution.
148
 
149
+ L2/L3 require the recorded inputs and compatible runtimes. The records and verifier distinguish
150
+ what can be checked from data alone from what requires inference hardware.
 
 
crowns.json CHANGED
@@ -1,50 +1,66 @@
1
  {
2
- "binary": {
3
- "code_bits": 1.0,
4
- "container_bits": 1.125,
5
- "miner": "5HMwB4rqW7MnawkfUFUX4FcRcBympynru587RhEZyY8ns43a",
6
- "model_id": "e9f6bd656075dc9a4096d6f3da06441094334c2e058d22dc5409b404ccb1dd6a",
7
- "record": "https://huggingface.co/datasets/RalphLabsAI/ralph-v2-rounds/resolve/main/rounds/round-00000007-f42ae20c6ed2a796.json",
8
- "retention": 0.263616,
9
- "round": 7,
10
- "source_repo": "ArizonaZZZ/ralph-v2-qwen3-8b-binary-p2A2-step500-05c56816",
11
- "source_revision": "29c525c5c3166df2d62d5e180d09255199f778fe",
12
- "tier": "binary"
13
- },
14
- "sub2": {
15
- "code_bits": 2.2626,
16
- "container_bits": 2.81,
17
- "miner": "5DeneVpvebmKrpegpoeBsCDFof5dTzgBFsgEfH3YKSKYWduh",
18
- "model_id": "72136433b8f4613cf794a642b664b28dcbdf054f3e6499f8a6127f490da8cac1",
19
- "record": "https://huggingface.co/datasets/RalphLabsAI/ralph-v2-rounds/resolve/main/rounds/round-00000007-f42ae20c6ed2a796.json",
20
- "retention": 0.282457,
21
- "round": 7,
22
- "source_repo": "boweizh1204/ralph-qwen3-8b-sub2-qat5",
23
- "source_revision": "261d535f67ba8e59f5d96ce7deeed98243ad8892",
24
- "tier": "sub2"
25
- },
26
- "sub4": {
27
- "code_bits": 4.0,
28
- "container_bits": 4.5,
29
- "miner": "5CPABbwvKphDTGP5qsAdpBNACNkoh3yhEBAtuwCYdYw9PZto",
30
- "model_id": "d6e83ec7141a70eafe4f505ab6abf294ca346c015bd84f2e8faea6d1a72c6cab",
31
- "record": "https://huggingface.co/datasets/RalphLabsAI/ralph-v2-rounds/resolve/main/rounds/round-00000007-f42ae20c6ed2a796.json",
32
- "retention": 0.320923,
33
- "round": 7,
34
- "source_repo": "boweizh1204/qwen3-8b-ralph-sub4-c1b-20260910",
35
- "source_revision": "3c21306c630dac6440b37ad67b965a4b9b787cf9",
36
- "tier": "sub4"
37
- },
38
- "ternary": {
39
- "code_bits": 1.714,
40
- "container_bits": 2.3986,
41
- "miner": "5HNA3Fegavpufa9CmAUn2Sm1NQu41LYWxGnrSp1twzSYiYbu",
42
- "model_id": "ff244ec7ca827af53332b4758337641792596d8bca9d760ad34b56daeabcd523",
43
- "record": "https://huggingface.co/datasets/RalphLabsAI/ralph-v2-rounds/resolve/main/rounds/round-00000005-25e6fd0528a93e74.json",
44
- "retention": 0.253732,
45
- "round": 5,
46
- "source_repo": "tensor-tailor/ralph-qwen3-8b-ternary-r5",
47
- "source_revision": "3e4096acf9ce1eb270ba3897b5d8396425a18884",
48
- "tier": "ternary"
49
- }
50
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  {
2
+ "binary": {
3
+ "chat_template_present": false,
4
+ "code_bits": 1.0,
5
+ "container_bits": 1.125,
6
+ "file_bytes": 1158964160,
7
+ "file_sha256": "05c568169fc180067172cbdd38c1a9f5c249a556ffdef1dacd7172bad40fab58",
8
+ "filename": "ralph-qwen3-8b-binary.gguf",
9
+ "miner": "5HMwB4rqW7MnawkfUFUX4FcRcBympynru587RhEZyY8ns43a",
10
+ "model_id": "e9f6bd656075dc9a4096d6f3da06441094334c2e058d22dc5409b404ccb1dd6a",
11
+ "record": "https://huggingface.co/datasets/RalphLabsAI/ralph-v2-rounds/resolve/main/rounds/round-00000007-f42ae20c6ed2a796.json",
12
+ "retention": 0.263616,
13
+ "round": 7,
14
+ "source_repo": "ArizonaZZZ/ralph-v2-qwen3-8b-binary-p2A2-step500-05c56816",
15
+ "source_revision": "29c525c5c3166df2d62d5e180d09255199f778fe",
16
+ "tier": "binary"
17
+ },
18
+ "sub2": {
19
+ "chat_template_present": true,
20
+ "code_bits": 2.2626,
21
+ "container_bits": 2.81,
22
+ "file_bytes": 2937263168,
23
+ "file_sha256": "9c45bf0ac486e793bd761a99ce4b9d965ec12e70f2d420e02af16797c71f6b50",
24
+ "filename": "ralph-qwen3-8b-sub2.gguf",
25
+ "miner": "5DeneVpvebmKrpegpoeBsCDFof5dTzgBFsgEfH3YKSKYWduh",
26
+ "model_id": "72136433b8f4613cf794a642b664b28dcbdf054f3e6499f8a6127f490da8cac1",
27
+ "record": "https://huggingface.co/datasets/RalphLabsAI/ralph-v2-rounds/resolve/main/rounds/round-00000007-f42ae20c6ed2a796.json",
28
+ "retention": 0.282457,
29
+ "round": 7,
30
+ "source_repo": "boweizh1204/ralph-qwen3-8b-sub2-qat5",
31
+ "source_revision": "261d535f67ba8e59f5d96ce7deeed98243ad8892",
32
+ "tier": "sub2"
33
+ },
34
+ "sub4": {
35
+ "chat_template_present": true,
36
+ "code_bits": 4.0,
37
+ "container_bits": 4.5,
38
+ "file_bytes": 4614304896,
39
+ "file_sha256": "b2ec80dce90258bbe9555a67983dea595d91f35cae48ca0d54c714eae8100edf",
40
+ "filename": "ralph-qwen3-8b-sub4.gguf",
41
+ "miner": "5CPABbwvKphDTGP5qsAdpBNACNkoh3yhEBAtuwCYdYw9PZto",
42
+ "model_id": "d6e83ec7141a70eafe4f505ab6abf294ca346c015bd84f2e8faea6d1a72c6cab",
43
+ "record": "https://huggingface.co/datasets/RalphLabsAI/ralph-v2-rounds/resolve/main/rounds/round-00000007-f42ae20c6ed2a796.json",
44
+ "retention": 0.320923,
45
+ "round": 7,
46
+ "source_repo": "boweizh1204/qwen3-8b-ralph-sub4-c1b-20260910",
47
+ "source_revision": "3c21306c630dac6440b37ad67b965a4b9b787cf9",
48
+ "tier": "sub4"
49
+ },
50
+ "ternary": {
51
+ "chat_template_present": true,
52
+ "code_bits": 1.714,
53
+ "container_bits": 2.3986,
54
+ "file_bytes": 2477212736,
55
+ "file_sha256": "c643cb42575a7a85b7518fd935973202c5686db270ef8b593afa8616a986154a",
56
+ "filename": "ralph-qwen3-8b-ternary.gguf",
57
+ "miner": "5HNA3Fegavpufa9CmAUn2Sm1NQu41LYWxGnrSp1twzSYiYbu",
58
+ "model_id": "ff244ec7ca827af53332b4758337641792596d8bca9d760ad34b56daeabcd523",
59
+ "record": "https://huggingface.co/datasets/RalphLabsAI/ralph-v2-rounds/resolve/main/rounds/round-00000005-25e6fd0528a93e74.json",
60
+ "retention": 0.253732,
61
+ "round": 5,
62
+ "source_repo": "tensor-tailor/ralph-qwen3-8b-ternary-r5",
63
+ "source_revision": "3e4096acf9ce1eb270ba3897b5d8396425a18884",
64
+ "tier": "ternary"
65
+ }
66
+ }