l31, q3_8b: key-side bases (exponent 1/2) and per-channel key read-error statistics (metadata paths relative; tensors unchanged)
Browse files- README.md +1 -0
- l31/mask_locality/cache/bases/beta1104/dual_basis_l31_dump-alpha0p5.pt +3 -0
- l31/mask_locality/cache/graded/l31_grade_stats_dumpa05.pt +3 -0
- q3_8b/mask_locality/cache/bases/beta1104/dual_basis_q3_8b_dump-alpha0p5.pt +3 -0
- q3_8b/mask_locality/cache/graded/q3_8b_grade_stats_dumpa05.pt +3 -0
README.md
CHANGED
|
@@ -15,6 +15,7 @@ license_name: per-model
|
|
| 15 |
- `<model>/ppl/`: tokenized WikiText-2 / C4 evaluation windows (int32 token ids) with their `manifest.json`
|
| 16 |
- `<model>/moments/`: calibration second-moment statistics the key-side bases were fitted from
|
| 17 |
- `<model>/mask_locality/cache/`: inputs and intermediate products of a pruning-mask locality study (channel permutations from calibration, per-channel keep-frequency profiles); sha256 of every file is recorded in the study's `ARTIFACTS.json`
|
|
|
|
| 18 |
- **Format (.lqz)**: a 4-bit group of 128 values holds at most 16 distinct fp16 values, stored as a 16-entry fp16 table plus
|
| 19 |
128 4-bit indices; all other tensors are stored raw. Decoding is exact (bit-identical tensors).
|
| 20 |
- **Not** an inference-ready release: research artifacts only, no quality guarantee.
|
|
|
|
| 15 |
- `<model>/ppl/`: tokenized WikiText-2 / C4 evaluation windows (int32 token ids) with their `manifest.json`
|
| 16 |
- `<model>/moments/`: calibration second-moment statistics the key-side bases were fitted from
|
| 17 |
- `<model>/mask_locality/cache/`: inputs and intermediate products of a pruning-mask locality study (channel permutations from calibration, per-channel keep-frequency profiles); sha256 of every file is recorded in the study's `ARTIFACTS.json`
|
| 18 |
+
- `<model>/mask_locality/cache/bases/beta1104/`, `<model>/mask_locality/cache/graded/`: key-side bases with a fixed exponent of 1/2 and the per-channel key read-error statistics fitted in them (metadata paths are relative; each statistics file stores the sha256 of its basis file)
|
| 19 |
- **Format (.lqz)**: a 4-bit group of 128 values holds at most 16 distinct fp16 values, stored as a 16-entry fp16 table plus
|
| 20 |
128 4-bit indices; all other tensors are stored raw. Decoding is exact (bit-identical tensors).
|
| 21 |
- **Not** an inference-ready release: research artifacts only, no quality guarantee.
|
l31/mask_locality/cache/bases/beta1104/dual_basis_l31_dump-alpha0p5.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:028fc2f9c880b03c8cf2cdce6a0b8d8fa4a8f1d49271f3f7d90e5034d5c5f9bf
|
| 3 |
+
size 33556877
|
l31/mask_locality/cache/graded/l31_grade_stats_dumpa05.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:74244baaf6cb4c015242f0dd64a975888ed5871b26a3f3f847ef4a3796be6931
|
| 3 |
+
size 1450797
|
q3_8b/mask_locality/cache/bases/beta1104/dual_basis_q3_8b_dump-alpha0p5.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:43707cdc4d4c5750a0620d883cdbae13a80c933811948b0d7fa5b9bf105a6cb4
|
| 3 |
+
size 37751197
|
q3_8b/mask_locality/cache/graded/q3_8b_grade_stats_dumpa05.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:62cebfb567a1df5aa2b21dd2725d74e2a01e481e1abe73186adce9c439fae9e4
|
| 3 |
+
size 1631625
|