NagusameCS commited on
Commit
13770b3
·
verified ·
1 Parent(s): df40770

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +15 -5
README.md CHANGED
@@ -14,7 +14,12 @@ GGUF (697.3 GB, 17 shards), built with `ultratensor/gguf_keep.py`. A splice
14
  keeps only the expert subset a domain actually uses:
15
 
16
  - **keep64** — 64 dense experts / 384 hash experts (156.1 GiB). Holds 97.66 %
17
- of code routing mass on the first dense layer.
 
 
 
 
 
18
  - **keep16u / keep12u / keep8u** — uniform 16/12/8-expert ladder splices
19
  (39.3 / 32.2 / 25.0 GiB).
20
  - **IQ2_XS requants** of the ladder (24.7 / 20.3 / 16.0 GiB, 2.36-2.38 BPW)
@@ -22,11 +27,16 @@ keeps only the expert subset a domain actually uses:
22
 
23
  All files are single-file GGUFs (split count patched), with the MTP metadata
24
  defect fixed (`nextn_predict_layers = 0`). They load natively in llama.cpp
25
- builds with DeepSeek-V4 support (b10424 line).
 
26
 
27
- **Licensing**: these files are derived from DeepSeek-V4-Pro weights. Verify
28
- the upstream DeepSeek model license and the BatiAI distribution terms before
29
- redistributing further.
 
 
 
 
30
 
31
  ## Download
32
 
 
14
  keeps only the expert subset a domain actually uses:
15
 
16
  - **keep64** — 64 dense experts / 384 hash experts (156.1 GiB). Holds 97.66 %
17
+ of code routing mass on the first dense layer. MIXED-E: dense layers keep
18
+ 64 of 384 experts behind a full-width gate, so stock llama.cpp refuses to
19
+ load it (check_tensor_dims). Requires the UltraTensor fork
20
+ (`ultratensor-factored`, commit b4c34be) which derives per-layer expert
21
+ counts from the stored tensors and routes out-of-range dense selections
22
+ to fallback expert 0 (same convention as the hash-layer tid2eid remap).
23
  - **keep16u / keep12u / keep8u** — uniform 16/12/8-expert ladder splices
24
  (39.3 / 32.2 / 25.0 GiB).
25
  - **IQ2_XS requants** of the ladder (24.7 / 20.3 / 16.0 GiB, 2.36-2.38 BPW)
 
27
 
28
  All files are single-file GGUFs (split count patched), with the MTP metadata
29
  defect fixed (`nextn_predict_layers = 0`). They load natively in llama.cpp
30
+ builds with DeepSeek-V4 support (b10424 line), except keep64/keep64-iq2xs
31
+ which require the UltraTensor fork (>= b4c34be) for mixed-E loading.
32
 
33
+ keep64 smoke (2026-08-22, node2 CPU): prefill 31 tokens in 291s, decode
34
+ 8 tokens in 42.8s (0.16 t/s, NFS-bound); clean completion.
35
+
36
+ **Licensing**: verified 2026-08-21 — upstream
37
+ `deepseek-ai/DeepSeek-V4-Pro` is **MIT**, and the BatiAI GGUF distribution
38
+ explicitly "inherits the source model license: MIT". Redistribution of these
39
+ splices is permitted under MIT with the attribution in the model card.
40
 
41
  ## Download
42