bakon3 commited on
Commit
8e2b94d
·
verified ·
1 Parent(s): 1b9b5b8

Add naming standard (format vs profile)

Browse files
Files changed (1) hide show
  1. NAMING.md +45 -0
NAMING.md ADDED
@@ -0,0 +1,45 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Sealed naming standard — coherent AMD family
2
+
3
+ ## Hard constraint from ROCmFPX types
4
+
5
+ | Wanted name | Exists? | Notes |
6
+ |-------------|---------|-------|
7
+ | `Q4_0_ROCMFP4_COHERENT` + imatrix | **YES** | Preferred farm default |
8
+ | `Q5_*_ROCMFP4_COHERENT` | **NO** | No ROCmFP4 Q5 type in this fork |
9
+ | `Q6_0_ROCMFP4_COHERENT` | **NO** | Q6 is **ROCmFPX**, not ROCmFP4 |
10
+ | `Q6_0_ROCMFPX_AGENT` + imatrix | **YES** | Q6 “coherent / agent” profile |
11
+
12
+ **ROCMFP4_COHERENT is a Q4-only quant type.**
13
+ Higher bit “coherent” uses **ROCMFPX_AGENT**, not the string `ROCMFP4_COHERENT`.
14
+
15
+ ## Shipped set (this dir)
16
+
17
+ | File | Role |
18
+ |------|------|
19
+ | `Qwen3.6-35B-A3B-Q4_0_ROCMFP4_COHERENT-imatrix.gguf` | Default — format ROCmFP4 + profile COHERENT + imatrix (~19G) |
20
+ | `Qwen3.6-35B-A3B-Q6_0_ROCMFPX_AGENT-imatrix.gguf` | High quality AMD coherent Q6 (~31G, tight on 32GB) |
21
+ | `Qwen3.6-35B-A3B-imatrix.gguf` | Shared imatrix |
22
+
23
+ **Removed (not coherent AMD):**
24
+ - `Q5_K_M-imatrix` (stock Q5, not ROCmFP4/ROCmFPX coherent)
25
+ - `Q6_0_ROCMFPX-imatrix` (base Q6, not AGENT)
26
+
27
+ ## Filename pattern (locked)
28
+
29
+ ```text
30
+ Qwen3.6-35B-A3B-{TYPE}-imatrix.gguf
31
+ ```
32
+
33
+ Where `{TYPE}` is the **exact llama-quantize ftype string**:
34
+ - `Q4_0_ROCMFP4_COHERENT`
35
+ - `Q6_0_ROCMFPX_AGENT`
36
+ - (future) `Q8_0_ROCMFPX_AGENT`, `Q3_0_ROCMFPX_AGENT`, etc.
37
+
38
+ Do **not** invent `Q5_0_ROCMFP4_COHERENT` or rename stock quants to look like ROCmFP4.
39
+
40
+ ## Optional future
41
+
42
+ | Type | Size (est.) | When |
43
+ |------|-------------|------|
44
+ | `Q6_0_ROCMFPX_AGENT_LEAN` | ~27G | If full AGENT is too tight on 32GB |
45
+ | `Q8_0_ROCMFPX_AGENT` | ~34G | Dual-GPU / short ctx only |