Add naming standard (format vs profile)
Browse files
NAMING.md
ADDED
|
@@ -0,0 +1,45 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Sealed naming standard — coherent AMD family
|
| 2 |
+
|
| 3 |
+
## Hard constraint from ROCmFPX types
|
| 4 |
+
|
| 5 |
+
| Wanted name | Exists? | Notes |
|
| 6 |
+
|-------------|---------|-------|
|
| 7 |
+
| `Q4_0_ROCMFP4_COHERENT` + imatrix | **YES** | Preferred farm default |
|
| 8 |
+
| `Q5_*_ROCMFP4_COHERENT` | **NO** | No ROCmFP4 Q5 type in this fork |
|
| 9 |
+
| `Q6_0_ROCMFP4_COHERENT` | **NO** | Q6 is **ROCmFPX**, not ROCmFP4 |
|
| 10 |
+
| `Q6_0_ROCMFPX_AGENT` + imatrix | **YES** | Q6 “coherent / agent” profile |
|
| 11 |
+
|
| 12 |
+
**ROCMFP4_COHERENT is a Q4-only quant type.**
|
| 13 |
+
Higher bit “coherent” uses **ROCMFPX_AGENT**, not the string `ROCMFP4_COHERENT`.
|
| 14 |
+
|
| 15 |
+
## Shipped set (this dir)
|
| 16 |
+
|
| 17 |
+
| File | Role |
|
| 18 |
+
|------|------|
|
| 19 |
+
| `Qwen3.6-35B-A3B-Q4_0_ROCMFP4_COHERENT-imatrix.gguf` | Default — format ROCmFP4 + profile COHERENT + imatrix (~19G) |
|
| 20 |
+
| `Qwen3.6-35B-A3B-Q6_0_ROCMFPX_AGENT-imatrix.gguf` | High quality AMD coherent Q6 (~31G, tight on 32GB) |
|
| 21 |
+
| `Qwen3.6-35B-A3B-imatrix.gguf` | Shared imatrix |
|
| 22 |
+
|
| 23 |
+
**Removed (not coherent AMD):**
|
| 24 |
+
- `Q5_K_M-imatrix` (stock Q5, not ROCmFP4/ROCmFPX coherent)
|
| 25 |
+
- `Q6_0_ROCMFPX-imatrix` (base Q6, not AGENT)
|
| 26 |
+
|
| 27 |
+
## Filename pattern (locked)
|
| 28 |
+
|
| 29 |
+
```text
|
| 30 |
+
Qwen3.6-35B-A3B-{TYPE}-imatrix.gguf
|
| 31 |
+
```
|
| 32 |
+
|
| 33 |
+
Where `{TYPE}` is the **exact llama-quantize ftype string**:
|
| 34 |
+
- `Q4_0_ROCMFP4_COHERENT`
|
| 35 |
+
- `Q6_0_ROCMFPX_AGENT`
|
| 36 |
+
- (future) `Q8_0_ROCMFPX_AGENT`, `Q3_0_ROCMFPX_AGENT`, etc.
|
| 37 |
+
|
| 38 |
+
Do **not** invent `Q5_0_ROCMFP4_COHERENT` or rename stock quants to look like ROCmFP4.
|
| 39 |
+
|
| 40 |
+
## Optional future
|
| 41 |
+
|
| 42 |
+
| Type | Size (est.) | When |
|
| 43 |
+
|------|-------------|------|
|
| 44 |
+
| `Q6_0_ROCMFPX_AGENT_LEAN` | ~27G | If full AGENT is too tight on 32GB |
|
| 45 |
+
| `Q8_0_ROCMFPX_AGENT` | ~34G | Dual-GPU / short ctx only |
|