philtheriver commited on
Commit
67f2d2b
·
verified ·
1 Parent(s): a2af433

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -72,8 +72,10 @@ JSON coherence. Filenames are prefixed `Qwopus3.6-27B-Coder-MTP-STRIX-`.
72
  | `embF16-Q6_0_ROCMFPX.gguf` | `Q6_0_ROCMFPX` | 110 | 6.50 | 24 GB | balanced (straight) |
73
  | `embF16-Q3_0_ROCMFPX_AGENT.gguf` | `Q3_0_ROCMFPX_AGENT` | 113 | ~3.5 | 21 GB | smallest agent |
74
  | `embF16-Q3_0_ROCMFPX.gguf` | `Q3_0_ROCMFPX` | 112 | 3.50 | 17 GB | smallest |
 
75
 
76
  > Tiers beyond the flagship are uploaded as they finish building — the **Files** tab is the source of truth for what's live.
 
77
 
78
  ## Running (ROCmFPX fork required)
79
 
 
72
  | `embF16-Q6_0_ROCMFPX.gguf` | `Q6_0_ROCMFPX` | 110 | 6.50 | 24 GB | balanced (straight) |
73
  | `embF16-Q3_0_ROCMFPX_AGENT.gguf` | `Q3_0_ROCMFPX_AGENT` | 113 | ~3.5 | 21 GB | smallest agent |
74
  | `embF16-Q3_0_ROCMFPX.gguf` | `Q3_0_ROCMFPX` | 112 | 3.50 | 17 GB | smallest |
75
+ | `embF16-Q4_0_ROCMFP4.gguf` | `Q4_0_ROCMFP4` | 100 | ~5.7¹ | 19 GB | fastest decode (4-bit body, ~13 tok/s raw) |
76
 
77
  > Tiers beyond the flagship are uploaded as they finish building — the **Files** tab is the source of truth for what's live.
78
+ > ¹ `Q4_0_ROCMFP4` is a true 4-bit body; the ~5.7 *effective* bpw is inflated by the f16 token embeddings (a lookup — it doesn't slow the fast 4-bit decode).
79
 
80
  ## Running (ROCmFPX fork required)
81