Reword model card intro
Browse files
README.md
CHANGED
|
@@ -13,10 +13,12 @@ tags:
|
|
| 13 |
|
| 14 |
# MemDraft drafters
|
| 15 |
|
| 16 |
-
These are
|
| 17 |
|
| 18 |
-
|
| 19 |
-
|
|
|
|
|
|
|
| 20 |
|
| 21 |
Load them with MemDraft's llama.cpp plugin. The [GitHub repo](https://github.com/Cyronius/memdraft) explains how to build the plugin and patch llama.cpp.
|
| 22 |
|
|
|
|
| 13 |
|
| 14 |
# MemDraft drafters
|
| 15 |
|
| 16 |
+
These are drafters for [MemDraft](https://github.com/Cyronius/memdraft), a speculative-decoding method for llama.cpp. MemDraft proposes tokens from a lookup table, so it doesn't need a separate draft model.
|
| 17 |
|
| 18 |
+
Each drafter is built for one target model and has two files:
|
| 19 |
+
|
| 20 |
+
- **`.mdt`**: the lookup table, built from text generated by the target model.
|
| 21 |
+
- **`.mdr`**: a reranker, a small MLP that chooses among the table's proposals.
|
| 22 |
|
| 23 |
Load them with MemDraft's llama.cpp plugin. The [GitHub repo](https://github.com/Cyronius/memdraft) explains how to build the plugin and patch llama.cpp.
|
| 24 |
|