Cyronius commited on
Commit
52da732
·
verified ·
1 Parent(s): f78547f

Reword model card intro

Browse files
Files changed (1) hide show
  1. README.md +5 -3
README.md CHANGED
@@ -13,10 +13,12 @@ tags:
13
 
14
  # MemDraft drafters
15
 
16
- These are lookup-table drafters for [MemDraft](https://github.com/Cyronius/memdraft), a speculative-decoding drafter for llama.cpp that runs no model. Each drafter has two files and is built for one target model:
17
 
18
- - **a table (`.mdt`)**, counted from text that the target model wrote;
19
- - **a reranker (`.mdr`)**, a small MLP that picks among the table's proposals.
 
 
20
 
21
  Load them with MemDraft's llama.cpp plugin. The [GitHub repo](https://github.com/Cyronius/memdraft) explains how to build the plugin and patch llama.cpp.
22
 
 
13
 
14
  # MemDraft drafters
15
 
16
+ These are drafters for [MemDraft](https://github.com/Cyronius/memdraft), a speculative-decoding method for llama.cpp. MemDraft proposes tokens from a lookup table, so it doesn't need a separate draft model.
17
 
18
+ Each drafter is built for one target model and has two files:
19
+
20
+ - **`.mdt`**: the lookup table, built from text generated by the target model.
21
+ - **`.mdr`**: a reranker, a small MLP that chooses among the table's proposals.
22
 
23
  Load them with MemDraft's llama.cpp plugin. The [GitHub repo](https://github.com/Cyronius/memdraft) explains how to build the plugin and patch llama.cpp.
24