Buckets:
30.8 GB
7,334 files
Updated 5 months ago
Ctrl+K
| Name | Size | Uploaded | Xet hash |
|---|---|---|---|
| CMakeLists.txt | 261 Bytes xet | 37d1d89d | |
| README.md | 448 Bytes xet | 719adf65 | |
| speculative-simple.cpp | 12.5 kB xet | c877d7a2 |
llama.cpp/examples/speculative-simple
Demonstration of basic greedy speculative decoding
./bin/llama-speculative-simple \
-m ../models/qwen2.5-32b-coder-instruct/ggml-model-q8_0.gguf \
-md ../models/qwen2.5-1.5b-coder-instruct/ggml-model-q4_0.gguf \
-f test.txt -c 0 -ngl 99 --color on \
--sampling-seq k --top-k 1 -fa on --temp 0.0 \
-ngld 99 --spec-draft-n-max 16 --spec-draft-n-draft-min 5 --draft-p-min 0.9
- Total size
- 30.8 GB
- Files
- 7,334
- Last updated
- Jun 18
- Pre-warmed CDN
- US EU US EU