Spaces:

kazutab
/

mindmap-studio

Running on Zero

App Files Files Community

mindmap-studio / backend /llama.cpp /examples /lookup /README.md

kazutab

Upload folder using huggingface_hub (part 2)

79b4c43 verified 3 months ago

preview code

Raw History Blame Contribute Delete

485 Bytes

# llama.cpp/examples/lookup

Demonstration of Prompt Lookup Decoding

https://github.com/apoorvumang/prompt-lookup-decoding

The key parameters for lookup decoding are `ngram_min`, `ngram_max` and `n_draft`. The first two determine the size of the ngrams to search for in the prompt for a match. The latter specifies how many subsequent tokens to draft if a match is found.

More info:

https://github.com/ggml-org/llama.cpp/pull/4484
https://github.com/ggml-org/llama.cpp/issues/4226

	# llama.cpp/examples/lookup

	Demonstration of Prompt Lookup Decoding

	https://github.com/apoorvumang/prompt-lookup-decoding

	The key parameters for lookup decoding are `ngram_min`, `ngram_max` and `n_draft`. The first two determine the size of the ngrams to search for in the prompt for a match. The latter specifies how many subsequent tokens to draft if a match is found.

	More info:

	https://github.com/ggml-org/llama.cpp/pull/4484
	https://github.com/ggml-org/llama.cpp/issues/4226