Georgi Gerganov d9d54e498d speculative : refactor and add a simpler example (#10362)		1 жил өмнө
..
CMakeLists.txt	1c641e6aac `build`: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)	1 жил өмнө
README.md	07a3fc0608 Removes multiple newlines at the end of files that is breaking the editorconfig step of CI. (#8258)	1 жил өмнө
lookup-create.cpp	7eee341bee common : use common_ prefix for common library functions (#9805)	1 жил өмнө
lookup-merge.cpp	7eee341bee common : use common_ prefix for common library functions (#9805)	1 жил өмнө
lookup-stats.cpp	d9d54e498d speculative : refactor and add a simpler example (#10362)	1 жил өмнө
lookup.cpp	d9d54e498d speculative : refactor and add a simpler example (#10362)	1 жил өмнө

llama.cpp/examples/lookup

Demonstration of Prompt Lookup Decoding

https://github.com/apoorvumang/prompt-lookup-decoding

The key parameters for lookup decoding are ngram_min, ngram_max and n_draft. The first two determine the size of the ngrams to search for in the prompt for a match. The latter specifies how many subsequent tokens to draft if a match is found.

More info:

https://github.com/ggerganov/llama.cpp/pull/4484 https://github.com/ggerganov/llama.cpp/issues/4226

README.md

llama.cpp/examples/lookup