Accueil Explorer Aide
Connexion
cturan
/
llama.cpp
miroir de https://github.com/cturan/llama.cpp
1
0
Fork 0
Fichiers Tickets 0 Wiki
Aborescence: f30f099228
Branches Tags
llama.cpp
/
examples
/
speculative
Georgi Gerganov afa8a9ec9b llama : add `llama_vocab`, functions -> methods, naming (#11110) il y a 1 an
..
CMakeLists.txt 7cc2d2c889 ggml : move AMX to the CPU backend (#10570) il y a 1 an
README.md 6d341ab6c5 speculative : implement stochastic speculative sampling (#5625) il y a 1 an
speculative.cpp afa8a9ec9b llama : add `llama_vocab`, functions -> methods, naming (#11110) il y a 1 an

README.md

llama.cpp/examples/speculative

Demonstration of speculative decoding and tree-based speculative decoding techniques

More info: