This website works better with JavaScript
Domovská stránka
Prehľadávať
Pomoc
Prihlásiť sa
cturan
/
llama.cpp
zrkadlo
https://github.com/cturan/llama.cpp
Pridať medzi pozorované
1
Hviezda
0
Fork
0
Súbory
Issues
0
Wiki
Strom:
3814a07392
Branche
Tagy
k2v2
master
minimax
qwen3_next
qwen3_next_optimized
toolinjection
test
b6814
llama.cpp
/
examples
/
speculative
Jeffrey Quesnelle
29eee40474
fix speculative decoding build on windows (
#5874
)
1 rok pred
..
CMakeLists.txt
b12fa0d1c1
build : link against build info instead of compiling against it (
#3879
)
2 rokov pred
README.md
6d341ab6c5
speculative : implement stochastic speculative sampling (
#5625
)
1 rok pred
speculative.cpp
29eee40474
fix speculative decoding build on windows (
#5874
)
1 rok pred
README.md
llama.cpp/examples/speculative
Demonstration of speculative decoding and tree-based speculative decoding techniques
More info:
https://github.com/ggerganov/llama.cpp/pull/2926
https://github.com/ggerganov/llama.cpp/pull/3624
https://github.com/ggerganov/llama.cpp/pull/5625