This website works better with JavaScript
Startsida
Utforska
Hjälp
Logga in
cturan
/
llama.cpp
spegling av
https://github.com/cturan/llama.cpp
Bevaka
1
Stjärnmärk
0
Fork
0
Filer
Ärenden
0
Wiki
Träd:
044ec4b2a5
Grenar
Taggar
k2v2
master
minimax
qwen3_next
qwen3_next_optimized
toolinjection
test
b6814
llama.cpp
/
examples
/
speculative
Jeffrey Quesnelle
29eee40474
fix speculative decoding build on windows (
#5874
)
1 år sedan
..
CMakeLists.txt
b12fa0d1c1
build : link against build info instead of compiling against it (
#3879
)
2 år sedan
README.md
6d341ab6c5
speculative : implement stochastic speculative sampling (
#5625
)
1 år sedan
speculative.cpp
29eee40474
fix speculative decoding build on windows (
#5874
)
1 år sedan
README.md
llama.cpp/examples/speculative
Demonstration of speculative decoding and tree-based speculative decoding techniques
More info:
https://github.com/ggerganov/llama.cpp/pull/2926
https://github.com/ggerganov/llama.cpp/pull/3624
https://github.com/ggerganov/llama.cpp/pull/5625