This website works better with JavaScript
Etusivu
Tutki
Apua
Kirjaudu sisään
cturan
/
llama.cpp
peilaus alkaen
https://github.com/cturan/llama.cpp
Tarkkaile
1
Äänestä
0
Haarauta
0
Tiedostot
Esitykset
0
Wiki
Puu:
b43272afa2
Haarat
Tunnisteet
k2v2
master
minimax
qwen3_next
qwen3_next_optimized
toolinjection
test
b6814
llama.cpp
/
examples
/
speculative
Pedro Cuenca
b97bc3966e
llama : support Llama 3 HF conversion (
#6745
)
1 vuosi sitten
..
CMakeLists.txt
b12fa0d1c1
build : link against build info instead of compiling against it (
#3879
)
2 vuotta sitten
README.md
6d341ab6c5
speculative : implement stochastic speculative sampling (
#5625
)
1 vuosi sitten
speculative.cpp
b97bc3966e
llama : support Llama 3 HF conversion (
#6745
)
1 vuosi sitten
README.md
llama.cpp/examples/speculative
Demonstration of speculative decoding and tree-based speculative decoding techniques
More info:
https://github.com/ggerganov/llama.cpp/pull/2926
https://github.com/ggerganov/llama.cpp/pull/3624
https://github.com/ggerganov/llama.cpp/pull/5625