 Cebtenzzre
|
4fa2cc1750
make : improve test target (#3031)
|
2 years ago |
|
Cebtenzzre
|
5ffab089a5
make : fix CPPFLAGS (#3035)
|
2 years ago |
 slaren
|
15b67a66c2
llama-bench : use two tokens in the warmup run for prompt evals (#3059)
|
2 years ago |
 Kawrakow
|
be8c9c245b
metal : parallel RoPE on Metal (#3024)
|
2 years ago |
|
Kawrakow
|
be6beeb8d7
metal : correct fix of kernel_norm (#3060)
|
2 years ago |
 Georgi Gerganov
|
c4f496648c
metal : fix kernel_norm (fixes Falcon on Metal) (#3057)
|
2 years ago |
 Przemysław Pawełczyk
|
fec2fb19e4
ggml : posixify madvise and pagesize (#3037)
|
2 years ago |
|
Georgi Gerganov
|
178b1850eb
k-quants : fix zero-weight guard in Q6_K (ref #3040)
|
2 years ago |
 Kerfuffle
|
ea2c85d5d2
convert-llama-ggml-to-gguf: Try to handle files older than GGJTv3 (#3023)
|
2 years ago |
|
Cebtenzzre
|
9912b9efc8
build : add LLAMA_METAL_NDEBUG flag (#3033)
|
2 years ago |
|
Cebtenzzre
|
9e2023156e
make : use new flag variables for recent changes (#3019)
|
2 years ago |
|
Cebtenzzre
|
de2fe892af
examples : replace fprintf to stdout with printf (#3017)
|
2 years ago |
 Erik Scholz
|
c9c3220c48
convert: fix convert.py not working with int filename_stem (#3028)
|
2 years ago |
|
Kawrakow
|
d59bd97065
Guard against all weights in a super-block being zero (#3010)
|
2 years ago |
|
Georgi Gerganov
|
35938ee3b0
llama : update logic for number of threads when using BLAS
|
2 years ago |
|
Georgi Gerganov
|
921772104b
speculative : add grammar support (#2991)
|
2 years ago |
|
Georgi Gerganov
|
2ba85c8609
py : minor
|
2 years ago |
|
Georgi Gerganov
|
e36ecdccc8
build : on Mac OS enable Metal by default (#2901)
|
2 years ago |
|
slaren
|
bd33e5ab92
ggml-opencl : store GPU buffer in ggml_tensor::extra (#2994)
|
2 years ago |
|
Cebtenzzre
|
3103568144
llama-bench : make cpp file non-executable (#2999)
|
2 years ago |
 Leng Yue
|
5b8530d88c
make : add speculative example (#3003)
|
2 years ago |
 Aarni Koskela
|
e4386f417f
server : add a subtle loading animation to the edit box (#2466)
|
2 years ago |
 Jiahao Li
|
35195689cd
2x faster (rms) norm cuda kernels (3.7% e2e improvement) (#2985)
|
2 years ago |
|
slaren
|
cf9b08485c
ggml-alloc : use virtual memory for measurement (#2973)
|
2 years ago |
|
Georgi Gerganov
|
47068e5170
speculative : PoC for speeding-up inference via speculative sampling (#2926)
|
2 years ago |
|
Georgi Gerganov
|
8f429fa511
perplexity : fix ETA by warming up the model with an empty run
|
2 years ago |
|
Kerfuffle
|
6519e9c99c
gguf(python): Fix special vocab handling when id < 0 (#2984)
|
2 years ago |
|
Georgi Gerganov
|
b7f2aa9e51
metal : restore 363f0bf and fix reduce in F16_F32 kernels (#2986)
|
2 years ago |
 Alon
|
73a12a6344
cov : disable comment in PRs (#2989)
|
2 years ago |
 opparco
|
3730134776
llama : fix bpe tokenize from byte (#2889)
|
2 years ago |
