 Jared Van Bortel
|
bbe7c56c99
cmake : pass CPU architecture flags to nvcc (#5146)
|
2 years ago |
 slaren
|
62fead3ea0
cuda : fix tensor size calculation for non-split buffer (#5145)
|
2 years ago |
|
slaren
|
15b4538ff2
ggml-alloc : add 10% margin to the buffer sizes (#5149)
|
2 years ago |
 snadampal
|
7032f4f634
ggml : update softmax n_task calculation (#5126)
|
2 years ago |
 Georgi Gerganov
|
5f1925a8ce
scripts : move run-with-preset.py from root to scripts folder
|
2 years ago |
|
Georgi Gerganov
|
3b7c914de2
tests : gitignore test-c.o
|
2 years ago |
 Xuan Son Nguyen
|
48c857aa10
server : refactored the task processing logic (#5065)
|
2 years ago |
 crasm
|
413e7b0559
ci : add model tests + script wrapper (#4586)
|
2 years ago |
 Paul Tsochantaris
|
6dd3c28c9c
metal : remove unused `n_buffers` and `buffers` (#5129)
|
2 years ago |
 Riceball LEE
|
38b431de23
gguf : fix "general.alignment" type in gguf_reader.py (#5136)
|
2 years ago |
|
Georgi Gerganov
|
aad0b01d73
readme : update hot topics
|
2 years ago |
 Kawrakow
|
1182cf4d4f
Another bucket sort (#5109)
|
2 years ago |
 XiaotaoChen
|
fe54033b69
readme : add MobileVLM 1.7B/3B to the supported models list (#5107)
|
2 years ago |
 l3utterfly
|
5eaf9964fc
llama : dynamic temperature sampling (#4972)
|
2 years ago |
|
Jared Van Bortel
|
d292f4f204
examples : make pydantic scripts pass mypy and support py3.8 (#5099)
|
2 years ago |
 Valentin Konovalov
|
256d1bb0dd
android : use release cmake build type by default (#5123)
|
2 years ago |
|
Kawrakow
|
faa3526a1e
Fix Q3_K_XS for MoE models (#5113)
|
2 years ago |
|
Georgi Gerganov
|
ddc5a5033f
metal : show compile log messages
|
2 years ago |
 Engininja2
|
cd4fddb29f
cuda : fix 2-bit quants on amd hip (#5105)
|
2 years ago |
 Michael Hueschen
|
c9b316c78f
nix-shell: use addToSearchPath
|
2 years ago |
|
Michael Hueschen
|
bf63d695b8
nix: add cc to devShell LD_LIBRARY_PATH
|
2 years ago |
|
slaren
|
1387ea2117
llama : pre-allocate input tensors in a separate buffer (#5100)
|
2 years ago |
|
Georgi Gerganov
|
26d607608d
metal : disable support for MUL_MAT F32 x F16
|
2 years ago |
|
Kawrakow
|
44879ee885
Additional KL-divergence statistics (#5081)
|
2 years ago |
 Johannes Gäßler
|
9ecdd12e95
CUDA: more info when no device code (#5088)
|
2 years ago |
|
Georgi Gerganov
|
89758723c7
minor : clean-up some warnings and style (#5094)
|
2 years ago |
|
Xuan Son Nguyen
|
2bed4aa3f3
devops : add intel oneapi dockerfile (#5068)
|
2 years ago |
 Michael Coppola
|
125d03a503
llama.vim : added api key support (#5090)
|
2 years ago |
|
slaren
|
011e8ec577
llama : fix not enough space in buffer with Qwen (#5086)
|
2 years ago |
|
Kawrakow
|
6f9939d119
KL-divergence (#5076)
|
2 years ago |
