 John
|
6db2b41a76
llava : support for Yi-VL and fix for mobileVLM (#5093)
|
2 years ago |
 Georgi Gerganov
|
753eafed0e
sync : ggml
|
2 years ago |
 Judd
|
e976423005
ggml : check ggml_add src1 type (ggml/708)
|
2 years ago |
 Michael Klimenko
|
35a2ee9143
Remove unused data and add fixes (#5154)
|
2 years ago |
 Maximilian Winter
|
ec903c0341
server : add self-extend support (#5104)
|
2 years ago |
 0cc4m
|
a1d6df129b
Add OpenCL add kernel (#5151)
|
2 years ago |
 Jared Van Bortel
|
bbe7c56c99
cmake : pass CPU architecture flags to nvcc (#5146)
|
2 years ago |
 slaren
|
62fead3ea0
cuda : fix tensor size calculation for non-split buffer (#5145)
|
2 years ago |
|
slaren
|
15b4538ff2
ggml-alloc : add 10% margin to the buffer sizes (#5149)
|
2 years ago |
 snadampal
|
7032f4f634
ggml : update softmax n_task calculation (#5126)
|
2 years ago |
|
Georgi Gerganov
|
5f1925a8ce
scripts : move run-with-preset.py from root to scripts folder
|
2 years ago |
|
Georgi Gerganov
|
3b7c914de2
tests : gitignore test-c.o
|
2 years ago |
 Xuan Son Nguyen
|
48c857aa10
server : refactored the task processing logic (#5065)
|
2 years ago |
 crasm
|
413e7b0559
ci : add model tests + script wrapper (#4586)
|
2 years ago |
 Paul Tsochantaris
|
6dd3c28c9c
metal : remove unused `n_buffers` and `buffers` (#5129)
|
2 years ago |
 Riceball LEE
|
38b431de23
gguf : fix "general.alignment" type in gguf_reader.py (#5136)
|
2 years ago |
|
Georgi Gerganov
|
aad0b01d73
readme : update hot topics
|
2 years ago |
 Kawrakow
|
1182cf4d4f
Another bucket sort (#5109)
|
2 years ago |
 XiaotaoChen
|
fe54033b69
readme : add MobileVLM 1.7B/3B to the supported models list (#5107)
|
2 years ago |
 l3utterfly
|
5eaf9964fc
llama : dynamic temperature sampling (#4972)
|
2 years ago |
|
Jared Van Bortel
|
d292f4f204
examples : make pydantic scripts pass mypy and support py3.8 (#5099)
|
2 years ago |
 Valentin Konovalov
|
256d1bb0dd
android : use release cmake build type by default (#5123)
|
2 years ago |
|
Kawrakow
|
faa3526a1e
Fix Q3_K_XS for MoE models (#5113)
|
2 years ago |
|
Georgi Gerganov
|
ddc5a5033f
metal : show compile log messages
|
2 years ago |
 Engininja2
|
cd4fddb29f
cuda : fix 2-bit quants on amd hip (#5105)
|
2 years ago |
 Michael Hueschen
|
c9b316c78f
nix-shell: use addToSearchPath
|
2 years ago |
|
Michael Hueschen
|
bf63d695b8
nix: add cc to devShell LD_LIBRARY_PATH
|
2 years ago |
|
slaren
|
1387ea2117
llama : pre-allocate input tensors in a separate buffer (#5100)
|
2 years ago |
|
Georgi Gerganov
|
26d607608d
metal : disable support for MUL_MAT F32 x F16
|
2 years ago |
|
Kawrakow
|
44879ee885
Additional KL-divergence statistics (#5081)
|
2 years ago |
