 sirus20x6
|
20cc625edc
ggml: Correct SVE implementation in ggml_vec_dot_f16_unroll (#16518)
|
3 months ago |
 Johannes Gäßler
|
11f0af5504
CUDA: faster tile FA, add oob checks, more HSs (#16492)
|
3 months ago |
 Georgi Gerganov
|
a3cb04744f
metal : fix mul-mm condition + fix mul-mv permuted kernels (#16494)
|
3 months ago |
 Pascal
|
4a8fbe0a5e
feat: render user content as markdown option (#16358)
|
3 months ago |
 Yann Follet
|
31d0ff1869
server / ranking : add sorting and management of top_n (#16403)
|
3 months ago |
 Diego Devesa
|
97870e6497
cuda : avoid initializing unused devices (#16510)
|
3 months ago |
 amirai21
|
477a66b035
convert : correctly handle LLaMA tokenizer for Jamba (#16470)
|
3 months ago |
|
Georgi Gerganov
|
e60f01d941
server : fix division by zero when reporting stats (#16501)
|
3 months ago |
|
Georgi Gerganov
|
81086cd6a3
vocab : mark EOT token for Granite models (#16499)
|
3 months ago |
 Radoslav Gerganov
|
68ee98ae18
server : return HTTP 400 if prompt exceeds context length (#16486)
|
3 months ago |
|
Radoslav Gerganov
|
cdb6da468c
server : log requests to /v1/completions (#16495)
|
3 months ago |
 Prajwal B Mehendarkar
|
6d69ab3f26
cmake : Dont define XOPENSOURCE on AIX (#16481)
|
3 months ago |
|
Pascal
|
1faa13a118
webui: updated the chat service to only include max_tokens in the req… (#16489)
|
3 months ago |
 duduta
|
1deee0f8d4
cpu : optimize the ggml NORM operation (#15953)
|
3 months ago |
|
Georgi Gerganov
|
d00cbea63c
server : host-memory prompt caching (#16391)
|
3 months ago |
|
Pascal
|
8328fd4bae
No markdown in cot (#16483)
|
3 months ago |
 Daniel Bevenius
|
56b4795842
model-conversion : add support for SentenceTransformers (#16387)
|
3 months ago |
 sudhiarm
|
2c0d875ae6
ci: add ARM64 Kleidiai build and test support (#16462)
|
3 months ago |
 Chenguang Li
|
aa4711d369
CANN: Improve ACL graph matching (#16166)
|
3 months ago |
 Charles Xu
|
d80d6d2400
kleidiai: kernel interface refactoring (#16460)
|
3 months ago |
 Neo Zhang Jianyu
|
b260213755
[SYCL] refactor soft_max, add soft_max_back (#16472)
|
3 months ago |
 Saba Fallah
|
e08db42595
model: EmbeddingGemma Adding Support for SentenceTransformers Dense Modules (#16367)
|
3 months ago |
|
Pascal
|
12bbc3fa50
refactor: centralize CoT parsing in backend for streaming mode (#16394)
|
3 months ago |
 ai-fonsi
|
9d0882840e
Disable CUDA host buffers on integrated GPUs (#16308)
|
3 months ago |
 issixx
|
d2ee056e1d
server : fix cancel pending task (#16467)
|
3 months ago |
|
Georgi Gerganov
|
b2c08c9ec4
metal : mark FA blocks (#16372)
|
3 months ago |
|
Georgi Gerganov
|
7fdd16b432
server : improve context checkpoint logic (#16440)
|
3 months ago |
 Reese Levine
|
74b8fc17f9
ggml webgpu: profiling, CI updates, reworking of command submission (#16452)
|
3 months ago |
 Tarek Dakhran
|
aeaf8a36f0
llama : support LiquidAI LFM2-MoE hybrid model (#16464)
|
3 months ago |
|
Georgi Gerganov
|
df1b612e29
server : add `/v1/health` endpoint (#16461)
|
3 months ago |
