 Radoslav Gerganov
|
68ee98ae18
server : return HTTP 400 if prompt exceeds context length (#16486)
|
3 months ago |
|
Radoslav Gerganov
|
cdb6da468c
server : log requests to /v1/completions (#16495)
|
3 months ago |
 Prajwal B Mehendarkar
|
6d69ab3f26
cmake : Dont define XOPENSOURCE on AIX (#16481)
|
3 months ago |
 Pascal
|
1faa13a118
webui: updated the chat service to only include max_tokens in the req… (#16489)
|
3 months ago |
 duduta
|
1deee0f8d4
cpu : optimize the ggml NORM operation (#15953)
|
3 months ago |
 Georgi Gerganov
|
d00cbea63c
server : host-memory prompt caching (#16391)
|
3 months ago |
|
Pascal
|
8328fd4bae
No markdown in cot (#16483)
|
3 months ago |
 Daniel Bevenius
|
56b4795842
model-conversion : add support for SentenceTransformers (#16387)
|
3 months ago |
 sudhiarm
|
2c0d875ae6
ci: add ARM64 Kleidiai build and test support (#16462)
|
3 months ago |
 Chenguang Li
|
aa4711d369
CANN: Improve ACL graph matching (#16166)
|
3 months ago |
 Charles Xu
|
d80d6d2400
kleidiai: kernel interface refactoring (#16460)
|
3 months ago |
 Neo Zhang Jianyu
|
b260213755
[SYCL] refactor soft_max, add soft_max_back (#16472)
|
3 months ago |
 Saba Fallah
|
e08db42595
model: EmbeddingGemma Adding Support for SentenceTransformers Dense Modules (#16367)
|
3 months ago |
|
Pascal
|
12bbc3fa50
refactor: centralize CoT parsing in backend for streaming mode (#16394)
|
3 months ago |
 ai-fonsi
|
9d0882840e
Disable CUDA host buffers on integrated GPUs (#16308)
|
3 months ago |
 issixx
|
d2ee056e1d
server : fix cancel pending task (#16467)
|
3 months ago |
|
Georgi Gerganov
|
b2c08c9ec4
metal : mark FA blocks (#16372)
|
3 months ago |
|
Georgi Gerganov
|
7fdd16b432
server : improve context checkpoint logic (#16440)
|
3 months ago |
 Reese Levine
|
74b8fc17f9
ggml webgpu: profiling, CI updates, reworking of command submission (#16452)
|
3 months ago |
 Tarek Dakhran
|
aeaf8a36f0
llama : support LiquidAI LFM2-MoE hybrid model (#16464)
|
3 months ago |
|
Georgi Gerganov
|
df1b612e29
server : add `/v1/health` endpoint (#16461)
|
3 months ago |
 Sascha Rogmann
|
4e0388aa8a
webui : added download action (#13552) (#16282)
|
3 months ago |
|
Georgi Gerganov
|
ef4c5b87ea
presets : fix pooling param for embedding models (#16455)
|
3 months ago |
|
Radoslav Gerganov
|
c61ae20d05
rpc : update documentation (#16441)
|
3 months ago |
|
Georgi Gerganov
|
0123ff38f5
memory : use sequential equal splits for recurrent modules (#16442)
|
3 months ago |
|
Georgi Gerganov
|
0a319bb75e
metal : add support for non-padded FA KV (#16148)
|
3 months ago |
|
Georgi Gerganov
|
1d6092fc72
tests : add -INF blocks to the KQ mask in the FA tests (#16380)
|
3 months ago |
|
Georgi Gerganov
|
8ae32dc9ec
metal : various optimizations + refactoring (#16446)
|
3 months ago |
 Gadflyii
|
3df2244df4
llama : add --no-host to disable host buffers (#16310)
|
3 months ago |
 Gabe Goodhart
|
c08002a198
chat : Granite Docling stopping (#16438)
|
3 months ago |
