 Xuan-Son Nguyen
|
9b17d74ab7
mtmd: add mtmd_log_set (#17268)
|
vor 2 Monaten |
 Georgi Gerganov
|
d396b43748
server : fix "can batch with" bug (#17263)
|
vor 2 Monaten |
|
Xuan-Son Nguyen
|
c4abcb2457
server: fixing naming conflict res_error (#17243)
|
vor 2 Monaten |
|
Xuan-Son Nguyen
|
00c94083b3
server: (refactor) implement generator-based API for task results (#17174)
|
vor 2 Monaten |
|
Xuan-Son Nguyen
|
ee8dd5c658
server: move res_error/res_ok to static function (#17167)
|
vor 2 Monaten |
|
Georgi Gerganov
|
cb1adf8851
server : handle failures to restore host cache (#17078)
|
vor 2 Monaten |
 Aidan
|
eeee367de5
server: fix correct time_ms calculation in prompt_progress (#17093)
|
vor 2 Monaten |
|
Georgi Gerganov
|
8c0d6bb455
server : print the samplers chain for each request (#17070)
|
vor 2 Monaten |
|
Georgi Gerganov
|
b7f9010d24
server : disable checkpoints with mtmd (#17045)
|
vor 2 Monaten |
|
Georgi Gerganov
|
13b339bcd9
server : do not default to multiple slots with speculative decoding (#17017)
|
vor 2 Monaten |
|
Georgi Gerganov
|
66d8eccd42
server : do context shift only while generating (#17000)
|
vor 2 Monaten |
|
Georgi Gerganov
|
48bd26501b
server : add props.model_alias (#16943)
|
vor 2 Monaten |
|
Xuan-Son Nguyen
|
070ff4d535
mtmd: add --image-min/max-tokens (#16921)
|
vor 2 Monaten |
|
Georgi Gerganov
|
2f966b8ed8
clip : use FA (#16837)
|
vor 2 Monaten |
|
Georgi Gerganov
|
cd5e3b5754
server : support unified cache across slots (#16736)
|
vor 2 Monaten |
|
Georgi Gerganov
|
c22473b580
server : don't print user inputs to console (#16871)
|
vor 2 Monaten |
 Daniel Bevenius
|
0f715b4e75
server : fix typos in server.cpp comments [no ci] (#16883)
|
vor 2 Monaten |
|
Georgi Gerganov
|
b52edd2558
server : remove n_past (#16818)
|
vor 2 Monaten |
|
Georgi Gerganov
|
85a7d8677b
memory : remove KV cache size padding (#16812)
|
vor 2 Monaten |
 Johannes Gäßler
|
0bf47a1dbb
server: add memory breakdown print (#16740)
|
vor 2 Monaten |
 matteo
|
8cf6b42d46
server : send partial stop string when <EOG> is reached (#15007)
|
vor 2 Monaten |
|
Georgi Gerganov
|
17304cbcc1
server : fix img token logs (#16595)
|
vor 3 Monaten |
|
Georgi Gerganov
|
554fd578a5
server : fix mtmd checkpoints (#16591)
|
vor 3 Monaten |
|
Georgi Gerganov
|
bc07349a7f
server : dynamic token limit for prompt cache (#16560)
|
vor 3 Monaten |
 Yann Follet
|
31d0ff1869
server / ranking : add sorting and management of top_n (#16403)
|
vor 3 Monaten |
|
Georgi Gerganov
|
e60f01d941
server : fix division by zero when reporting stats (#16501)
|
vor 3 Monaten |
 Radoslav Gerganov
|
68ee98ae18
server : return HTTP 400 if prompt exceeds context length (#16486)
|
vor 3 Monaten |
|
Radoslav Gerganov
|
cdb6da468c
server : log requests to /v1/completions (#16495)
|
vor 3 Monaten |
|
Georgi Gerganov
|
d00cbea63c
server : host-memory prompt caching (#16391)
|
vor 3 Monaten |
 issixx
|
d2ee056e1d
server : fix cancel pending task (#16467)
|
vor 3 Monaten |
