 Georgi Gerganov
|
cb1adf8851
server : handle failures to restore host cache (#17078)
|
hace 2 meses |
|
Georgi Gerganov
|
cd5e3b5754
server : support unified cache across slots (#16736)
|
hace 2 meses |
|
Georgi Gerganov
|
d00cbea63c
server : host-memory prompt caching (#16391)
|
hace 3 meses |
 65a
|
4afb0a746f
server : Support multimodal completion and embeddings prompts in JSON format (#15108)
|
hace 4 meses |
|
Georgi Gerganov
|
d2fcd91cf9
server : disable context shift by default (#15416)
|
hace 5 meses |
 Lukas Straub
|
a9f77a8be3
server : add openai-style logit_bias support (#14946)
|
hace 5 meses |
 Olivier Chafik
|
f13847cfb5
server: fix regression on streamed non-chat completion w/ stops (#13785)
|
hace 7 meses |
 Xuan-Son Nguyen
|
360a9c98e1
server : fix cache_tokens bug with no cache_prompt (#13533)
|
hace 8 meses |
 Diego Devesa
|
1d36b3670b
llama : move end-user examples to tools directory (#13249)
|
hace 8 meses |
