 Michael Klimenko
|
35a2ee9143
Remove unused data and add fixes (#5154)
|
%!s(int64=2) %!d(string=hai) anos |
 Maximilian Winter
|
ec903c0341
server : add self-extend support (#5104)
|
%!s(int64=2) %!d(string=hai) anos |
 Xuan Son Nguyen
|
48c857aa10
server : refactored the task processing logic (#5065)
|
%!s(int64=2) %!d(string=hai) anos |
|
Xuan Son Nguyen
|
821f0a271e
server : defer tasks when "slot unavailable" (#5018)
|
%!s(int64=2) %!d(string=hai) anos |
 Georgi Gerganov
|
0ea069b87b
server : fix prompt caching with system prompt (#4914)
|
%!s(int64=2) %!d(string=hai) anos |
 Ziad Ben Hadj-Alouane
|
356327feb3
server : fix deadlock that occurs in multi-prompt scenarios (#4905)
|
%!s(int64=2) %!d(string=hai) anos |
 makomk
|
ee8243adaa
server : fix crash with multimodal models without BOS token (#4904)
|
%!s(int64=2) %!d(string=hai) anos |
 slaren
|
e7e4df031b
llama : ggml-backend integration (#4766)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
1d118386fe
server : fix infill when prompt is empty (#4833)
|
%!s(int64=2) %!d(string=hai) anos |
 Laura
|
4330bd83fe
server : implement credentialed CORS (#4514)
|
%!s(int64=2) %!d(string=hai) anos |
 Michael Coppola
|
27379455c3
server : support for multiple api keys (#4864)
|
%!s(int64=2) %!d(string=hai) anos |
 Behnam M
|
eab6795006
server : add `LOG_INFO` when model is successfully loaded (#4881)
|
%!s(int64=2) %!d(string=hai) anos |
 Isaac McFadyen
|
2f043328e3
server : fix typo in model name (#4876)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
5c1980d8d4
server : fix build + rename enums (#4870)
|
%!s(int64=2) %!d(string=hai) anos |
|
Behnam M
|
cd108e641d
server : add a `/health` endpoint (#4860)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
67984921a7
server : fix n_predict check (#4798)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
012cf349ae
server : send token probs for "stream == false" (#4714)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
32866c5edd
editorconfig : fix whitespace and indentation #4710
|
%!s(int64=2) %!d(string=hai) anos |
 minarchist
|
5d7002d437
server : add --override-kv parameter (#4710)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
9fbda719de
clip : refactor + bug fixes (#4696)
|
%!s(int64=2) %!d(string=hai) anos |
 Justine Tunney
|
db49ff8ed7
server : replace sleep with condition variables (#4673)
|
%!s(int64=2) %!d(string=hai) anos |
 SakuraUmi
|
60f55e888c
server : fix OpenAI server sampling w.r.t. penalty. (#4675)
|
%!s(int64=2) %!d(string=hai) anos |
 Karthik Sethuraman
|
b93edd22f5
server : allow to generate multimodal embeddings (#4681)
|
%!s(int64=2) %!d(string=hai) anos |
|
Justine Tunney
|
65e5f6dadb
Fix OpenAI server sampling w.r.t. temp and seed (#4668)
|
%!s(int64=2) %!d(string=hai) anos |
 Alexey Parfenov
|
6123979952
server : allow to specify custom prompt for penalty calculation (#3727)
|
%!s(int64=2) %!d(string=hai) anos |
 olexiyb
|
0ffc92d2d2
server : disable llm logs if SERVER_VERBOSE is off (#3792)
|
%!s(int64=2) %!d(string=hai) anos |
 AdithyanI
|
8edd2b40fd
server : fix grammar being ignored (#4494)
|
%!s(int64=2) %!d(string=hai) anos |
|
Alexey Parfenov
|
eb16dae7e7
server : fix possible ambiguity in content type charset (#4501)
|
%!s(int64=2) %!d(string=hai) anos |
 mzcu
|
62bd52b7bf
server : allow requests larger than 8K (#4500)
|
%!s(int64=2) %!d(string=hai) anos |
 ShadovvBeast
|
88ae8952b6
server : add optional API Key Authentication example (#4441)
|
%!s(int64=2) %!d(string=hai) anos |
