 Pierrick Hymbert
|
c0a8c6db37
server : health endpoint configurable failure on no slot (#5594)
|
hai 1 ano |
 Robey Holderith
|
5ee99c32f5
common, server : surface min_keep as its own parameter (#5567)
|
hai 1 ano |
|
Pierrick Hymbert
|
c145f8a132
server : slots monitoring endpoint (#5550)
|
hai 1 ano |
|
Pierrick Hymbert
|
e75c6279d1
server : enhanced health endpoint (#5548)
|
hai 1 ano |
|
Pierrick Hymbert
|
36376abe05
server : --n-predict option document and cap to max value (#5549)
|
hai 1 ano |
 Alexey Parfenov
|
6dcc02d244
server : add "samplers" param to control the samplers order (#5494)
|
hai 1 ano |
 bmwl
|
f486f6e1e5
ggml : add numa options (#5377)
|
hai 1 ano |
|
Alexey Parfenov
|
684780141a
server : allow to specify tokens as strings in logit_bias (#5003)
|
hai 1 ano |
 Justin Parker
|
f3e2b4fa3f
server : update `/props` with "total_slots" value (#5373)
|
hai 1 ano |
 Michael Coppola
|
31e7903221
server : add `dynatemp_range` and `dynatemp_exponent` (#5352)
|
hai 1 ano |
|
Alexey Parfenov
|
a2d60c9158
server : allow to get default generation settings for completion (#5307)
|
hai 1 ano |
 Wu Jian Ping
|
6685cc41c2
server : improve README (#5209)
|
hai 1 ano |
 Kyle Mistele
|
39baaf55a1
docker : add server-first container images (#5157)
|
%!s(int64=2) %!d(string=hai) anos |
 Maximilian Winter
|
ec903c0341
server : add self-extend support (#5104)
|
%!s(int64=2) %!d(string=hai) anos |
|
Michael Coppola
|
27379455c3
server : support for multiple api keys (#4864)
|
%!s(int64=2) %!d(string=hai) anos |
 Behnam M
|
7a9f75c38b
server : update readme to document the new `/health` endpoint (#4866)
|
%!s(int64=2) %!d(string=hai) anos |
|
Behnam M
|
128de3585b
server : update readme about token probs (#4777)
|
%!s(int64=2) %!d(string=hai) anos |
 Zsapi
|
8c58330318
server : add api-key flag to documentation (#4832)
|
%!s(int64=2) %!d(string=hai) anos |
|
Michael Coppola
|
e5804313a1
server : fix options in README.md (#4765)
|
%!s(int64=2) %!d(string=hai) anos |
 Karthik Sethuraman
|
b93edd22f5
server : allow to generate multimodal embeddings (#4681)
|
%!s(int64=2) %!d(string=hai) anos |
|
Alexey Parfenov
|
6123979952
server : allow to specify custom prompt for penalty calculation (#3727)
|
%!s(int64=2) %!d(string=hai) anos |
 Yueh-Po Peng
|
8a7b2fa528
Update README.md (#4388)
|
%!s(int64=2) %!d(string=hai) anos |
 Georgi Gerganov
|
af19d35734
server : OAI API compatibility (#4198)
|
%!s(int64=2) %!d(string=hai) anos |
 Mihai
|
57ad015dc3
server : add min_p param (#3877)
|
%!s(int64=2) %!d(string=hai) anos |
 Thái Hoàng Tâm
|
bb60fd0bf6
server : fix typo for --alias shortcut from -m to -a (#3958)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
438c2ca830
server : parallel decoding and multimodal (#3677)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
e74c705e15
editorconfig : remove trailing spaces
|
%!s(int64=2) %!d(string=hai) anos |
 coezbek
|
3ad1e3f1a1
server : documentation of JSON return value of /completion endpoint (#3632)
|
%!s(int64=2) %!d(string=hai) anos |
|
Mihai
|
cb13d73a72
server : docs fix default values and add n_probs (#3506)
|
%!s(int64=2) %!d(string=hai) anos |
 vvhg1
|
c97f01c362
infill : add new example + extend server API (#3296)
|
%!s(int64=2) %!d(string=hai) anos |
