 Xuan Son Nguyen
|
6e7d133a5f
server : refactor multitask handling (#9274)
|
vor 1 Jahr |
 ardfork
|
978ba3d83d
Server: Don't ignore llama.cpp params (#8754)
|
vor 1 Jahr |
 Georgi Gerganov
|
4e24cffd8c
server : handle content array in chat API (#8449)
|
vor 1 Jahr |
|
Xuan Son Nguyen
|
48e6b92cc3
Add chat template support for llama-cli (#8068)
|
vor 1 Jahr |
 sasha0552
|
7a16ce7db2
server : smart slot selection using Longest Common Prefix (#7728)
|
vor 1 Jahr |
|
Georgi Gerganov
|
1442677f92
common : refactor cli arg parsing (#7675)
|
vor 1 Jahr |
 Benjamin Findley
|
e586ee4259
change default temperature of OAI compat API from 0 to 1 (#7226)
|
vor 1 Jahr |
 Johannes Gäßler
|
c12452c7ae
JSON: [key] -> .at(key), assert() -> GGML_ASSERT (#7143)
|
vor 1 Jahr |
|
Xuan Son Nguyen
|
1fd9c1741d
clean up json_value & server_log (#7142)
|
vor 1 Jahr |
 Pedro Cuenca
|
b97bc3966e
llama : support Llama 3 HF conversion (#6745)
|
vor 1 Jahr |
 Pierrick Hymbert
|
75cd4c7729
ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response (#6495)
|
vor 1 Jahr |
 JH23X
|
60cdf40cc3
server : handle exception on wrong type in request (#6452)
|
vor 1 Jahr |
|
Xuan Son Nguyen
|
ad3a0505e3
Server: clean up OAI params parsing function (#6284)
|
vor 1 Jahr |
|
Pierrick Hymbert
|
1b26aebe4d
server: flush stdout after logging in both text and json layout (#6253)
|
vor 1 Jahr |
 Olivier Chafik
|
72114edf06
json-schema-to-grammar : fix order of props + non-str const/enum (#6232)
|
vor 1 Jahr |
|
Olivier Chafik
|
5b7b0ac8df
json-schema-to-grammar improvements (+ added to server) (#5978)
|
vor 1 Jahr |
 Karthick
|
47cc7a7bf9
Server: Handle n_keep parameter in the request (#6174)
|
vor 1 Jahr |
|
Xuan Son Nguyen
|
99b71c068f
Server: Use multi-task for embeddings endpoint (#6001)
|
vor 1 Jahr |
|
Xuan Son Nguyen
|
caa106d4e0
Server: format error to json (#5961)
|
vor 1 Jahr |
 Minsoo Cheong
|
332bdfd798
server : maintain chat completion id for streaming responses (#5988)
|
vor 1 Jahr |
|
Georgi Gerganov
|
2002bc96bf
server : refactor (#5882)
|
vor 1 Jahr |
|
Pierrick Hymbert
|
9731134296
server: tests: passkey challenge / self-extend with context shift demo (#5832)
|
vor 1 Jahr |
|
Xuan Son Nguyen
|
052051d8ae
Server: normalize naming (#5779)
|
vor 1 Jahr |
|
Pierrick Hymbert
|
930b178026
server: logs - unified format and --log-format option (#5700)
|
vor 1 Jahr |
|
Pierrick Hymbert
|
d52d7819b8
server: concurrency fix + monitoring - add /metrics prometheus compatible endpoint (#5708)
|
vor 1 Jahr |
|
Pierrick Hymbert
|
1ecea255eb
server: health: fix race condition on slots data using tasks queue (#5634)
|
vor 1 Jahr |
|
Xuan Son Nguyen
|
9c405c9f9a
Server: use llama_chat_apply_template (#5593)
|
vor 1 Jahr |
 Daniel Hiltgen
|
66c1968f7a
server : graceful server shutdown (#5244)
|
vor 1 Jahr |
|
Xuan Son Nguyen
|
907e08c110
server : add llama2 chat template (#5425)
|
vor 1 Jahr |
|
Georgi Gerganov
|
753eafed0e
sync : ggml
|
vor 2 Jahren |
