 Georgi Gerganov
|
e92d53b29e
sampling : optimize samplers by reusing bucket sort (#15665)
|
4 kuukautta sitten |
|
Georgi Gerganov
|
0d161f021a
server : enable /slots by default and make it secure (#15630)
|
4 kuukautta sitten |
 Sigbjørn Skjæret
|
84ab83cc0b
model : jina-embeddings-v3 support (#13693)
|
4 kuukautta sitten |
 65a
|
4afb0a746f
server : Support multimodal completion and embeddings prompts in JSON format (#15108)
|
4 kuukautta sitten |
 teo
|
1bc664a26a
server: fix OpenAI API compatibility for usage statistics in chat streams (#15444)
|
4 kuukautta sitten |
 davidef
|
d1d8241600
server : fix incoming tasks not process in order (#15395)
|
5 kuukautta sitten |
 Oleksandr Kuvshynov
|
e5155e6986
server : export max observed n_past value (#15361)
|
5 kuukautta sitten |
 Diego Devesa
|
f75b830647
chat : include kwargs in template example (#15309)
|
5 kuukautta sitten |
|
Georgi Gerganov
|
d32e03f449
server : add SWA checkpoints (#15293)
|
5 kuukautta sitten |
|
Sigbjørn Skjæret
|
b3e16665e1
server : enable -td and -tbd parameters (#15172)
|
5 kuukautta sitten |
 Copilot
|
d8914fc47e
common : add --override-tensor-draft, --cpu-moe-draft and --n-cpu-moe-draft parameters (#15191)
|
5 kuukautta sitten |
 Xuan-Son Nguyen
|
53d0a12658
server : allow specifying reasoning_format in HTTP request (#15238)
|
5 kuukautta sitten |
 Johannes Gäßler
|
f906275537
server: enable token array inputs for OAI API (#15001)
|
5 kuukautta sitten |
 g2mt
|
94933c8c2e
server : implement universal assisted decoding (#12635)
|
5 kuukautta sitten |
 Lukas Straub
|
a9f77a8be3
server : add openai-style logit_bias support (#14946)
|
5 kuukautta sitten |
 Daniel Bevenius
|
41e78c567e
server : add support for `embd_normalize` parameter (#14964)
|
5 kuukautta sitten |
 Molly Sophia
|
adef81781a
server : allow setting `--reverse-prompt` arg (#14799)
|
5 kuukautta sitten |
 IsaacDynamo
|
b4efd77f8a
server : add parse_special option to /tokenize endpoint (#14783)
|
6 kuukautta sitten |
|
Georgi Gerganov
|
6ffd4e9c44
server : pre-calculate EOG logit biases (#14721)
|
6 kuukautta sitten |
|
Georgi Gerganov
|
538cc77f7f
server : fix handling of the ignore_eos flag (#14710)
|
6 kuukautta sitten |
 Douglas Hanley
|
0c1df14b5f
server : fix pooled embedding output (#14645)
|
6 kuukautta sitten |
 Alawode Oluwandabira
|
17a1f0d2d4
server: Add ability to mount server at prefix (#14544)
|
6 kuukautta sitten |
 matteo
|
caf5681fcb
server : support jinja extra template kwargs (Qwen3 enable_thinking feature), from command line and from client (#13196)
|
6 kuukautta sitten |
|
Georgi Gerganov
|
7b50d589a8
kv-cells : fix tracking of seq_pos (#14339)
|
6 kuukautta sitten |
|
Georgi Gerganov
|
4c9fdfbe15
ubatch : new splitting logic (#14217)
|
7 kuukautta sitten |
 aa956
|
d67341dc18
server : add server parameters for draft model cache type (#13782)
|
7 kuukautta sitten |
|
Georgi Gerganov
|
89fea80d29
server : fix incorrect usage of llama_get_embeddings() (#14225)
|
7 kuukautta sitten |
|
Georgi Gerganov
|
d3e64b9f49
llama : rework embeddings logic (#14208)
|
7 kuukautta sitten |
 Eric Curtin
|
cd355eda7d
server : When listening on a unix domain socket don't print http:// and port (#14180)
|
7 kuukautta sitten |
|
Georgi Gerganov
|
ffad043973
server : fix SWA condition for full context reprocess (#14163)
|
7 kuukautta sitten |
