Georgi Gerganov
|
99bd4ac28c
llama : infill sampling handle very long tokens (#9924)
|
пре 1 година |
Tim Wang
|
3752217ed5
readme : update bindings list (#9918)
|
пре 1 година |
Diego Devesa
|
f010b77a37
vulkan : add backend registry / device interfaces (#9721)
|
пре 1 година |
Gilad S.
|
2194200278
fix: allocating CPU buffer with size `0` (#9917)
|
пре 1 година |
Gilad S.
|
73afe681aa
fix: use `vm_allocate` to allocate CPU backend buffer on macOS (#9875)
|
пре 1 година |
Daniel Bevenius
|
9e04102448
llama : suppress conversion from 'size_t' to 'int' (#9046)
|
пре 1 година |
Daniel Bevenius
|
dbf18e4de9
llava : fix typo in error message [no ci] (#9884)
|
пре 1 година |
Joe Eli McIlvain
|
66c2c93082
grammar : fix JSON Schema for string regex with top-level alt. (#9903)
|
пре 1 година |
Molly Sophia
|
10433e8b45
llama : add tensor name for "result_norm" (#9907)
|
пре 1 година |
Alexey Parfenov
|
1f66b699c4
server : fix the disappearance of the end of the text (#9867)
|
пре 1 година |
Georgi Gerganov
|
0e41b300ed
sync : ggml
|
пре 1 година |
Daniel Bevenius
|
cd60b88bf7
ggml-alloc : remove buffer_id from leaf_alloc (ggml/987)
|
пре 1 година |
leo-pony
|
becfd387f6
[CANN] Fix cann compilation error (#9891)
|
пре 1 година |
Georgi Gerganov
|
755a9b2bf0
llama : add infill sampler (#9896)
|
пре 1 година |
Georgi Gerganov
|
223c25a72f
server : improve infill context reuse (#9894)
|
пре 1 година |
MaggotHATE
|
fbc98b748e
sampling : add XTC sampler (#9742)
|
пре 1 година |
Georgi Gerganov
|
dcdd535302
server : update preact (#9895)
|
пре 1 година |
Michał Tuszyński
|
4c42f93b22
readme : update bindings list (#9889)
|
пре 1 година |
VoidIsVoid
|
a89f75e1b7
server : handle "logprobs" field with false value (#9871)
|
пре 1 година |
agray3
|
13dca2a54a
Vectorize load instructions in dmmv f16 CUDA kernel (#9816)
|
пре 1 година |
Georgi Gerganov
|
d4c19c0f5c
server : accept extra_context for the infill endpoint (#9874)
|
пре 1 година |
Georgi Gerganov
|
c7181bd294
server : reuse cached context chunks (#9866)
|
пре 1 година |
Georgi Gerganov
|
92be9f1216
flake.lock: Update (#9870)
|
пре 1 година |
Georgi Gerganov
|
edc265661c
server : add option to time limit the generation phase (#9865)
|
пре 1 година |
Georgi Gerganov
|
1bde94dd02
server : remove self-extend features (#9860)
|
пре 1 година |
Georgi Gerganov
|
95c76e8e92
server : remove legacy system_prompt feature (#9857)
|
пре 1 година |
Georgi Gerganov
|
11ac9800af
llama : improve infill support and special token detection (#9798)
|
пре 1 година |
R0CKSTAR
|
943d20b411
musa : update doc (#9856)
|
пре 1 година |
Diego Devesa
|
96776405a1
ggml : move more prints to the ggml log system (#9839)
|
пре 1 година |
Diego Devesa
|
7eee341bee
common : use common_ prefix for common library functions (#9805)
|
пре 1 година |