 Leng Yue
|
35f73049af
speculative : add heuristic algorithm (#3006)
|
%!s(int64=2) %!d(string=hai) anos |
 FK
|
84e723653c
speculative: add --n-gpu-layers-draft option (#3063)
|
%!s(int64=2) %!d(string=hai) anos |
 Przemysław Pawełczyk
|
cb6c44c5e0
build : do not use _GNU_SOURCE gratuitously (#2035)
|
%!s(int64=2) %!d(string=hai) anos |
 Georgi Gerganov
|
921772104b
speculative : add grammar support (#2991)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
47068e5170
speculative : PoC for speeding-up inference via speculative sampling (#2926)
|
%!s(int64=2) %!d(string=hai) anos |
