 slaren
|
16bc66d947
llama.cpp : split llama_context_params into model and context params (#3301)
|
il y a 2 ans |
 Georgi Gerganov
|
ec893798b7
llama : custom attention mask + parallel decoding + no context swaps (#3228)
|
il y a 2 ans |
 Leng Yue
|
35f73049af
speculative : add heuristic algorithm (#3006)
|
il y a 2 ans |
 FK
|
84e723653c
speculative: add --n-gpu-layers-draft option (#3063)
|
il y a 2 ans |
 Przemysław Pawełczyk
|
cb6c44c5e0
build : do not use _GNU_SOURCE gratuitously (#2035)
|
il y a 2 ans |
|
Georgi Gerganov
|
921772104b
speculative : add grammar support (#2991)
|
il y a 2 ans |
|
Georgi Gerganov
|
47068e5170
speculative : PoC for speeding-up inference via speculative sampling (#2926)
|
il y a 2 ans |
