 Georgi Gerganov
|
2b4ea35e56
cuda : add batched cuBLAS GEMM for faster attention (#3749)
|
%!s(int64=2) %!d(string=hai) anos |
 Marcus Dunn
|
5be6c803fa
llama : remove token functions with `context` args in favor of `model` (#3720)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
22c69a2794
batched : add len CLI argument
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
0e89203b51
speculative : add tree-based sampling example (#3624)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
8c70a5ff25
batched : add bench tool (#3545)
|
%!s(int64=2) %!d(string=hai) anos |
 slaren
|
16bc66d947
llama.cpp : split llama_context_params into model and context params (#3301)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
ec893798b7
llama : custom attention mask + parallel decoding + no context swaps (#3228)
|
%!s(int64=2) %!d(string=hai) anos |
