 slaren
|
2bf8d0f7c4
backend : offload large batches to GPU (#6083)
|
hai 1 ano |
 bmwl
|
f486f6e1e5
ggml : add numa options (#5377)
|
hai 1 ano |
 Kawrakow
|
5ed26e1fc9
Adding some imatrix tools (#5302)
|
hai 1 ano |
|
Kawrakow
|
15bceec2d7
imatrix : keep intermediate imatrix results (#5077)
|
%!s(int64=2) %!d(string=hai) anos |
|
Kawrakow
|
726c0fa9a2
Slightly faster imatrix (#5050)
|
%!s(int64=2) %!d(string=hai) anos |
 Georgi Gerganov
|
2d5419d08a
imatrix : fix assert for src0 non-cont check
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
ba69bbc84c
imatrix : offload to GPU support (#4957)
|
%!s(int64=2) %!d(string=hai) anos |
|
Kawrakow
|
326b418b59
Importance Matrix calculation (#4861)
|
%!s(int64=2) %!d(string=hai) anos |
