 slaren
|
58b367c2d7
cuBLAS: refactor and optimize f16 mat mul performance (#1259)
|
%!s(int64=2) %!d(string=hai) anos |
|
slaren
|
b925f1f1b0
cuBLAS: fall back to pageable memory if pinned alloc fails (#1233)
|
%!s(int64=2) %!d(string=hai) anos |
|
slaren
|
7fc50c051a
cuBLAS: use host pinned memory and dequantize while copying (#1207)
|
%!s(int64=2) %!d(string=hai) anos |
 Henri Vasserman
|
b1ee8f59b4
cuBLAS: non-contiguous tensor support (#1215)
|
%!s(int64=2) %!d(string=hai) anos |
 Stephan Walter
|
36d19a603b
Remove Q4_3 which is no better than Q5 (#1218)
|
%!s(int64=2) %!d(string=hai) anos |
 Georgi Gerganov
|
574406dc7e
ggml : add Q5_0 and Q5_1 quantization (#1187)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
7a32fcb3b2
ggml : add Q8_0 quantization format (rename the old one to Q8_1) (ARM NEON) (#1179)
|
%!s(int64=2) %!d(string=hai) anos |
|
slaren
|
50cb666b8a
Improve cuBLAS performance by using a memory pool (#1094)
|
%!s(int64=2) %!d(string=hai) anos |
|
slaren
|
2005469ea1
Add Q4_3 support to cuBLAS (#1086)
|
%!s(int64=2) %!d(string=hai) anos |
|
slaren
|
02d6988121
Improve cuBLAS performance by dequantizing on the GPU (#1065)
|
%!s(int64=2) %!d(string=hai) anos |
