 Georgi Gerganov
|
b97ca431db
ggml : sync latest ggml repo (#1924)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
ce2c7d72e2
metal : handle buffers larger than device's maxBufferLength (#1826)
|
%!s(int64=2) %!d(string=hai) anos |
 Johannes Gäßler
|
254a7a7a5f
CUDA full GPU acceleration, KV cache in VRAM (#1827)
|
%!s(int64=2) %!d(string=hai) anos |
 xaedes
|
e32089b2c2
train : improved training-from-scratch example (#1652)
|
%!s(int64=2) %!d(string=hai) anos |
|
Johannes Gäßler
|
17366df842
Multi GPU support, CUDA refactor, CUDA scratch buffer (#1703)
|
%!s(int64=2) %!d(string=hai) anos |
 Kawrakow
|
99009e72f8
ggml : add SOTA 2,3,4,5,6 bit k-quantizations (#1684)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
ecb217db4f
llama : Metal inference (#1642)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
7552ac5863
ggml : sync cgraph import / export API
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
93618031c7
ggml : add ggml_tensor_overhead()
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
bdbda1b17a
ggml : sync ggml core (minor additions, e.g. ggml_get_tensor_by_name())
|
%!s(int64=2) %!d(string=hai) anos |
 0cc4m
|
2e6cd4b025
OpenCL Token Generation Acceleration (#1459)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
3de84b2606
ggml : add ggml_clamp() (#1539)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
2d5db48371
ggml : use F16 instead of F32 in Q4_0, Q4_1, Q8_0 (#1508)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
13c351ad72
ggml : various fixes (#1450)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
601a033475
ggml : add GGML_QNT_VERSION to track quantization format changes
|
%!s(int64=2) %!d(string=hai) anos |
|
Johannes Gäßler
|
905d87b70a
ggml : GPU-accelerated token generation (#1412)
|
%!s(int64=2) %!d(string=hai) anos |
|
xaedes
|
f954edda93
ggml : implement backward pass for llama + small training-llama-from-scratch example (#1360)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
b9fd7eee57
ggml : remove bit shuffling (#1405)
|
%!s(int64=2) %!d(string=hai) anos |
 slaren
|
2d099e5193
ggml: add names to tensors (#1268)
|
%!s(int64=2) %!d(string=hai) anos |
 slaren
|
58b367c2d7
cuBLAS: refactor and optimize f16 mat mul performance (#1259)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
6bc4400e67
ggml : add Q5 WASM SIMD + GGML_FTYPE
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
0b5a935099
ggml : fix visibility and unused warnings
|
%!s(int64=2) %!d(string=hai) anos |
 Stephan Walter
|
36d19a603b
Remove Q4_3 which is no better than Q5 (#1218)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
55390bcaf2
ggml : sync ggml (ggml_alibi)
|
%!s(int64=2) %!d(string=hai) anos |
|
0cc4m
|
7296c961d9
ggml : add CLBlast support (#1164)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
574406dc7e
ggml : add Q5_0 and Q5_1 quantization (#1187)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
7a32fcb3b2
ggml : add Q8_0 quantization format (rename the old one to Q8_1) (ARM NEON) (#1179)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
8a0f8673ba
ggml : export symbols (#1155)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
12b5900dbc
ggml : sync ggml (add GPT-NeoX RoPE implementation)
|
%!s(int64=2) %!d(string=hai) anos |
|
Kawrakow
|
38de86a711
llama : multi-threaded quantization (#1075)
|
%!s(int64=2) %!d(string=hai) anos |
