 slaren
|
2d099e5193
ggml: add names to tensors (#1268)
|
%!s(int64=2) %!d(string=hai) anos |
 slaren
|
58b367c2d7
cuBLAS: refactor and optimize f16 mat mul performance (#1259)
|
%!s(int64=2) %!d(string=hai) anos |
 Georgi Gerganov
|
6bc4400e67
ggml : add Q5 WASM SIMD + GGML_FTYPE
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
0b5a935099
ggml : fix visibility and unused warnings
|
%!s(int64=2) %!d(string=hai) anos |
 Stephan Walter
|
36d19a603b
Remove Q4_3 which is no better than Q5 (#1218)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
55390bcaf2
ggml : sync ggml (ggml_alibi)
|
%!s(int64=2) %!d(string=hai) anos |
 0cc4m
|
7296c961d9
ggml : add CLBlast support (#1164)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
574406dc7e
ggml : add Q5_0 and Q5_1 quantization (#1187)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
7a32fcb3b2
ggml : add Q8_0 quantization format (rename the old one to Q8_1) (ARM NEON) (#1179)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
8a0f8673ba
ggml : export symbols (#1155)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
12b5900dbc
ggml : sync ggml (add GPT-NeoX RoPE implementation)
|
%!s(int64=2) %!d(string=hai) anos |
 Kawrakow
|
38de86a711
llama : multi-threaded quantization (#1075)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
e0305ead3a
ggml : add Q4_3 quantization (#1082)
|
%!s(int64=2) %!d(string=hai) anos |
|
slaren
|
8944a13296
Add NVIDIA cuBLAS support (#1044)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
77a73403ca
ggml : add new Q4_2 quantization (ARM only) (#1046)
|
%!s(int64=2) %!d(string=hai) anos |
|
slaren
|
315a95a4d3
Add LoRA support (#820)
|
%!s(int64=2) %!d(string=hai) anos |
 Ivan Komarov
|
f266259ad9
Speedup the AVX-512 implementation of ggml_vec_dot_q4_0() (#933)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
e95b6554b4
ggml : add Q8_0 quantization for intermediate results (#951)
|
%!s(int64=2) %!d(string=hai) anos |
 Pavol Rusnak
|
c56b715269
Expose type name from ggml (#970)
|
%!s(int64=2) %!d(string=hai) anos |
 Kerfuffle
|
c9a59b70a5
ggml : add unary and binary map operations (#874)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
a3a2a0eda8
ggml : add GGML_DEFAULT_N_THREADS
|
%!s(int64=2) %!d(string=hai) anos |
|
Stephan Walter
|
3e6e70d8e8
Add enum llama_ftype, sync ggml_type to model files (#709)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
c3ac702e5e
ggml : add ggml_cont() + optimize ggml_cpy() for contiguous dst
|
%!s(int64=2) %!d(string=hai) anos |
 comex
|
f963b63afa
Rewrite loading code to try to satisfy everyone:
|
%!s(int64=2) %!d(string=hai) anos |
 unbounded
|
62cfc54f77
Add quantize-stats command for testing quantization (#728)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
986b6ce9f9
ggml, llama : avoid heavy V transpose + improvements (#775)
|
%!s(int64=2) %!d(string=hai) anos |
 Marian Cepok
|
c0bb1d3ce2
ggml : change ne to int64_t (#626)
|
%!s(int64=2) %!d(string=hai) anos |
 Justine Tunney
|
6f23ba5ee2
Ensure --mlock works properly with mmap() support
|
%!s(int64=2) %!d(string=hai) anos |
|
Slaren
|
c03ae8dca1
Add mmap support for model files
|
%!s(int64=2) %!d(string=hai) anos |
|
Stephan Walter
|
c1f885067c
ggml : introduce structs for the q4 data blocks (#356)
|
%!s(int64=2) %!d(string=hai) anos |
