 Georgi Gerganov
|
0bf7cf1b29
Revert "ggml : load data into int8x16x4_t using vld4q_s8 on arm64 (#1738)"
|
2 years ago |
 le.chang
|
8432d4d9f7
ggml : load data into int8x16x4_t using vld4q_s8 on arm64 (#1738)
|
2 years ago |
 Kawrakow
|
0f291e1f65
metal : Q6_K implementation (#1752)
|
2 years ago |
 qingfengfenga
|
8fc8179919
Add llama.cpp docker support for non-latin languages (#1673)
|
2 years ago |
 Steven Roussey
|
b50b570ed9
ggml : fix fprintf warnings (#1720)
|
2 years ago |
|
Georgi Gerganov
|
53aba3f393
clang-tidy : restore dot file from accidental deletion
|
2 years ago |
|
Kawrakow
|
4161bdc04d
metal : add Q4_K implementation (#1733)
|
2 years ago |
 johnson442
|
0035858273
k-quants : add missing compile definition to CMakeLists (#1748)
|
2 years ago |
|
Georgi Gerganov
|
5c64a0952e
k-quants : allow to optionally disable at compile time (#1734)
|
2 years ago |
 jacobi petrucciani
|
5b57a5b726
flake : update to support metal on m1/m2 (#1724)
|
2 years ago |
|
Georgi Gerganov
|
4dc62c545d
readme : add June roadmap
|
2 years ago |
 Willy Tarreau
|
35a84916fb
main: add the possibility to open the prompt cache read-only (#1640)
|
2 years ago |
|
Georgi Gerganov
|
2d7bf110ed
llama : fix vram_scratch var
|
2 years ago |
|
Georgi Gerganov
|
2a4e41a086
llama : fix compile warnings
|
2 years ago |
 Johannes Gäßler
|
17366df842
Multi GPU support, CUDA refactor, CUDA scratch buffer (#1703)
|
2 years ago |
|
Georgi Gerganov
|
44f906e853
metal : add f16 support
|
2 years ago |
 LostRuins
|
d5b111f53d
Clblast fixes + enhancements to save VRAM and offload more layers (#1675)
|
2 years ago |
|
Georgi Gerganov
|
2d43387daf
ggml : fix builds, add ggml-quants-k.o (close #1712, close #1710)
|
2 years ago |
|
Georgi Gerganov
|
7ad7750c5c
gitignore : add .clang-tidy
|
2 years ago |
|
Georgi Gerganov
|
7a74dee6b4
llama : temporary disable Q6_K output quantization (#1711)
|
2 years ago |
 Spencer Sutton
|
590250f7a9
metal : add checks for buffer size (#1706)
|
2 years ago |
 Yuval Peled
|
f4c55d3bd7
docs : add performance troubleshoot + example benchmark documentation (#1674)
|
2 years ago |
 Foul-Tarnished
|
f1465624c2
readme : fix typo (#1700)
|
2 years ago |
 mgroeber9110
|
c2df36d60d
llama : consistently catch and throw only exceptions deriving from std::exception (#1599)
|
2 years ago |
 kiltyj
|
9d0693bce3
metal : use shared buffers between CPU and GPU (#1696)
|
2 years ago |
 grahameth
|
efe0507632
ggml : fix internal overflow in ggml_time_us on Windows (#1702)
|
2 years ago |
|
Georgi Gerganov
|
e7fe66e670
ci : disable auto tidy (#1705)
|
2 years ago |
|
Kawrakow
|
99009e72f8
ggml : add SOTA 2,3,4,5,6 bit k-quantizations (#1684)
|
2 years ago |
 Henri Vasserman
|
5220a991a5
Increase 3B scratch buffers. (#1698)
|
2 years ago |
|
Georgi Gerganov
|
d1f563a743
llama : fix Metal KV cache sync (close #1695)
|
2 years ago |
