 Georgi Gerganov
|
53aba3f393
clang-tidy : restore dot file from accidental deletion
|
2 سال پیش |
 Kawrakow
|
4161bdc04d
metal : add Q4_K implementation (#1733)
|
2 سال پیش |
 johnson442
|
0035858273
k-quants : add missing compile definition to CMakeLists (#1748)
|
2 سال پیش |
|
Georgi Gerganov
|
5c64a0952e
k-quants : allow to optionally disable at compile time (#1734)
|
2 سال پیش |
 jacobi petrucciani
|
5b57a5b726
flake : update to support metal on m1/m2 (#1724)
|
2 سال پیش |
|
Georgi Gerganov
|
4dc62c545d
readme : add June roadmap
|
2 سال پیش |
 Willy Tarreau
|
35a84916fb
main: add the possibility to open the prompt cache read-only (#1640)
|
2 سال پیش |
|
Georgi Gerganov
|
2d7bf110ed
llama : fix vram_scratch var
|
2 سال پیش |
|
Georgi Gerganov
|
2a4e41a086
llama : fix compile warnings
|
2 سال پیش |
 Johannes Gäßler
|
17366df842
Multi GPU support, CUDA refactor, CUDA scratch buffer (#1703)
|
2 سال پیش |
|
Georgi Gerganov
|
44f906e853
metal : add f16 support
|
2 سال پیش |
 LostRuins
|
d5b111f53d
Clblast fixes + enhancements to save VRAM and offload more layers (#1675)
|
2 سال پیش |
|
Georgi Gerganov
|
2d43387daf
ggml : fix builds, add ggml-quants-k.o (close #1712, close #1710)
|
2 سال پیش |
|
Georgi Gerganov
|
7ad7750c5c
gitignore : add .clang-tidy
|
2 سال پیش |
|
Georgi Gerganov
|
7a74dee6b4
llama : temporary disable Q6_K output quantization (#1711)
|
2 سال پیش |
 Spencer Sutton
|
590250f7a9
metal : add checks for buffer size (#1706)
|
2 سال پیش |
 Yuval Peled
|
f4c55d3bd7
docs : add performance troubleshoot + example benchmark documentation (#1674)
|
2 سال پیش |
 Foul-Tarnished
|
f1465624c2
readme : fix typo (#1700)
|
2 سال پیش |
 mgroeber9110
|
c2df36d60d
llama : consistently catch and throw only exceptions deriving from std::exception (#1599)
|
2 سال پیش |
 kiltyj
|
9d0693bce3
metal : use shared buffers between CPU and GPU (#1696)
|
2 سال پیش |
 grahameth
|
efe0507632
ggml : fix internal overflow in ggml_time_us on Windows (#1702)
|
2 سال پیش |
|
Georgi Gerganov
|
e7fe66e670
ci : disable auto tidy (#1705)
|
2 سال پیش |
|
Kawrakow
|
99009e72f8
ggml : add SOTA 2,3,4,5,6 bit k-quantizations (#1684)
|
2 سال پیش |
 Henri Vasserman
|
5220a991a5
Increase 3B scratch buffers. (#1698)
|
2 سال پیش |
|
Georgi Gerganov
|
d1f563a743
llama : fix Metal KV cache sync (close #1695)
|
2 سال پیش |
|
Georgi Gerganov
|
827f5eda91
readme : update hot topics
|
2 سال پیش |
|
Georgi Gerganov
|
ecb217db4f
llama : Metal inference (#1642)
|
2 سال پیش |
 0cc4m
|
dcb2ed4826
OpenCL: Fix duplication of layers in VRAM and RAM, add GPU mul kernel (#1653)
|
2 سال پیش |
|
Henri Vasserman
|
d8bd0013e8
Add info about CUDA_VISIBLE_DEVICES (#1682)
|
2 سال پیش |
 Jiří Podivín
|
b5c85468a3
Docker: change to calling convert.py (#1641)
|
2 سال پیش |
