 Georgi Gerganov
|
2a4e41a086
llama : fix compile warnings
|
2 سال پیش |
 Johannes Gäßler
|
17366df842
Multi GPU support, CUDA refactor, CUDA scratch buffer (#1703)
|
2 سال پیش |
|
Georgi Gerganov
|
2d43387daf
ggml : fix builds, add ggml-quants-k.o (close #1712, close #1710)
|
2 سال پیش |
 kiltyj
|
9d0693bce3
metal : use shared buffers between CPU and GPU (#1696)
|
2 سال پیش |
 grahameth
|
efe0507632
ggml : fix internal overflow in ggml_time_us on Windows (#1702)
|
2 سال پیش |
 Kawrakow
|
99009e72f8
ggml : add SOTA 2,3,4,5,6 bit k-quantizations (#1684)
|
2 سال پیش |
|
Georgi Gerganov
|
ecb217db4f
llama : Metal inference (#1642)
|
2 سال پیش |
 0cc4m
|
dcb2ed4826
OpenCL: Fix duplication of layers in VRAM and RAM, add GPU mul kernel (#1653)
|
2 سال پیش |
|
Georgi Gerganov
|
7552ac5863
ggml : sync cgraph import / export API
|
2 سال پیش |
|
Georgi Gerganov
|
5d1830b99d
ggml : fix bug in ggml_alibi
|
2 سال پیش |
 apcameron
|
a6704643b6
ggml : add support for the RISCV architecture (#1616)
|
2 سال پیش |
|
Georgi Gerganov
|
93618031c7
ggml : add ggml_tensor_overhead()
|
2 سال پیش |
|
Georgi Gerganov
|
bdbda1b17a
ggml : sync ggml core (minor additions, e.g. ggml_get_tensor_by_name())
|
2 سال پیش |
|
0cc4m
|
2e6cd4b025
OpenCL Token Generation Acceleration (#1459)
|
2 سال پیش |
|
Georgi Gerganov
|
265db9834e
ggml : output 3d sizes in ggml_graph_dump_dot()
|
2 سال پیش |
|
Georgi Gerganov
|
fab49c685e
ggml : update WASM SIMD
|
2 سال پیش |
|
Georgi Gerganov
|
3de84b2606
ggml : add ggml_clamp() (#1539)
|
2 سال پیش |
|
Johannes Gäßler
|
affc76edfd
cuda : loading models directly into VRAM, norm calculation on GPU, broadcasting for ggml_mul (#1483)
|
2 سال پیش |
 Maxime
|
503db28849
llama : fix name shadowing and C4146 (#1526)
|
2 سال پیش |
|
Georgi Gerganov
|
4fd3e29297
ggml : fix scalar implementation of Q4_1 dot
|
2 سال پیش |
|
Georgi Gerganov
|
2d5db48371
ggml : use F16 instead of F32 in Q4_0, Q4_1, Q8_0 (#1508)
|
2 سال پیش |
 Ilya Kurdyukov
|
42627421ec
~7% faster Q5_1 AVX2 code (#1477)
|
2 سال پیش |
 xaedes
|
79b2d5b69d
ggml : alternative fix for race condition bug in non-inplace ggml_compute_forward_diag_mask_f32 (#1454)
|
2 سال پیش |
|
Georgi Gerganov
|
13c351ad72
ggml : various fixes (#1450)
|
2 سال پیش |
 katsu560
|
60f8c361ca
ggml : add AVX support based on AVX2 code (#1430)
|
2 سال پیش |
|
Georgi Gerganov
|
66841fdb0e
ggml : multi-thread mul and diag_mask ops (#1428)
|
2 سال پیش |
|
Johannes Gäßler
|
905d87b70a
ggml : GPU-accelerated token generation (#1412)
|
2 سال پیش |
|
xaedes
|
f954edda93
ggml : implement backward pass for llama + small training-llama-from-scratch example (#1360)
|
2 سال پیش |
|
Georgi Gerganov
|
f048af0230
ggml : sync alibi fix from ggml repo
|
2 سال پیش |
 3ooabkhxtn
|
ac0cd259d5
Adding SSE instructions to ggml_vec_dot_q4_0_q8_0 (#1413)
|
2 سال پیش |
