 Kylin
|
cca894f16a
cuda : fix compile error in jetson platform (#4975)
|
2 gadi atpakaļ |
 Georgi Gerganov
|
38566680cd
ggml : add IQ2 to test-backend-ops + refactoring (#4990)
|
2 gadi atpakaļ |
 Justine Tunney
|
a0b3ac8c48
ggml : introduce GGML_CALL function annotation (#4850)
|
2 gadi atpakaļ |
|
Georgi Gerganov
|
ddb008d845
cuda : fix dequantize kernel names (#4938)
|
2 gadi atpakaļ |
 Kawrakow
|
4a3156de2f
CUDA: faster dequantize kernels for Q4_0 and Q4_1 (#4938)
|
2 gadi atpakaļ |
 Johannes Gäßler
|
3fe81781e3
CUDA: faster q8_0 -> f16 dequantization (#4895)
|
2 gadi atpakaļ |
 slaren
|
e7e4df031b
llama : ggml-backend integration (#4766)
|
2 gadi atpakaļ |
|
Johannes Gäßler
|
1b280c9fff
CUDA: fix softmax compile for old CUDA versions (#4862)
|
2 gadi atpakaļ |
|
Kawrakow
|
49662cbed3
ggml : SOTA 2-bit quants (add IQ2_XS) (#4856)
|
2 gadi atpakaļ |
 Erik Scholz
|
f34432ca1e
fix : cuda order of synchronization when setting a buffer (ggml/679)
|
2 gadi atpakaļ |
|
Johannes Gäßler
|
8f900abfc0
CUDA: faster softmax via shared memory + fp16 math (#4742)
|
2 gadi atpakaļ |
|
Kawrakow
|
dd5ae06405
SOTA 2-bit quants (#4773)
|
2 gadi atpakaļ |
|
Johannes Gäßler
|
d5a410e855
CUDA: fixed redundant value dequantization (#4809)
|
2 gadi atpakaļ |
 Konstantin Zhuravlyov
|
63ee677efd
ggml : use __builtin_amdgcn_sudot4 in __dp4a for gfx11 (#4787)
|
2 gadi atpakaļ |
 Finn Voorhees
|
1bf681f90e
ggml : add error handling to graph_compute (whisper/1714)
|
2 gadi atpakaļ |
|
Georgi Gerganov
|
7bed7eba35
cuda : simplify expression
|
2 gadi atpakaļ |
|
Georgi Gerganov
|
d55356d3ba
cuda : mark I16 and I32 ops as unsupported
|
2 gadi atpakaļ |
|
Johannes Gäßler
|
39d8bc71ed
CUDA: fixed tensor cores not being used on RDNA3 (#4697)
|
2 gadi atpakaļ |
|
Johannes Gäßler
|
a20f3c7465
CUDA: fix tensor core logic for Pascal and HIP (#4682)
|
2 gadi atpakaļ |
 hydai
|
91bb39cec7
cuda: fix vmm oom issue on NVIDIA AGX Orin (#4687)
|
2 gadi atpakaļ |
 bssrdf
|
afc8c19291
ggml : fix some mul mat cases + add tests for src1 F16 (ggml/669)
|
2 gadi atpakaļ |
|
slaren
|
dc68f0054c
cuda : fix vmm pool with multi GPU (#4620)
|
2 gadi atpakaļ |
 FantasyGmm
|
77465dad48
Fix new CUDA10 compilation errors (#4635)
|
2 gadi atpakaļ |
|
slaren
|
5bf3953d7e
cuda : improve cuda pool efficiency using virtual memory (#4606)
|
2 gadi atpakaļ |
|
slaren
|
708e179e85
fallback to CPU buffer if host buffer alloc fails (#4610)
|
2 gadi atpakaļ |
|
Johannes Gäßler
|
e0a4002273
CUDA: fixed row rounding for 0 tensor splits (#4594)
|
2 gadi atpakaļ |
|
Georgi Gerganov
|
ba66175132
sync : ggml (fix im2col) (#4591)
|
2 gadi atpakaļ |
|
FantasyGmm
|
a55876955b
cuda : fix jetson compile error (#4560)
|
2 gadi atpakaļ |
 Henrik Forstén
|
6724ef1657
Fix CudaMemcpy direction (#4599)
|
2 gadi atpakaļ |
|
slaren
|
48b7ff193e
llama : fix platforms without mmap (#4578)
|
2 gadi atpakaļ |
