Neo Zhang Jianyu
|
25f4a613c4
[SYCL] fix set main gpu crash (#6339)
|
1 year ago |
AidanBeltonS
|
e82f9e2b83
[SYCL] Fix batched impl for NVidia GPU (#6164)
|
1 year ago |
compilade
|
557410b8f0
llama : greatly reduce output buffer memory usage (#6122)
|
1 year ago |
Meng, Hengyu
|
ddf6568510
[SYCL] offload op (#6217)
|
1 year ago |
AidanBeltonS
|
c5b8595e3f
Add nvidia and amd backends (#6157)
|
1 year ago |
slaren
|
2bf8d0f7c4
backend : offload large batches to GPU (#6083)
|
1 year ago |
Neo Zhang Jianyu
|
46acb36767
fix set main gpu error (#6073)
|
1 year ago |
AidanBeltonS
|
753e36f650
[SYCL] Fix non-intel device selection (#6042)
|
1 year ago |
slaren
|
f30ea47a87
llama : add pipeline parallelism support (#6017)
|
1 year ago |
AidanBeltonS
|
b3d978600f
Update get version (#6025)
|
1 year ago |
Georgi Gerganov
|
8030da7afe
ggml : reuse quantum structs across backends (#5943)
|
1 year ago |
Georgi Gerganov
|
48358b2e5b
sycl : update IQ1_S kernels (WIP - not working!) (#5995)
|
1 year ago |
Abhilash Majumder
|
ef3ced26a3
[SYCL] Add q3_s and q1_s (#5886)
|
1 year ago |
Georgi Gerganov
|
8a3012a4ad
ggml : add ggml-common.h to deduplicate shared code (#5940)
|
1 year ago |
Neo Zhang Jianyu
|
89fb735fcf
Revert "[SYCL] fix error when set main gpu to non-zero (#5901)" (#5918)
|
1 year ago |
Neo Zhang Jianyu
|
ceca1aef07
[SYCL] fix error when set main gpu to non-zero (#5901)
|
1 year ago |
Neo Zhang Jianyu
|
8ced9f7e32
add wait() to make code stable (#5895)
|
1 year ago |
Neo Zhang Jianyu
|
21b0867433
[SYCL] fix mul_mat fault in CI/unit-test (#5862)
|
1 year ago |
Michael Podvitskiy
|
9fa2627347
ggml : introduce ggml_status (ggml/750)
|
1 year ago |
Neo Zhang Jianyu
|
715641391d
Support multiple GPUs (split mode) on SYCL backend (#5806)
|
1 year ago |
AidanBeltonS
|
38d1521608
[SYCL] Use batched mul_mat pathway (#5591)
|
1 year ago |
UEXTM.com
|
5f70671856
Introduce backend GUIDs (ggml/743)
|
1 year ago |
AidanBeltonS
|
e849078c6e
[SYCL] Add support for soft_max ALiBi (#5639)
|
1 year ago |
Georgi Gerganov
|
ab336a9d5e
code : normalize enum names (#5697)
|
1 year ago |
Meng, Hengyu
|
88c46cbdac
[SYCL] conext add name (#5624)
|
1 year ago |
AidanBeltonS
|
b9111bd209
Update ggml_sycl_op_mul_mat_vec_q (#5502)
|
1 year ago |
Abhilash Majumder
|
43fe07c1a4
ggml-sycl: Replace 3d ops with macro (#5458)
|
1 year ago |
Abhilash Majumder
|
6e99f2a04f
Fix f16_sycl cpy call from Arc (#5411)
|
1 year ago |
AidanBeltonS
|
4833ac209d
[SYCL] Fix cpy with dims of 3 (#5289)
|
1 year ago |
AidanBeltonS
|
a305dba8ff
Fix im2col with 32fp (#5286)
|
1 year ago |