 Georgi Gerganov
|
e437b37fd0
scripts : parse wtype in server-llm.sh (#5167)
|
1 year ago |
 Mirror Azure
|
2d40085c26
py : add check for '.attn.masked_bias' layers to GPT2model (#5281)
|
1 year ago |
 AidanBeltonS
|
b05102fe8c
Tidy ggml-sycl (#5261)
|
1 year ago |
 Xuan Son Nguyen
|
6b91b1e0a9
docker : add build for SYCL, Vulkan + update readme (#5228)
|
1 year ago |
 Meng, Hengyu
|
e805f0fa99
[SYCL] get MAX_MEM_ALLOC from device property (#5270)
|
1 year ago |
 Neo Zhang Jianyu
|
af3ba5d946
[SYCL] update guide of SYCL backend (#5254)
|
1 year ago |
 Ian Bull
|
e1e721094d
llama : fix memory leak in llama_batch_free (#5252)
|
1 year ago |
|
Neo Zhang Jianyu
|
128dcbd3c9
add --no-mmap in llama-bench (#5257)
|
2 years ago |
 0cc4m
|
4d0924a890
Vulkan Phi Fix for AMD Proprietary Drivers (#5260)
|
2 years ago |
 slaren
|
8ca511cade
cuda : fix LLAMA_CUDA_F16 (#5262)
|
2 years ago |
 Ali Nehzat
|
d71ac90985
make : generate .a library for static linking (#5205)
|
2 years ago |
 Guoteng
|
ce32060198
llama : support InternLM2 (#5184)
|
2 years ago |
 Eve
|
1cfb5372cf
Fix broken Vulkan Cmake (properly) (#5230)
|
2 years ago |
|
Georgi Gerganov
|
d3bac7d584
llama : reorder build_orion() at correct place (#5118)
|
2 years ago |
|
Georgi Gerganov
|
5cb04dbc16
llama : remove LLAMA_MAX_DEVICES and LLAMA_SUPPORTS_GPU_OFFLOAD (#5240)
|
2 years ago |
|
Georgi Gerganov
|
efb7bdbbd0
metal : add im2col F32 dst support (#5132)
|
2 years ago |
 JidongZhang-THU
|
15606309a0
llava : add MobileVLM support (#5132)
|
2 years ago |
|
Neo Zhang Jianyu
|
b2b9f025e7
format license text, restore apache license by legal suggestion (#5233)
|
2 years ago |
|
slaren
|
dabcc5b471
ggml : limit n_threads to the max n_tasks (#5238)
|
2 years ago |
|
0cc4m
|
f8e9140cb4
Vulkan Fixes (#5223)
|
2 years ago |
 Yiming Cui
|
d62520eb2c
Fix typos of IQ2_XXS and IQ3_XXS in llama.cpp (#5231)
|
2 years ago |
|
Neo Zhang Jianyu
|
01684139c3
support SYCL backend windows build (#5208)
|
2 years ago |
 Jared Van Bortel
|
e8dc55d006
kompute : llama-bench support and ggml_cpu_has_kompute() (#5226)
|
2 years ago |
|
Georgi Gerganov
|
e0085fdf7c
Revert "server : change deps.sh xxd files to string literals (#5221)"
|
2 years ago |
|
Georgi Gerganov
|
e6f291d158
server : fix context shift (#5195)
|
2 years ago |
 JohnnyB
|
4003be0e5f
server : change deps.sh xxd files to string literals (#5221)
|
2 years ago |
 Kawrakow
|
fea4fd4ba7
ggml : fix IQ3_XXS on Metal (#5219)
|
2 years ago |
|
Georgi Gerganov
|
8f8ddfcfad
sync : ggml (#0)
|
2 years ago |
|
Georgi Gerganov
|
6fb50ebbf0
gguf : fix comparison (ggml/715)
|
2 years ago |
 John Balis
|
625a699b54
`ggml_cuda_cpy` support for 4d tensors and float16->float32 upcasting (ggml/686)
|
2 years ago |
