 Georgi Gerganov
|
06658ad7c3
metal : separate scale and mask from QKT in FA kernel (#9189)
|
vor 1 Jahr |
|
Georgi Gerganov
|
fc18425b6a
ggml : add SSM Metal kernels (#8546)
|
vor 1 Jahr |
|
Georgi Gerganov
|
879275ac98
tests : fix compile warnings for unreachable code (#9185)
|
vor 1 Jahr |
|
Georgi Gerganov
|
7a3df798fc
ci : add VULKAN support to ggml-ci (#9055)
|
vor 1 Jahr |
|
Georgi Gerganov
|
e5edb210cd
server : update deps (#9183)
|
vor 1 Jahr |
 slaren
|
0c41e03ceb
metal : gemma2 flash attention support (#9159)
|
vor 1 Jahr |
|
slaren
|
f12ceaca0c
ggml-ci : try to improve build time (#9160)
|
vor 1 Jahr |
 Justine Tunney
|
436787f170
llama : fix time complexity of string replacement (#9163)
|
vor 1 Jahr |
 Herman Semenov
|
93bc3839f9
common: fixed not working find argument --n-gpu-layers-draft (#9175)
|
vor 1 Jahr |
 Johannes Gäßler
|
f91fc5639b
CUDA: fix Gemma 2 numerical issues for FA (#9166)
|
vor 1 Jahr |
|
Johannes Gäßler
|
e11bd856d5
CPU/CUDA: Gemma 2 FlashAttention support (#8542)
|
vor 1 Jahr |
 João Dinis Ferreira
|
8f824ffe8e
quantize : fix typo in usage help of `quantize.cpp` (#9145)
|
vor 1 Jahr |
 Xuan Son Nguyen
|
3ba780e2a8
lora : fix llama conversion script with ROPE_FREQS (#9117)
|
vor 1 Jahr |
 piDack
|
a07c32ea54
llama : use F32 precision in GLM4 attention and no FA (#9130)
|
vor 1 Jahr |
 Akarshan Biswas
|
11b84eb457
[SYCL] Add a space to supress a cmake warning (#9133)
|
vor 1 Jahr |
 luoyu-intel
|
1731d4238f
[SYCL] Add oneDNN primitive support (#9091)
|
vor 1 Jahr |
 compilade
|
a1631e53f6
llama : simplify Mamba with advanced batch splits (#8526)
|
vor 1 Jahr |
|
Xuan Son Nguyen
|
fc54ef0d1c
server : support reading arguments from environment variables (#9105)
|
vor 1 Jahr |
 Younes Belkada
|
b40eb84895
llama : support for `falcon-mamba` architecture (#9074)
|
vor 1 Jahr |
 fairydreaming
|
f63f603c87
llava : zero-initialize clip_ctx structure fields with aggregate initialization 908)
|
vor 1 Jahr |
 Daniel Bevenius
|
8455340b87
llama : std::move llm_bigram_bpe from work_queue (#9062)
|
vor 1 Jahr |
 Changyeon Kim
|
2f3c1466ff
llava: Add ACC OP for GPU acceleration to the Vulkan backend in the LLAVA CLIP model. (#8984)
|
vor 1 Jahr |
 Meng, Hengyu
|
50addec9a5
[SYCL] fallback mmvq (#9088)
|
vor 1 Jahr |
 zhentaoyu
|
4f8d19ff17
[SYCL] Fix SYCL `im2col` and `convert` Overflow with Large Dims (#9052)
|
vor 1 Jahr |
|
fairydreaming
|
90db8146d5
tests : add missing comma in grammar integration tests (#9099)
|
vor 1 Jahr |
 wangshuai09
|
cfac111e2b
cann: add doc for cann backend (#8867)
|
vor 1 Jahr |
 Radoslav Gerganov
|
1b6ff90ff8
rpc : print error message when failed to connect endpoint (#9042)
|
vor 1 Jahr |
|
Radoslav Gerganov
|
18eaf29f4c
rpc : prevent crashes on invalid input (#9040)
|
vor 1 Jahr |
|
Georgi Gerganov
|
554b049068
flake.lock: Update (#9068)
|
vor 1 Jahr |
 ltoniazzi
|
2339a0be1c
tests : add integration test for lora adapters (#8957)
|
vor 1 Jahr |
