 Georgi Gerganov
|
af04481e6b
model : do not repack if a GPU device is present (#12498)
|
10 months ago |
 Sigbjørn Skjæret
|
960e726077
chore : cleanup llama_model_loader::TENSOR_ usage (#12492)
|
10 months ago |
 marcoStocchi
|
ea1518e839
llama-tts : avoid crashes related to bad model file paths (#12482)
|
10 months ago |
 蕭澧邦
|
1aa87ee53d
[SYCL] Fix build on Windows when ccache enabled (#9954) (#9976)
|
10 months ago |
 Svetlozar Georgiev
|
9ffcc9e374
sycl: cleanup oneDNN related code (#12097)
|
10 months ago |
 Woof Dog
|
e04643063b
webui : Prevent rerendering on textarea input (#12299)
|
10 months ago |
|
Sigbjørn Skjæret
|
dbb3a4739e
llama : make Qwen2MoE QKV bias optional (#12477)
|
10 months ago |
 Srihari-mcw
|
3d82dbcbce
ggml : block interleaving support for Q4_K quantization for x86 AVX2 architecture (#12332)
|
10 months ago |
 Bartowski
|
732b5fbf5e
convert : avoid calls to tokenizer.added_tokens_decoder (#12473)
|
10 months ago |
 fairydreaming
|
568013d0cd
context : clear sets containing encoder output sequence ids before storing new values (#12470)
|
10 months ago |
 Gaurav Garg
|
517b5ddbf0
CUDA: Improve flash decoding kernel GPU occupancy for BS=1 case (#12183)
|
10 months ago |
 Jeff Bolz
|
a9b59288e2
vulkan: optimize iq1 coopmat2 dequant functions (#12427)
|
10 months ago |
 Guus Waals
|
0fd8487b14
Fix visionOS build and add CI (#12415)
|
10 months ago |
|
Sigbjørn Skjæret
|
108e53c2f1
llama : add support for GPT2, Bloom and CodeShell tied word embeddings (#12456)
|
10 months ago |
|
Sigbjørn Skjæret
|
a686171ea7
convert : Support chat_template.json (#12460)
|
10 months ago |
|
Jeff Bolz
|
c446b2edd2
vulkan: Submit once enough matmul work has been recorded (#12406)
|
10 months ago |
 lhez
|
d84635b1b0
opencl: improve profiling (#12442)
|
10 months ago |
|
Georgi Gerganov
|
75422e8bc4
graph : normalize Q, K, V shapes + sync cross attention (#12449)
|
10 months ago |
 R0CKSTAR
|
bb115d2bf7
musa: override warp_size of musa device to 32 (#12445)
|
10 months ago |
 Xuan-Son Nguyen
|
29fff308c7
llama : support converting Mistral Small text-only (#12450)
|
10 months ago |
|
Georgi Gerganov
|
c6af2161b2
speculative : fix seg fault in certain cases (#12454)
|
10 months ago |
|
Xuan-Son Nguyen
|
99aa304fb9
llama : add support for EXAONE tied word embeddings (#12451)
|
10 months ago |
|
Georgi Gerganov
|
8551c44d84
context : always use non-causal attention for encoder graphs (#12447)
|
10 months ago |
 Łukasz Ślusarczyk
|
35cae5ba05
SYCL: using graphs is configurable by environment variable and compile option (#12371)
|
10 months ago |
|
Georgi Gerganov
|
810e0af3f5
server : fix warmup draft cache type (#12446)
|
10 months ago |
 Prajwal B Mehendarkar
|
eba92d64c3
cmake : fix PowerPC build (#12241)
|
10 months ago |
 fj-y-saito
|
d9a14523bb
ggml : add SVE support for q6_K_q8_K (#12361)
|
10 months ago |
 0cc4m
|
fd123cfead
Vulkan: Default to 1GB allocations instead of 4GB to avoid fragmentation and driver issues (#12434)
|
10 months ago |
|
Łukasz Ślusarczyk
|
a53f7f7b88
fixed compilation warnings in ggml-sycl (#12424)
|
10 months ago |
 Molly Sophia
|
7dfad387e3
llama: Add support for RWKV v7 architecture (#12412)
|
10 months ago |
