compilade
|
d31192b4ee
imatrix : use GGUF by default (#14842)
|
5 months ago |
compilade
|
0a2f5496be
imatrix : fix 3d activation handling for hybrid and recurrent models (#14994)
|
5 months ago |
compilade
|
11a3811164
memory : handle kv_unified for hybrid models (#15050)
|
5 months ago |
Csaba Kecskemeti
|
97366dc6ab
vocab : JetBrains Mellum pre-tokenizer (#15045)
|
5 months ago |
Gabriel Larson
|
83bc2f288c
model : add text-only support for Kimi-VL (and find special tokens in text_config) (#15051)
|
5 months ago |
Jeff Bolz
|
6c7a441161
vulkan: Use coopmat2 for conv2d (#14982)
|
5 months ago |
lhez
|
5c0eb5ef54
opencl: fix adreno compiler detection logic (#15029)
|
5 months ago |
Johannes Gäßler
|
03d4698218
CUDA: use mma FA kernel for gqa > 4 on RTX 4000 (#15035)
|
5 months ago |
leejet
|
3303c19b16
cuda: make im2col a little faster (#15025)
|
5 months ago |
Daniel Bevenius
|
4fdea540bd
kv-cache : skip alignment of n_stream in kv-cache log msg [no ci] (#15040)
|
5 months ago |
Georgi Gerganov
|
a4569c41fd
llama : enable LLAMA_SET_ROWS=1 by default (#14959)
|
5 months ago |
Georgi Gerganov
|
15e92fd337
cuda, sycl : fix batched gemm when ne02 == 1 && ne03 > 1 (#15038)
|
5 months ago |
Sigbjørn Skjæret
|
2bf3fbf0b5
ci : check that pre-tokenizer hashes are up-to-date (#15032)
|
5 months ago |
Douglas Hanley
|
711d5e6fe6
convert : fix Qwen3-Embedding pre-tokenizer hash (#15030)
|
5 months ago |
Jhen-Jie Hong
|
f738989dcb
chat : fix multiple tool_calls on hermes-2-pro (#14962)
|
5 months ago |
Jeff Bolz
|
4cb208c93c
vulkan: coopmat2 mul_mat optimizations (#14934)
|
5 months ago |
R0CKSTAR
|
3025b621d1
llama-bench: rename DB table name from test to llama_bench (#15003)
|
5 months ago |
Jeff Bolz
|
ec0b18802c
vulkan: Support ne[3]>1 in noncontig matrix-vector multiply (#15015)
|
5 months ago |
Douglas Hanley
|
339bd0268c
model : support Qwen3-Embedding (#15023)
|
5 months ago |
Johannes Gäßler
|
f906275537
server: enable token array inputs for OAI API (#15001)
|
5 months ago |
Jeff Bolz
|
a9f7541ec2
vulkan: optimizations for direct convolution (#14933)
|
5 months ago |
Johannes Gäßler
|
9c35706b98
CUDA: fix MMQ nwarps for AMD with warp_size==32 (#15014)
|
5 months ago |
l-austenfeld
|
c76b420e4c
vendor : update vendored copy of google/minja (#15011)
|
5 months ago |
stevenkuang
|
0f5ccd6fd1
model : add hunyuan dense (#14878)
|
5 months ago |
lhez
|
1c872f71fb
opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
|
5 months ago |
Srihari-mcw
|
baad94885d
ggml : Q2k interleaving implementation - x86/x64 SIMD (#14373)
|
5 months ago |
Georgi Gerganov
|
ba42794c9e
graph : fix equal_seq() check (#14986)
|
5 months ago |
diannao
|
2860d479b4
docker : add cann build pipline (#14591)
|
5 months ago |
R0CKSTAR
|
484b2091ce
compare-commits.sh: support both llama-bench and test-backend-ops (#14392)
|
5 months ago |
Ed Addario
|
daf2dd7880
quantize : skip tensor override when in fallback mode (#14995)
|
5 months ago |