Georgi Gerganov
|
d9f8f60618
batch : fix sequence id ownership (#17915)
|
1 month ago |
Yuichiro Utsumi
|
e4ae383317
docs: use port 8080 in Docker examples (#17903)
|
1 month ago |
nullname
|
34ce48d97a
ggml-hexagon: fix `rope` failure at `test-backend-ops` (#17565)
|
1 month ago |
Sigbjørn Skjæret
|
45e350e3d3
ci: fix riscv64-native build (#17916)
|
1 month ago |
Xuan-Son Nguyen
|
c6b2c9310c
mtmd: some small clean up (#17909)
|
1 month ago |
Xuan-Son Nguyen
|
34a6d86982
cli: enable jinja by default (#17911)
|
1 month ago |
Pascal
|
f32ca51bfe
server: add presets (config) when using multiple models (#17859)
|
1 month ago |
Max Krasnyansky
|
e1f4921980
Fix race conditions in threadpool when dealing with dynamic/frequent n_threads changes (#17748)
|
1 month ago |
Georgi Gerganov
|
4dff236a52
ggml : remove GGML_KQ_MASK_PAD constant (#17910)
|
1 month ago |
Sigbjørn Skjæret
|
4df6e859e9
cuda : add missing support check for xielu (#17895)
|
1 month ago |
Xuan-Son Nguyen
|
6c2131773c
cli: new CLI experience (#17824)
|
1 month ago |
Eric Zhang
|
b677721819
model : Qwen3-Next-80B-A3B has 48 layers (#17898)
|
1 month ago |
lhez
|
2d2e1030e3
docs : update opencl ops (#17904)
|
1 month ago |
Johannes Gäßler
|
17f7f4baad
CUDA: fix unpadded strides in MMA FA kernel (#17891)
|
1 month ago |
Xuan-Son Nguyen
|
9e79b0116e
convert: allow using quantized Mistral weight (#17889)
|
1 month ago |
Neo Zhang Jianyu
|
2e9eab80c2
fix softmax for iGPU (#17838)
|
1 month ago |
Aldehir Rojas
|
2fbe3b7bb7
common : add parser for ministral/mistral large 3/devstral 2 (#17713)
|
1 month ago |
Sigbjørn Skjæret
|
63391852b0
docs : update cpu and cuda ops (#17890)
|
1 month ago |
Gabe Goodhart
|
086a63e3a5
metal: SSM kernel improvements (#17876)
|
1 month ago |
Piotr Wilkin (ilintar)
|
b63509262a
Add DIAG for CUDA (#17873)
|
1 month ago |
Johannes Gäßler
|
48f47565a7
docs: clarify that CPU support should be first (#17886)
|
1 month ago |
Gabe Goodhart
|
02e409a5be
ggml : Provide macos-specific backtrace printing to avoid terminal death (#17869)
|
1 month ago |
Georgi Gerganov
|
6b82eb7883
metal : print node names for debugging (#17882)
|
1 month ago |
Sigbjørn Skjæret
|
86a3f0fad8
ggml : allow fill node alloc inplace (#17870)
|
1 month ago |
Rhys-T
|
63908b631a
cmake: fix Mach-O current version number (#17877)
|
1 month ago |
Sigbjørn Skjæret
|
42b12b5608
model : nit, DeepSeek V1 MoE is 16B and GigaChat is 20B (#12652)
|
1 month ago |
Xuan-Son Nguyen
|
4e842d5120
console: allow using arrow left/right, home/end keys and history mode (#17836)
|
1 month ago |
Chenguang Li
|
ca709e427b
CANN: add support for partial RoPE and Vision mode (#17543)
|
1 month ago |
Johannes Gäßler
|
0cdce38a97
CUDA: fix FP16 overflow in tile FA kernel (#17875)
|
1 month ago |
Aldehir Rojas
|
e39502e74b
llama : add token matching support to llama-grammar (#17816)
|
1 month ago |