 Johannes Gäßler
|
29c60d8cdd
tokenization: add warning for double BOS (#7332)
|
1 jaar geleden |
 Herman Semenov
|
359cbe3f46
ggml-quants, llama : removed excess checks (#7274)
|
1 jaar geleden |
 amd-lalithnc
|
e18bc6aaf3
convert : fix Qwen/Qwen-7b conversion (#7308)
|
1 jaar geleden |
 Radoslav Gerganov
|
ee94172d33
server : add support for the RPC backend (#7305)
|
1 jaar geleden |
 Justine Tunney
|
934266c0e0
ggml : rewrite silu and softmax for cpu (#7154)
|
1 jaar geleden |
 Leon Knauer
|
9c4fdcbec8
[Server] Added --verbose option to README [no ci] (#7335)
|
1 jaar geleden |
 Pierrick Hymbert
|
24ecb58168
Revert "server bench: fix bench not waiting for model load (#7284)" (#7334)
|
1 jaar geleden |
|
Radoslav Gerganov
|
9afdffe70e
rpc : get available mem for the CPU backend
|
1 jaar geleden |
|
Radoslav Gerganov
|
3b3963c55c
rpc : add command line arg for specifying backend memory
|
1 jaar geleden |
 Jared Van Bortel
|
dda64fc17c
convert : get general.name from model dir, not its parent (#5615)
|
1 jaar geleden |
|
Herman Semenov
|
0350f58152
grammar, json, llama: replace push on emplace if it possible (#7273)
|
1 jaar geleden |
 Vaibhav Srivastav
|
ad52d5c259
doc: add references to hugging face GGUF-my-repo quantisation web tool. (#7288)
|
1 jaar geleden |
 Max Krasnyansky
|
172b78210a
ci: fix bin/Release path for windows-arm64 builds (#7317)
|
1 jaar geleden |
 Max Krasnyansky
|
13ad16af12
Add support for properly optimized Windows ARM64 builds with LLVM and MSVC (#7191)
|
1 jaar geleden |
 Daniel Bevenius
|
8f7080bf48
readme : remove stray double quote (#7310)
|
1 jaar geleden |
 kunnis
|
e1b40ac3b9
ggml : use dynamic thread scheduling for matrix multiplication (#6915)
|
1 jaar geleden |
 agray3
|
dc020985b8
Avoid unnecessarily disabling CUDA graphs (#7302)
|
1 jaar geleden |
 slaren
|
344f9126cc
ggml : tag ggml_tensor::backend as deprecated (#7290)
|
1 jaar geleden |
 AidanBeltonS
|
9a17ab914b
Add missing " (#7303)
|
1 jaar geleden |
 dm4
|
ea3b0590ee
embedding : free the batch after execution (#7297)
|
1 jaar geleden |
 Georgi Gerganov
|
29499bb593
sync : ggml
|
1 jaar geleden |
 John Balis
|
48aa8fd1f2
ggml : add `ggml_upscale_ext` (ggml/814)
|
1 jaar geleden |
|
Johannes Gäßler
|
583fd6b000
server bench: fix bench not waiting for model load (#7284)
|
1 jaar geleden |
|
Georgi Gerganov
|
9f773486ab
script : sync ggml-rpc
|
1 jaar geleden |
|
Georgi Gerganov
|
e8a7fd4fb0
metal : support FA without mask + add asserts (#7278)
|
1 jaar geleden |
|
Georgi Gerganov
|
a5e3fde857
sync : ggml
|
1 jaar geleden |
|
Georgi Gerganov
|
f308ea7059
metal : tune soft_max number of threads (whisper/0)
|
1 jaar geleden |
|
Georgi Gerganov
|
c3c88f296a
ggml : try fix ppc64 (whisper/0)
|
1 jaar geleden |
 Przemysław Pawełczyk
|
182adefcf3
ggml : expose SSE3 and SSSE3 for MSVC when AVX is available (whisper/2128)
|
1 jaar geleden |
 Hong Bo PENG
|
0d26d8ccd8
ggml : optimize for ppc64le using VSX intrinsics (ggml/784)
|
1 jaar geleden |
