 Jhen-Jie Hong
|
2feb8934eb
server : fix default grammar by use empty string in the UI (#2604)
|
2 years ago |
|
Jhen-Jie Hong
|
5517d6e692
server : implement json-schema-to-grammar.mjs & add grammar param in the UI (#2588)
|
2 years ago |
 vxiiduu
|
f31b539714
Enhance Windows 7 and below compatibility. (#2592)
|
2 years ago |
 drbh
|
ee77efea2a
test : add simple grammar parsing tests (#2594)
|
2 years ago |
 Johannes Gäßler
|
f64d44a9b9
CUDA: Fixed OpenLLaMA 3b mmq, reduced compile time (#2590)
|
2 years ago |
 byte-6174
|
b19edd54d5
Adding support for llama2.c models (#2559)
|
2 years ago |
 Equim
|
53dc399472
server: fixed wrong variable name in timing json (#2579)
|
2 years ago |
 DannyDaemonic
|
9ca4abed89
Handle `ENABLE_VIRTUAL_TERMINAL_PROCESSING` more gracefully on earlier versions of Windows.
|
2 years ago |
 Christian Demsar
|
e59fcb2bc1
Add --n-predict -2 for stopping generation on full context (#2565)
|
2 years ago |
 Martin Krasser
|
1638757767
Fix grammar-based sampling issue in server (#2566)
|
2 years ago |
 Sam Spilsbury
|
916a9acdd0
ggml-alloc: Don't try to re-use buffers of external tensors (#2562)
|
2 years ago |
 grahameth
|
ea04a4ca19
add log_callback to llama_context_params for custom logging. (#2234)
|
2 years ago |
|
Johannes Gäßler
|
25d43e0eb5
CUDA: tuned mul_mat_q kernels (#2546)
|
2 years ago |
|
Martin Krasser
|
f5bfea0580
Allow passing grammar to completion endpoint (#2532)
|
2 years ago |
|
Johannes Gäßler
|
acfc5478ff
CUDA: tighter VRAM scratch size for 65b/70b (#2551)
|
2 years ago |
 chaihahaha
|
7ed8d1fe7f
llm.vim : multiline autocompletion, get rid of "^@" (#2543)
|
2 years ago |
 Georgi Gerganov
|
e7f94d6fdc
vim : bring back simple llm.vim example
|
2 years ago |
 AustinMroz
|
2d7baaf50f
vim : streaming and more (#2495)
|
2 years ago |
 klosax
|
f3c3b4b167
Add --rope-scale parameter (#2544)
|
2 years ago |
|
Georgi Gerganov
|
93356bdb7a
ggml : mul mat tweaks (#2372)
|
2 years ago |
|
Georgi Gerganov
|
60baff7c85
ggml : pad result of ggml_nbytes()
|
2 years ago |
|
Georgi Gerganov
|
9082b5dfbf
ggml : change params pointer (style change) (#2539)
|
2 years ago |
|
Georgi Gerganov
|
99d29c0094
ggml : sync (custom ops) (#2537)
|
2 years ago |
|
Johannes Gäßler
|
3d9a551816
Fixed mmap prefetch for GPU offloading (#2529)
|
2 years ago |
|
Georgi Gerganov
|
f6f9896ac3
metal : fix out-of-bounds access + inc concurrency nodes (#2416)
|
2 years ago |
 GiviMAD
|
34a14b28ff
[Makefile] Move ARM CFLAGS before compilation (#2536)
|
2 years ago |
 Henri Vasserman
|
7297128db8
[Zig] Rewrite build for Zig 0.11 (#2514)
|
2 years ago |
|
DannyDaemonic
|
86c3219895
console : fix issue related to Windows 11 PowerShell console mode persistence (#2521)
|
2 years ago |
 Keiichi Tabata
|
2e8265ae17
convert.py : add missing abstract methods for quantized data (#2491)
|
2 years ago |
|
Johannes Gäßler
|
f514d1b306
CUDA: faster k-quant mul_mat_q kernels (#2525)
|
2 years ago |
