 Adrian Hesketh
|
ca190bca8e
server : re-enable completion and embedded at the same time (#3876)
|
2 years ago |
 Kerfuffle
|
6e08281e58
Extend llama_kv_cache_seq_rm to allow matching any sequence (#3843)
|
2 years ago |
 Georgi Gerganov
|
34b2a5e1ee
server : do not release slot on image input (#3798)
|
2 years ago |
 cebtenzzre
|
ad93962657
server : add parameter -tb N, --threads-batch N (#3584) (#3768)
|
2 years ago |
|
Georgi Gerganov
|
1717521cdb
server : do not block system prompt update (#3767)
|
2 years ago |
 Marcus Dunn
|
5be6c803fa
llama : remove token functions with `context` args in favor of `model` (#3720)
|
2 years ago |
|
Georgi Gerganov
|
438c2ca830
server : parallel decoding and multimodal (#3677)
|
2 years ago |
|
Georgi Gerganov
|
d1031cf49c
sampling : refactor init to use llama_sampling_params (#3696)
|
2 years ago |
|
Georgi Gerganov
|
a0edf73bda
server : fix uninitialized sampling context (close #3685)
|
2 years ago |
|
Georgi Gerganov
|
0e89203b51
speculative : add tree-based sampling example (#3624)
|
2 years ago |
|
Georgi Gerganov
|
57dd55e2c7
server : fix kv cache management (#3588)
|
2 years ago |
 Michael Coppola
|
a8bdd65525
server : add parameter -tb N, --threads-batch N (#3584)
|
2 years ago |
|
Kerfuffle
|
70c29da118
common : fix mirostat state when using multiple sequences (#3543)
|
2 years ago |
 vvhg1
|
11ea5c7d96
infill. : fix tokenization (#3508)
|
2 years ago |
 Jhen-Jie Hong
|
97af49fa39
server : reuse llama_sample_token common util (#3494)
|
2 years ago |
 Kenvix ⭐
|
45eba9369f
build : use std::make_tuple() for compatibility with older GCC versions (#3488)
|
2 years ago |
|
Jhen-Jie Hong
|
e8b8d32e86
server : fix incorrect num_tokens_predicted (#3480)
|
2 years ago |
|
Georgi Gerganov
|
ac2219fef3
llama : fix session saving/loading (#3400)
|
2 years ago |
|
vvhg1
|
c97f01c362
infill : add new example + extend server API (#3296)
|
2 years ago |
 slaren
|
16bc66d947
llama.cpp : split llama_context_params into model and context params (#3301)
|
2 years ago |
 xaedes
|
0e76a8992c
train : finetune LORA (#2632)
|
2 years ago |
|
Georgi Gerganov
|
ec893798b7
llama : custom attention mask + parallel decoding + no context swaps (#3228)
|
2 years ago |
|
Cebtenzzre
|
a5661d7e71
llama : allow gguf RoPE keys to be overridden with defaults (#3240)
|
2 years ago |
|
Cebtenzzre
|
3aefaab9e5
check C++ code with -Wmissing-declarations (#3184)
|
2 years ago |
|
Cebtenzzre
|
00d62adb79
fix some warnings from gcc and clang-tidy (#3038)
|
2 years ago |
|
Cebtenzzre
|
de2fe892af
examples : replace fprintf to stdout with printf (#3017)
|
2 years ago |
|
Jhen-Jie Hong
|
571083f508
server : avoid aniprompt in probabilities of final response (#2849)
|
2 years ago |
|
Cebtenzzre
|
ef15649972
build : fix most gcc and clang warnings (#2861)
|
2 years ago |
 Johannes Gäßler
|
6b73ef1201
YAML result logging + preset script (#2657)
|
2 years ago |
|
Georgi Gerganov
|
edd4c14817
llama : more tokenizer fixes (#2810)
|
2 years ago |
