Radoslav Gerganov f4bd8b3d26 rpc : set SO_REUSEADDR for the server socket (#7320) hai 1 ano
..
baby-llama ab336a9d5e code : normalize enum names (#5697) hai 1 ano
batched b97bc3966e llama : support Llama 3 HF conversion (#6745) hai 1 ano
batched-bench 9c67c2773d ggml : add Flash Attention (#5021) hai 1 ano
batched.swift 40f74e4d73 llama : add option to render special/control tokens (#6807) hai 1 ano
beam-search b97bc3966e llama : support Llama 3 HF conversion (#6745) hai 1 ano
benchmark 5b09797321 ggml : remove old quantization functions (#5942) hai 1 ano
convert-llama2c-to-ggml 07cd41d096 TypoFix (#7162) hai 1 ano
embedding ea3b0590ee embedding : free the batch after execution (#7297) hai 1 ano
eval-callback eaf4bd8b39 eval-callback : fix conversion to float (#7184) hai 1 ano
export-lora 6e4e973b26 ci : add an option to fail on compile warning (#3952) hai 1 ano
finetune 3855416027 ggml : introduce bfloat16 support (#6412) hai 1 ano
gbnf-validator cbaadc9294 grammars: 1.5x faster inference w/ complex grammars (vector reserves / reuses) (#6609) hai 1 ano
gguf 8228b66dbc gguf : add option to not check tensor data (#6582) hai 1 ano
gguf-split 842500144e gguf-split: add --no-tensor-first-split (#7072) hai 1 ano
gritlm 8a56075b07 gritlm : add --outdir option to hf.sh script (#6699) hai 1 ano
imatrix 48b2f9c1fc Fixed save_imatrix to match old behaviour for MoE (#7099) hai 1 ano
infill b97bc3966e llama : support Llama 3 HF conversion (#6745) hai 1 ano
jeopardy a8777ad84e parallel : add option to load external prompt file (#3416) %!s(int64=2) %!d(string=hai) anos
llama-bench e849648888 llama-bench : add pp+tg test type (#7199) hai 1 ano
llama.android 1265c670fd Revert "move ndk code to a new library (#6951)" (#7282) hai 1 ano
llama.swiftui 40f74e4d73 llama : add option to render special/control tokens (#6807) hai 1 ano
llava 344f9126cc ggml : tag ggml_tensor::backend as deprecated (#7290) hai 1 ano
lookahead b97bc3966e llama : support Llama 3 HF conversion (#6745) hai 1 ano
lookup 28103f4832 Server: fix seed for multiple slots (#6835) hai 1 ano
main 4e3880978f Fix memory bug in grammar parser (#7194) hai 1 ano
main-cmake-pkg b8a7a5a90f build(cmake): simplify instructions (`cmake -B build && cmake --build build ...`) (#6964) hai 1 ano
parallel b97bc3966e llama : support Llama 3 HF conversion (#6745) hai 1 ano
passkey b97bc3966e llama : support Llama 3 HF conversion (#6745) hai 1 ano
perplexity 1c570d8bee perplexity: add BF16 vs. FP16 results (#7150) hai 1 ano
quantize ad52d5c259 doc: add references to hugging face GGUF-my-repo quantisation web tool. (#7288) hai 1 ano
quantize-stats 8843a98c2b Improve usability of --model-url & related flags (#6930) hai 1 ano
retrieval 64e7b47c69 examples : add "retrieval" (#6193) hai 1 ano
rpc f4bd8b3d26 rpc : set SO_REUSEADDR for the server socket (#7320) hai 1 ano
save-load-state beea6e1b16 llama : save and restore kv cache for single seq id (#6341) hai 1 ano
server ee94172d33 server : add support for the RPC backend (#7305) hai 1 ano
simple b97bc3966e llama : support Llama 3 HF conversion (#6745) hai 1 ano
speculative b97bc3966e llama : support Llama 3 HF conversion (#6745) hai 1 ano
sycl 04976db7a8 docs: fix typos (#7124) hai 1 ano
tokenize 1b67731e18 BERT tokenizer fixes (#6498) hai 1 ano
train-text-from-scratch 8b1b1f4982 train : add general name (#6752) hai 1 ano
CMakeLists.txt 5e31828d3e ggml : add RPC backend (#6829) hai 1 ano
Miku.sh 019fe257bb MIKU MAYHEM: Upgrading the Default Model for Maximum Fun 🎉 (#2287) %!s(int64=2) %!d(string=hai) anos
alpaca.sh a17a2683d8 alpaca.sh : update model file name (#2074) %!s(int64=2) %!d(string=hai) anos
base-translate.sh 96e80dabc6 examples : improve base-translate.sh script (#4783) %!s(int64=2) %!d(string=hai) anos
chat-13B.bat d9ad104440 Create chat-13B.bat (#592) %!s(int64=2) %!d(string=hai) anos
chat-13B.sh 6daa09d879 examples : read chat prompts from a template file (#1196) %!s(int64=2) %!d(string=hai) anos
chat-persistent.sh ac2219fef3 llama : fix session saving/loading (#3400) %!s(int64=2) %!d(string=hai) anos
chat-vicuna.sh c36e81da62 examples : add chat-vicuna.sh (#1854) %!s(int64=2) %!d(string=hai) anos
chat.sh 8341a25957 main : log file (#2748) %!s(int64=2) %!d(string=hai) anos
gpt4all.sh 107980d970 examples : add -n to alpaca and gpt4all scripts (#706) %!s(int64=2) %!d(string=hai) anos
json-schema-pydantic-example.py 5b7b0ac8df json-schema-to-grammar improvements (+ added to server) (#5978) hai 1 ano
json_schema_to_grammar.py ab9a3240a9 JSON schema conversion: ⚡️ faster repetitions, min/maxLength for strings, cap number length (#6555) hai 1 ano
llama.vim 125d03a503 llama.vim : added api key support (#5090) %!s(int64=2) %!d(string=hai) anos
llama2-13b.sh 73643f5fb1 gitignore : changes for Poetry users + chat examples (#2284) %!s(int64=2) %!d(string=hai) anos
llama2.sh 73643f5fb1 gitignore : changes for Poetry users + chat examples (#2284) %!s(int64=2) %!d(string=hai) anos
llm.vim ad9ddcff6e llm.vim : stop generation at multiple linebreaks, bind to <F2> (#2879) %!s(int64=2) %!d(string=hai) anos
make-ggml.py ac43576124 make-ggml.py : compatibility with more models and GGUF (#3290) %!s(int64=2) %!d(string=hai) anos
pydantic-models-to-grammar-examples.py d292f4f204 examples : make pydantic scripts pass mypy and support py3.8 (#5099) %!s(int64=2) %!d(string=hai) anos
pydantic_models_to_grammar.py d292f4f204 examples : make pydantic scripts pass mypy and support py3.8 (#5099) %!s(int64=2) %!d(string=hai) anos
reason-act.sh 7c2227a197 chmod : make scripts executable (#2675) %!s(int64=2) %!d(string=hai) anos
regex-to-grammar.py ab9a3240a9 JSON schema conversion: ⚡️ faster repetitions, min/maxLength for strings, cap number length (#6555) hai 1 ano
server-embd.py 2002bc96bf server : refactor (#5882) hai 1 ano
server-llama2-13B.sh 7c2227a197 chmod : make scripts executable (#2675) %!s(int64=2) %!d(string=hai) anos
ts-type-to-grammar.sh ab9a3240a9 JSON schema conversion: ⚡️ faster repetitions, min/maxLength for strings, cap number length (#6555) hai 1 ano