Diego Devesa
|
d6818d06a6
llama : allow other bufts when overriding to CPU, add --no-repack option (#14990)
|
5 месяцев назад |
compilade
|
90083283ec
imatrix : use GGUF to store importance matrices (#9400)
|
6 месяцев назад |
Georgi Gerganov
|
225e7a1438
llama : add high-throughput mode (#14363)
|
6 месяцев назад |
Georgi Gerganov
|
6ffd4e9c44
server : pre-calculate EOG logit biases (#14721)
|
6 месяцев назад |
Ruikai Peng
|
dd6e6d0b6a
vocab : prevent tokenizer overflow (#14301)
|
7 месяцев назад |
fanyang
|
456af35eb7
build : suppress gcc15 compile warnings (#14261)
|
7 месяцев назад |
Diego Devesa
|
6adc3c3ebc
llama : add thread safety test (#14035)
|
7 месяцев назад |
Georgi Gerganov
|
d3e64b9f49
llama : rework embeddings logic (#14208)
|
7 месяцев назад |
bandoti
|
2e89f76b7a
common: fix issue with regex_escape routine on windows (#14133)
|
7 месяцев назад |
Georgi Gerganov
|
745aa5319b
llama : deprecate llama_kv_self_ API (#14030)
|
7 месяцев назад |
Max Krasnyansky
|
053b1539c0
threading: support for GGML_SCHED_PRIO_LOW, update thread info on Windows to avoid throttling (#12995)
|
7 месяцев назад |
Đinh Trọng Huy
|
e0e3aa231d
llama : add support for BertForSequenceClassification reranker (#13858)
|
7 месяцев назад |
Percy Piper
|
c508256db2
rpc : Fix build on OpenBSD (#13541)
|
7 месяцев назад |
Georgi Gerganov
|
a4090d1174
llama : remove llama_kv_cache_view API + remove deprecated (#13653)
|
8 месяцев назад |
Georgi Gerganov
|
e298d2fbd0
kv-cache : add SWA support (#13194)
|
8 месяцев назад |
psocolovsky
|
1dfbf2cf3a
common : add load_progress_callback (#13617)
|
8 месяцев назад |
Olivier Chafik
|
3198405e98
`common`: add partial regex support (#12808)
|
8 месяцев назад |
Johannes Gäßler
|
10d2af0eaa
llama/ggml: add LLM training support (#10544)
|
8 месяцев назад |
David Huang
|
7f323a589f
Add `--no-op-offload` to improve `-ot` pp perf in MoE models like llama4 400B (#13386)
|
8 месяцев назад |
Georgi Gerganov
|
51fb96b1ff
context : remove logits_all flag (#13284)
|
8 месяцев назад |
Prajwal B Mehendarkar
|
bc091a4dc5
common : Define cache directory on AIX (#12915)
|
9 месяцев назад |
yuri@FreeBSD
|
68b08f36d0
common : Define cache directory on FreeBSD (#12892)
|
9 месяцев назад |
tastelikefeet
|
b2034c2b55
contrib: support modelscope community (#12664)
|
9 месяцев назад |
Diego Devesa
|
e0e912f49b
llama : add option to override model tensor buffers (#11397)
|
9 месяцев назад |
Xuan-Son Nguyen
|
42eb248f46
common : remove json.hpp from common.cpp (#12697)
|
9 месяцев назад |
Xuan-Son Nguyen
|
267c1399f1
common : refactor downloading system, handle mmproj with -hf option (#12694)
|
9 месяцев назад |
fairydreaming
|
8fcb563613
Load all MoE experts during warmup (#11571)
|
10 месяцев назад |
Georgi Gerganov
|
e0dbec0bc6
llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)
|
10 месяцев назад |
Olivier Chafik
|
669912d9a5
`tool-call`: fix Qwen 2.5 Coder support, add micro benchmarks, support trigger patterns for lazy grammars (#12034)
|
10 месяцев назад |
Olivier Chafik
|
63e489c025
tool-call: refactor common chat / tool-call api (+ tests / fixes) (#11900)
|
11 месяцев назад |