Georgi Gerganov
|
797f2ac062
kv-cache : simplify the interface (#13660)
|
8 ay önce |
Georgi Gerganov
|
a4090d1174
llama : remove llama_kv_cache_view API + remove deprecated (#13653)
|
8 ay önce |
Georgi Gerganov
|
e298d2fbd0
kv-cache : add SWA support (#13194)
|
8 ay önce |
Diego Devesa
|
cf0a43bb64
llama-bench : add defrag-thold, check for invalid ranges (#13487)
|
8 ay önce |
Johannes Gäßler
|
10d2af0eaa
llama/ggml: add LLM training support (#10544)
|
8 ay önce |
David Huang
|
7f323a589f
Add `--no-op-offload` to improve `-ot` pp perf in MoE models like llama4 400B (#13386)
|
8 ay önce |
Sigbjørn Skjæret
|
d2a4ef05c6
vocab : add ByteDance-Seed/Seed-Coder (#13423)
|
8 ay önce |
Georgi Gerganov
|
6562e5a4d6
context : allow cache-less context for embeddings (#13108)
|
8 ay önce |
Georgi Gerganov
|
51fb96b1ff
context : remove logits_all flag (#13284)
|
8 ay önce |
Georgi Gerganov
|
d9d398f84f
sampling : when top-k <= 0 -> noop (#13173)
|
8 ay önce |
Xuan-Son Nguyen
|
ecda2ec4b3
mtmd : Support Pixtral 12B (#13065)
|
9 ay önce |
Ed Addario
|
71e90e8813
quantize: Handle user-defined quantization levels for additional tensors (#12511)
|
9 ay önce |
Xuan-Son Nguyen
|
1466621e73
llama : Support llama 4 text-only (#12791)
|
9 ay önce |
Diego Devesa
|
e0e912f49b
llama : add option to override model tensor buffers (#11397)
|
9 ay önce |
Sigbjørn Skjæret
|
2c3f8b850a
llama : support BailingMoE (Ling) (#12634)
|
9 ay önce |
Juyoung Suk
|
b3de7cac73
llama : add Trillion 7B model support (#12556)
|
9 ay önce |
Johannes Gäßler
|
dd373dd3bf
llama: fix error on bad grammar (#12628)
|
9 ay önce |
compilade
|
00d53800e0
llama-vocab : add SuperBPE pre-tokenizer (#12532)
|
10 ay önce |
fairydreaming
|
8fcb563613
Load all MoE experts during warmup (#11571)
|
10 ay önce |
Georgi Gerganov
|
e0dbec0bc6
llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)
|
10 ay önce |
Olivier Chafik
|
669912d9a5
`tool-call`: fix Qwen 2.5 Coder support, add micro benchmarks, support trigger patterns for lazy grammars (#12034)
|
10 ay önce |
Xuan-Son Nguyen
|
c43a3e7996
llama : add Phi-4-mini support (supersede #12099) (#12108)
|
10 ay önce |
Vitali Lovich
|
3e9a2860e9
llama : expose llama_model_n_head_kv in the API (#11997)
|
10 ay önce |
Georgi Gerganov
|
68ff663a04
repo : update links to new url (#11886)
|
11 ay önce |
Vinesh Janarthanan
|
27e8a23300
sampling: add Top-nσ sampler (#11223)
|
11 ay önce |
Christian Fillion
|
7ee953a64a
llama : add llama_sampler_init for safe usage of llama_sampler_free (#11727)
|
11 ay önce |
Olivier Chafik
|
8b576b6c55
Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639)
|
11 ay önce |
Olivier Chafik
|
6171c9d258
Add Jinja template support (#11016)
|
1 yıl önce |
Radoslav Gerganov
|
667d72846c
rpc : early register backend devices (#11262)
|
1 yıl önce |
David Renshaw
|
960ec65273
llama : fix deprecation message: vocabable -> vocab (#11269)
|
1 yıl önce |