 Xuan Son Nguyen
|
9f912511bc
common : fix duplicated file name with hf_repo and hf_file (#10550)
|
1 éve |
 Diego Devesa
|
10bce0450f
llama : accept a list of devices to use to offload a model (#10497)
|
1 éve |
|
Diego Devesa
|
5931c1f233
ggml : add support for dynamic loading of backends (#10469)
|
1 éve |
 Georgi Gerganov
|
d9d54e498d
speculative : refactor and add a simpler example (#10362)
|
1 éve |
|
Georgi Gerganov
|
8e752a777b
llama : add check for KV cache shifts (#10401)
|
1 éve |
 Johannes Gäßler
|
4e54be0ec6
llama/ex: remove --logdir argument (#10339)
|
1 éve |
|
Diego Devesa
|
ae8de6d50a
ggml : build backends as libraries (#10256)
|
1 éve |
|
Georgi Gerganov
|
5c333e0140
metal : add BF16 support (#8439)
|
1 éve |
|
Diego Devesa
|
9f40989351
ggml : move CPU backend to a separate file (#10144)
|
1 éve |
|
Georgi Gerganov
|
8d8ff71536
llama : remove Tail-Free sampling (#10071)
|
1 éve |
 wwoodsTM
|
ff252ea48e
llama : add DRY sampler (#9702)
|
1 éve |
 Michael Podvitskiy
|
d80fb71f8b
llama: string_split fix (#10022)
|
1 éve |
|
Georgi Gerganov
|
f594bc80ba
ggml : add asserts for type conversion in fattn kernels (#9971)
|
1 éve |
|
Xuan Son Nguyen
|
cda0e4b648
llama : remove all_pos_0, all_pos_1, all_seq_id from llama_batch (#9745)
|
1 éve |
 MaggotHATE
|
fbc98b748e
sampling : add XTC sampler (#9742)
|
1 éve |
|
Georgi Gerganov
|
11ac9800af
llama : improve infill support and special token detection (#9798)
|
1 éve |
|
Diego Devesa
|
7eee341bee
common : use common_ prefix for common library functions (#9805)
|
1 éve |
|
Georgi Gerganov
|
8c475b97b8
rerank : use [SEP] token instead of [BOS] (#9737)
|
1 éve |
 matiaslin
|
faac0bae26
common : ensure llama_batch size does not exceed max size (#9668)
|
1 éve |
|
Georgi Gerganov
|
f4d2b8846a
llama : add reranking support (#9510)
|
1 éve |
|
Georgi Gerganov
|
6262d13e0b
common : reimplement logging (#9418)
|
1 éve |
|
Georgi Gerganov
|
0abc6a2c25
llama : llama_perf + option to disable timings during decode (#9355)
|
1 éve |
 Ahmad Tameem
|
2b00fa7997
riscv : modify Makefile and add a RISCV_VECT to print log info (#9442)
|
1 éve |
 Farbod Bijary
|
67155ab7f5
feat: Implements retrying logic for downloading models using --model-url flag (#9255)
|
1 éve |
|
Xuan Son Nguyen
|
6cd4e03444
arg : bring back missing ifdef (#9411)
|
1 éve |
|
Xuan Son Nguyen
|
bfe76d4a17
common : move arg parser code to `arg.cpp` (#9388)
|
1 éve |
|
Xuan Son Nguyen
|
3f7ccfd649
common : bring back missing args, add env var duplication check (#9375)
|
1 éve |
|
slaren
|
a249843d89
common : restore --n-gpu-layers (#9371)
|
1 éve |
|
Xuan Son Nguyen
|
00b02bb249
imatrix : fix arg parser for imatrix (#9366)
|
1 éve |
|
Georgi Gerganov
|
faf69d4237
llama : sanitize invalid tokens (#9357)
|
1 éve |
