 Georgi Gerganov
|
8b20858e5e
perplexity : faster Winogrande via batching (#5024)
|
пре 2 година |
 John
|
57e2a7a52a
llama : fix falcon arch for tied output embeddings (#4978)
|
пре 2 година |
|
Georgi Gerganov
|
9b6ea4263a
cmake : add ggml public headers (#5011)
|
пре 2 година |
 Xuan Son Nguyen
|
821f0a271e
server : defer tasks when "slot unavailable" (#5018)
|
пре 2 година |
 slaren
|
96d7f56d29
llama : fix mlock with no-mmap with Metal (#5025)
|
пре 2 година |
|
Georgi Gerganov
|
2d5419d08a
imatrix : fix assert for src0 non-cont check
|
пре 2 година |
|
Georgi Gerganov
|
d391ae9b49
perplexity : fix winogrande N tasks option
|
пре 2 година |
|
Georgi Gerganov
|
e9240cdfa0
scripts : add get-winogrande.sh
|
пре 2 година |
 David Sommers
|
b46757735d
convert.py : fix llama/llama2 conversion due to vocab_size=-1 (#5019)
|
пре 2 година |
 Kawrakow
|
3e945cc1e9
HellaSwag: speed up by parallelizing log-prob evaluation (#5020)
|
пре 2 година |
|
Georgi Gerganov
|
ad19812cda
perplexity : faster HellaSwag via batching (#5017)
|
пре 2 година |
|
Kawrakow
|
682986a08e
Add Winogrande evaluation (#5015)
|
пре 2 година |
|
Georgi Gerganov
|
dcad445d0c
scritps : add helper script to get hellaswag data in txt format
|
пре 2 година |
 Paul Tsochantaris
|
1e605f4102
metal : fix memory leak, dangling pointer and unused autorel (#5007)
|
пре 2 година |
|
Georgi Gerganov
|
6b6916b215
sync : ggml
|
пре 2 година |
|
Georgi Gerganov
|
38566680cd
ggml : add IQ2 to test-backend-ops + refactoring (#4990)
|
пре 2 година |
|
Georgi Gerganov
|
ba69bbc84c
imatrix : offload to GPU support (#4957)
|
пре 2 година |
|
Georgi Gerganov
|
44a1a4a41a
backend : add eval callback (#4935)
|
пре 2 година |
|
Georgi Gerganov
|
c918fe8dca
metal : create autorelease pool during library build (#4970)
|
пре 2 година |
|
Georgi Gerganov
|
0f83e727af
py : fix whitespace
|
пре 2 година |
|
Georgi Gerganov
|
4f4bf35f46
py : fix missing added_tokens_dict for SPM and BPE vocabs (#4971)
|
пре 2 година |
|
Kawrakow
|
2b3a665d39
llama : use Q4_K for attn_v for Q2_K_S when n_gqa >= 4 (#4996)
|
пре 2 година |
|
Paul Tsochantaris
|
7563293665
metal : remove unnecessary nil check (#4986)
|
пре 2 година |
 David Renshaw
|
f46c0c1b0e
llama : fix copy/paste error in llama_sampling_params comment (#4994)
|
пре 2 година |
|
Georgi Gerganov
|
5c99960901
py : remove unnecessary hasattr (#4903)
|
пре 2 година |
 Philip Taron
|
bee938da74
nix: remove nixConfig from flake.nix (#4984)
|
пре 2 година |
 Daniel Bevenius
|
cec8a48470
finetune : add training data file to log message (#4979)
|
пре 2 година |
|
Kawrakow
|
334a835a1c
ggml : importance matrix support for legacy quants (#4969)
|
пре 2 година |
 Maximilian Winter
|
4feb4b33ee
examples : add complete parallel function calling example (#4974)
|
пре 2 година |
|
Georgi Gerganov
|
959ef0c0df
perplexity : fix kv cache handling for hellaswag (#4981)
|
пре 2 година |
