 Georgi Gerganov
|
deb7dfca4b
gguf : add ftype meta info to the model (#2710)
|
пре 2 година |
|
Georgi Gerganov
|
6381d4e110
gguf : new file format with flexible meta data (beta) (#2398)
|
пре 2 година |
 slaren
|
097e121e2f
llama : add benchmark example (#2626)
|
пре 2 година |
 Kamil Tomšík
|
348acf188c
llama : add missing enum keyword in function signatures (#2610)
|
пре 2 година |
 grahameth
|
ea04a4ca19
add log_callback to llama_context_params for custom logging. (#2234)
|
пре 2 година |
 Johannes Gäßler
|
0728c5a8b9
CUDA: mmq CLI option, fixed mmq build issues (#2453)
|
пре 2 година |
 Kawrakow
|
eb542d3932
Add LLAMA_DEFAULT_RMS_EPS so we can change the default (#2384)
|
пре 2 година |
|
slaren
|
41c674161f
make rms_norm_eps a parameter (#2374)
|
пре 2 година |
 Evan Jones
|
84e09a7d8b
llama : add grammar-based sampling (#1773)
|
пре 2 година |
|
Georgi Gerganov
|
e76d630df1
llama : grouped-query attention + LLaMAv2 70B support (#2276)
|
пре 2 година |
 Guillaume "Vermeille" Sanchez
|
ab0e26bdfb
llama : remove cfg smooth factor as it is only a reparameterization of the guidance scale (#2280)
|
пре 2 година |
|
Georgi Gerganov
|
ae178ab46b
llama : make tensor_split ptr instead of array (#2272)
|
пре 2 година |
 Rinne
|
294f424554
llama : extend API to get max devices at runtime (#2253)
|
пре 2 година |
 Xiao-Yong Jin
|
6e7cca4047
llama : add custom RoPE (#2054)
|
пре 2 година |
 Bach Le
|
7513b7b0a1
llama : add functions that work directly on model (#2197)
|
пре 2 година |
|
Bach Le
|
c9c74b4e3f
llama : add classifier-free guidance (#2135)
|
пре 2 година |
 Evan Miller
|
5656d10599
mpi : add support for distributed inference via MPI (#2099)
|
пре 2 година |
 Tobias Lütke
|
31cfbb1013
Expose generation timings from server & update completions.js (#2116)
|
пре 2 година |
 Howard Su
|
b8c8dda75f
Use unsigned for random seed (#2006)
|
пре 2 година |
 ningshanwutuobang
|
cfa0750bc9
llama : support input embeddings directly (#1910)
|
пре 2 година |
 zrm
|
b853d45601
ggml : add NUMA support (#1556)
|
пре 2 година |
 Didzis Gosko
|
527b6fba1d
llama : make model stateless and context stateful (llama_state) (#1797)
|
пре 2 година |
 Ettore Di Giacinto
|
aacdbd4056
llama : fix params struct slignment (#1936)
|
пре 2 година |
 yangli2
|
c36e81da62
examples : add chat-vicuna.sh (#1854)
|
пре 2 година |
|
Johannes Gäßler
|
254a7a7a5f
CUDA full GPU acceleration, KV cache in VRAM (#1827)
|
пре 2 година |
 xaedes
|
e32089b2c2
train : improved training-from-scratch example (#1652)
|
пре 2 година |
 Kerfuffle
|
4f0154b0ba
llama : support requantizing models instead of only allowing quantization from 16/32bit (#1691)
|
пре 2 година |
|
Johannes Gäßler
|
17366df842
Multi GPU support, CUDA refactor, CUDA scratch buffer (#1703)
|
пре 2 година |
|
Kawrakow
|
99009e72f8
ggml : add SOTA 2,3,4,5,6 bit k-quantizations (#1684)
|
пре 2 година |
|
Georgi Gerganov
|
ecb217db4f
llama : Metal inference (#1642)
|
пре 2 година |
