 Georgi Gerganov
|
ec893798b7
llama : custom attention mask + parallel decoding + no context swaps (#3228)
|
2 anos atrás |
 Cebtenzzre
|
a5661d7e71
llama : allow gguf RoPE keys to be overridden with defaults (#3240)
|
2 anos atrás |
 goerch
|
b08e75baea
Fixing the last deviations from sentencepiece indicated by test-tokenizer-1 (#3170)
|
2 anos atrás |
|
Cebtenzzre
|
3aefaab9e5
check C++ code with -Wmissing-declarations (#3184)
|
2 anos atrás |
 Roland
|
2d770505a8
llama : remove mtest (#3177)
|
2 anos atrás |
 FK
|
84e723653c
speculative: add --n-gpu-layers-draft option (#3063)
|
2 anos atrás |
|
Cebtenzzre
|
00d62adb79
fix some warnings from gcc and clang-tidy (#3038)
|
2 anos atrás |
|
Georgi Gerganov
|
c4f496648c
metal : fix kernel_norm (fixes Falcon on Metal) (#3057)
|
2 anos atrás |
|
Cebtenzzre
|
de2fe892af
examples : replace fprintf to stdout with printf (#3017)
|
2 anos atrás |
|
Georgi Gerganov
|
921772104b
speculative : add grammar support (#2991)
|
2 anos atrás |
|
Georgi Gerganov
|
e36ecdccc8
build : on Mac OS enable Metal by default (#2901)
|
2 anos atrás |
|
Georgi Gerganov
|
47068e5170
speculative : PoC for speeding-up inference via speculative sampling (#2926)
|
2 anos atrás |
|
Georgi Gerganov
|
8f429fa511
perplexity : fix ETA by warming up the model with an empty run
|
2 anos atrás |
|
Cebtenzzre
|
ef15649972
build : fix most gcc and clang warnings (#2861)
|
2 anos atrás |
 staviq
|
8341a25957
main : log file (#2748)
|
2 anos atrás |
 xaedes
|
44c117f41e
train : mem usage and other improvements (#2439)
|
2 anos atrás |
 Johannes Gäßler
|
6b73ef1201
YAML result logging + preset script (#2657)
|
2 anos atrás |
|
Georgi Gerganov
|
edd4c14817
llama : more tokenizer fixes (#2810)
|
2 anos atrás |
 Henri Vasserman
|
6bbc598a63
ROCm Port (#1087)
|
2 anos atrás |
|
Georgi Gerganov
|
cf658adc83
llm : add Falcon support (#2717)
|
2 anos atrás |
 Kawrakow
|
62959e740e
Strided perplexity (#2714)
|
2 anos atrás |
|
Johannes Gäßler
|
c63bb1d16a
CUDA: use mul_mat_q kernels by default (#2683)
|
2 anos atrás |
 slaren
|
1123f7fbdf
ggml-cuda : use graph allocator (#2684)
|
2 anos atrás |
|
Georgi Gerganov
|
6381d4e110
gguf : new file format with flexible meta data (beta) (#2398)
|
2 anos atrás |
