 Johannes Gäßler
|
ac3b886953
llama : fix embd when offloading non-repeating layers (#1891)
|
il y a 2 ans |
 FrankHB
|
5b9ccaf104
Fixed possible macro redefinition (#1892)
|
il y a 2 ans |
 Borislav Stanimirov
|
9cbf50c041
build : fix and ignore MSVC warnings (#1889)
|
il y a 2 ans |
 Kawrakow
|
3d01122610
CUDA : faster k-quant dot kernels (#1862)
|
il y a 2 ans |
|
Borislav Stanimirov
|
602c748863
gitignore : add several entries specific to Visual Studio (#1888)
|
il y a 2 ans |
|
Johannes Gäßler
|
a09f9195be
Fixed CUDA runtime version check (#1879)
|
il y a 2 ans |
 Georgi Gerganov
|
bed9275617
cmake : remove whitespaces
|
il y a 2 ans |
 yangli2
|
c36e81da62
examples : add chat-vicuna.sh (#1854)
|
il y a 2 ans |
 Igor Okulist
|
3559433fec
cmake : set include path for OpenBlas (#1830)
|
il y a 2 ans |
 Frederik Vogel
|
69b34a0e80
swift : Package compile breaks due to ggml-metal.metal (#1831)
|
il y a 2 ans |
 daboe01
|
cf267d1c71
make : add train-text-from-scratch (#1850)
|
il y a 2 ans |
 Srinivas Billa
|
9dda13e5e1
readme : server compile flag (#1874)
|
il y a 2 ans |
 sandyiscool
|
37e257c48e
make : clean *.so files (#1857)
|
il y a 2 ans |
 Howard Su
|
64cc19b4fe
Fix the validation of main device (#1872)
|
il y a 2 ans |
|
Georgi Gerganov
|
4bfcc855ab
metal : parallel command buffer encoding (#1860)
|
il y a 2 ans |
|
Johannes Gäßler
|
6b8312e797
Better error when using both LoRA + GPU layers (#1861)
|
il y a 2 ans |
|
Johannes Gäßler
|
254a7a7a5f
CUDA full GPU acceleration, KV cache in VRAM (#1827)
|
il y a 2 ans |
 0xspringtime
|
9254920265
baby-llama : fix operator!= (#1821)
|
il y a 2 ans |
 xaedes
|
e32089b2c2
train : improved training-from-scratch example (#1652)
|
il y a 2 ans |
|
Georgi Gerganov
|
2347e45e7b
llama : do a warm-up eval at start for better timings (#1824)
|
il y a 2 ans |
 Kerfuffle
|
74d4cfa343
Allow "quantizing" to f16 and f32 (#1787)
|
il y a 2 ans |
|
Kawrakow
|
74a6d922f1
Metal implementation for all k_quants (#1807)
|
il y a 2 ans |
 slaren
|
e4caa8da59
ci : run when changing only the CUDA sources (#1800)
|
il y a 2 ans |
|
Howard Su
|
58970a4c39
Leverage mmap for offloading tensors to GPU (#1597)
|
il y a 2 ans |
|
Kawrakow
|
8c0a10e64d
metal : fix failure to load model (#1817)
|
il y a 2 ans |
|
Kerfuffle
|
fa84c4b3e8
Fix issue where interactive mode crashes when input exceeds ctx size (#1789)
|
il y a 2 ans |
 Kyle Liang
|
12b063f0ec
Fixed WSL cuda's OOM error (#1594)
|
il y a 2 ans |
 Ryan Landay
|
31d2b5f4a4
Update SHA256SUMS with current hashes for models quantized using q4_0 (#1798)
|
il y a 2 ans |
|
Georgi Gerganov
|
4de0334f5c
cmake : fix Metal build (close #1791)
|
il y a 2 ans |
 Artyom Lebedev
|
3f1223155a
k-quants : GCC12 compilation fix (#1792)
|
il y a 2 ans |
