 Georgi Gerganov
|
469c9addef
metal : handle ggml_scale for n%4 != 0 (close #3754)
|
%!s(int64=2) %!d(string=hai) anos |
 Jhen-Jie Hong
|
c67fe68e41
metal : implement q5_0 and q5_1 kernels (#3648)
|
%!s(int64=2) %!d(string=hai) anos |
 Jan Ploski
|
f5f9121de1
llm : add MPT support (#3417)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
fcca0a7004
refact : fix convert script + zero out KV cache to avoid nans (#3523)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
dcc09d2596
metal : do not use mul_mm kernels when ne00 < 64 (#3542)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
db3abcc114
sync : ggml (ggml-backend) (#3548)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
94e502dfb7
ci : enable on obj-c changes + fix metal build (#3540)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
b0ec5218c3
metal : support MTLGPUFamily < Apple7, formatting, style (#3524)
|
%!s(int64=2) %!d(string=hai) anos |
|
Jhen-Jie Hong
|
c26765a0a1
metal : support default.metallib load & reuse code for swift package (#3522)
|
%!s(int64=2) %!d(string=hai) anos |
 Phillip Kravtsov
|
0e797c2fc5
llm : support Adept Persimmon 8B (#3410)
|
%!s(int64=2) %!d(string=hai) anos |
 Jiahao Li
|
f56e1baec3
metal : alibi for arbitrary number of heads (#3426)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
ec893798b7
llama : custom attention mask + parallel decoding + no context swaps (#3228)
|
%!s(int64=2) %!d(string=hai) anos |
 Rickard Hallerbäck
|
dc6897404e
metal : reusing llama.cpp logging (#3152)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
8c00b7a6ff
sync : ggml (Metal F32 support + reduce ggml-alloc size) (#3192)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
a51b687657
metal : relax conditions on fast matrix multiplication kernel (#3168)
|
%!s(int64=2) %!d(string=hai) anos |
 Kawrakow
|
f31b6f4e2d
metal : PP speedup (#3084)
|
%!s(int64=2) %!d(string=hai) anos |
 kchro3
|
21ac3a1503
metal : support for Swift (#3078)
|
%!s(int64=2) %!d(string=hai) anos |
|
Jhen-Jie Hong
|
4fd5477955
metal : support build for iOS/tvOS (#3089)
|
%!s(int64=2) %!d(string=hai) anos |
|
Kawrakow
|
be8c9c245b
metal : parallel RoPE on Metal (#3024)
|
%!s(int64=2) %!d(string=hai) anos |
 Przemysław Pawełczyk
|
fec2fb19e4
ggml : posixify madvise and pagesize (#3037)
|
%!s(int64=2) %!d(string=hai) anos |
|
Kawrakow
|
ca82cf7bac
metal : more optimizations (#2959)
|
%!s(int64=2) %!d(string=hai) anos |
 Karsten Weiss
|
8b56b4f2c3
metal : show all Metal device instances in the system (#2952)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
13268c5331
metal : slight speed-up for add and mul kernels (#2917)
|
%!s(int64=2) %!d(string=hai) anos |
|
Kawrakow
|
e8d9158925
metal: somewhat faster f16 x f32 matrix multiply kernel (#2951)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
3a007648f2
metal : add option to disable debug logs (close #2764)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
f55538c3cc
metal : fix memory leak (#2762)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
d67777c202
metal : add Q8_0 support (#2763)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
cf658adc83
llm : add Falcon support (#2717)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
6381d4e110
gguf : new file format with flexible meta data (beta) (#2398)
|
%!s(int64=2) %!d(string=hai) anos |
|
Jhen-Jie Hong
|
ed53db86c3
metal : print error of load pipeline state (#2564)
|
%!s(int64=2) %!d(string=hai) anos |
