Jared Van Bortel
|
be55134a53
convert : refactor vocab selection logic (#6355)
|
1 year ago |
Ziang Wu
|
66ba560256
llava : fix MobileVLM (#6364)
|
1 year ago |
compilade
|
0308f5e3d7
llama : fix command-r inference when omitting outputs (#6367)
|
1 year ago |
Pierrick Hymbert
|
28cb9a09c4
ci: bench: fix master not schedule, fix commit status failed on external repo (#6365)
|
1 year ago |
Ting Sun
|
cfc4d75df6
doc: fix outdated default value of batch size (#6336)
|
1 year ago |
Eric Zhang
|
6902cb7f2e
server : stop gracefully on SIGTERM (#6348)
|
1 year ago |
hutli
|
d2d8f38996
nix: removed unnessesary indentation
|
1 year ago |
hutli
|
d39b308eaf
nix: moved blas availability check to package inputs so it is still overridable
|
1 year ago |
hutli
|
c873976649
using blas.meta.available to check host platform
|
1 year ago |
hutli
|
dbb03e2b9c
only using explicit blas if hostPlatform is allowed
|
1 year ago |
Someone Serge
|
e9f17dc3bf
nix: .#windows: proper cross-compilation set-up
|
1 year ago |
Someone Serge
|
22a462cc1f
nix: package: don't introduce the dependency on python
|
1 year ago |
hutli
|
f6a0f5c642
nix: .#widnows: init
|
1 year ago |
Ziang Wu
|
d0e2f6416b
doc: fix typo in MobileVLM-README.md (#6181)
|
1 year ago |
Neo Zhang Jianyu
|
25f4a613c4
[SYCL] fix set main gpu crash (#6339)
|
1 year ago |
Pierrick Hymbert
|
a016026a3a
server: continuous performance monitoring and PR comment (#6283)
|
1 year ago |
Someone Serge
|
53c7ec53d5
nix: ci: dont test cuda and rocm (for now)
|
1 year ago |
slaren
|
e5b89a441a
ggml : fix bounds checking of zero size views (#6347)
|
1 year ago |
Georgi Gerganov
|
3a0345970e
make : whitespace
|
1 year ago |
howlger
|
1e13987fba
embedding : show full embedding for single prompt (#6342)
|
1 year ago |
AidanBeltonS
|
e82f9e2b83
[SYCL] Fix batched impl for NVidia GPU (#6164)
|
1 year ago |
Kawrakow
|
cbc8343619
Make IQ1_M work for QK_K = 64 (#6327)
|
1 year ago |
Sigbjørn Skjæret
|
e562b9714b
common : change --no-penalize-nl to --penalize-nl (#6334)
|
1 year ago |
Georgi Gerganov
|
2ab4f00d25
llama2c : open file as binary (#6332)
|
1 year ago |
Mateusz Charytoniuk
|
1740d6dd4e
readme : add php api bindings (#6326)
|
1 year ago |
Eric Zhang
|
0642b22cd1
server: public: use relative routes for static files (#6325)
|
1 year ago |
Neo Zhang Jianyu
|
a4f569e8a3
[SYCL] fix no file in win rel (#6314)
|
1 year ago |
Jared Van Bortel
|
32c8486e1f
wpm : portable unicode tolower (#6305)
|
1 year ago |
compilade
|
557410b8f0
llama : greatly reduce output buffer memory usage (#6122)
|
1 year ago |
Kawrakow
|
55c1b2a3bb
IQ1_M: 1.75 bpw quantization (#6302)
|
1 year ago |