 AidanBeltonS
|
38d1521608
[SYCL] Use batched mul_mat pathway (#5591)
|
1 year ago |
 Xuan Son Nguyen
|
052051d8ae
Server: normalize naming (#5779)
|
1 year ago |
 Marcus Dunn
|
d5ab29757e
llama : constified `llama_set_state_data`'s `src` (#5774)
|
1 year ago |
 Georgi Gerganov
|
87c91c0766
ci : reduce 3b ppl chunks to 1 to avoid timeout (#5771)
|
1 year ago |
 Eve
|
317709b2a8
make portability_enumeration_ext apple only (#5757)
|
1 year ago |
|
Georgi Gerganov
|
08c5ee87e4
llama : remove deprecated API (#5770)
|
1 year ago |
|
Georgi Gerganov
|
78aacf3634
awq-py : remove (#5768)
|
1 year ago |
|
Georgi Gerganov
|
8c0e8f4e73
sync : ggml
|
1 year ago |
 slaren
|
2774b0c974
add google magika inference example (ggml/748)
|
1 year ago |
 UEXTM.com
|
5f70671856
Introduce backend GUIDs (ggml/743)
|
1 year ago |
|
Xuan Son Nguyen
|
a693bea1e6
server : hit Ctrl+C twice to exit (#5734)
|
1 year ago |
 compilade
|
adcb12a9ba
llama : fix non-quantization of expert gating tensors (#5754)
|
1 year ago |
 Douglas Hanley
|
177628bfd8
llama : improve BERT tokenization (#5740)
|
1 year ago |
 Daniel Bevenius
|
6c4416868d
readme : add link to LLaVA 1.6 models (#5758)
|
1 year ago |
 Jorge A
|
efc72253f7
server : add "/chat/completions" alias for "/v1/...` (#5722)
|
1 year ago |
 Kawrakow
|
7c4263d426
ggml : make i-quants work with super-blocks of 64 (CPU,Metal) (#5760)
|
1 year ago |
|
Kawrakow
|
cb49e0f8c9
Attempt to fix android build (#5752)
|
1 year ago |
|
Kawrakow
|
0becb22ac0
IQ4_XS: a 4.25 bpw quantization (#5747)
|
1 year ago |
 Engininja2
|
c24a2a6e60
cuda : replace remaining shfl_xor with calls to warp_reduce functions (#5744)
|
1 year ago |
|
Engininja2
|
1f30b7a9f1
ggml-quants : fix avx2 iq1_s vec_dot when compiled with gcc (#5742)
|
1 year ago |
|
Georgi Gerganov
|
9d533a77d0
llama : fix defrag bugs + add parameter (#5735)
|
1 year ago |
 le.chang
|
cbbd1efa06
Makefile: use variables for cublas (#5689)
|
1 year ago |
|
Xuan Son Nguyen
|
b11a93df41
fix server hangs on empty prompt (#5733)
|
1 year ago |
|
Kawrakow
|
a33e6a0d2a
Adding IQ2_S and IQ2_M to complete coverage of the 2-3 bit quantization range (#5721)
|
1 year ago |
 Johannes Gäßler
|
47bb7b48c7
CUDA: fix DEBUG_CUDA_MALLOC (#5729)
|
1 year ago |
 Artem
|
c4d7f81786
readme : update ui list (#5731)
|
1 year ago |
|
AidanBeltonS
|
e849078c6e
[SYCL] Add support for soft_max ALiBi (#5639)
|
1 year ago |
|
Georgi Gerganov
|
67fd33132f
unicode : reuse iterator (#5726)
|
1 year ago |
 Pierrick Hymbert
|
4804215cb8
server: CI fix trailing space (#5728)
|
1 year ago |
|
Pierrick Hymbert
|
8a533f0d90
server: CI tests reduce build matrix (#5725)
|
1 year ago |
