 Johannes Gäßler
|
64639555ff
Fixed OpenLLaMA 3b CUDA mul_mat_vec_q (#2144)
|
2 lat temu |
|
Johannes Gäßler
|
061f5f8d21
CUDA: add __restrict__ to mul mat vec kernels (#2140)
|
2 lat temu |
 dylan
|
84525e7962
docker : add support for CUDA in docker (#1461)
|
2 lat temu |
 Georgi Gerganov
|
a7e20edf22
ci : switch threads to 1 (#2138)
|
2 lat temu |
 Qingyou Meng
|
1d656d6360
ggml : change ggml_graph_compute() API to not require context (#1999)
|
2 lat temu |
|
Georgi Gerganov
|
7242140283
ggml : remove sched_yield() call in ggml_graph_compute_thread() (#2134)
|
2 lat temu |
 Aarni Koskela
|
3e08ae99ce
convert.py: add mapping for safetensors bf16 (#1598)
|
2 lat temu |
 Howard Su
|
481f793acc
Fix opencl by wrap #if-else-endif with \n (#2086)
|
2 lat temu |
|
Georgi Gerganov
|
dfd9fce6d6
ggml : fix restrict usage
|
2 lat temu |
 Judd
|
36680f6e40
convert : update for baichuan (#2081)
|
2 lat temu |
 tslmy
|
a17a2683d8
alpaca.sh : update model file name (#2074)
|
2 lat temu |
 Tobias Lütke
|
31cfbb1013
Expose generation timings from server & update completions.js (#2116)
|
2 lat temu |
 Jesse Jojo Johnson
|
983b555e9d
Update Server Instructions (#2113)
|
2 lat temu |
|
Georgi Gerganov
|
ec326d350c
ggml : fix bug introduced in #1237
|
2 lat temu |
|
Georgi Gerganov
|
1b6efeab82
tests : fix test-grad0
|
2 lat temu |
 Stephan Walter
|
1b107b8550
ggml : generalize `quantize_fns` for simpler FP16 handling (#1237)
|
2 lat temu |
|
Jesse Jojo Johnson
|
8567c76b53
Update server instructions for web front end (#2103)
|
2 lat temu |
|
Johannes Gäßler
|
924dd22fd3
Quantized dot products for CUDA mul mat vec (#2067)
|
2 lat temu |
|
Howard Su
|
051c70dcd5
llama: Don't double count the sampling time (#2107)
|
2 lat temu |
|
Johannes Gäßler
|
9e4475f5cf
Fixed OpenCL offloading prints (#2082)
|
2 lat temu |
 Nigel Bosch
|
7f0e9a775e
embd-input: Fix input embedding example unsigned int seed (#2105)
|
2 lat temu |
|
Georgi Gerganov
|
b472f3fca5
readme : add link web chat PR
|
2 lat temu |
|
Georgi Gerganov
|
ed9a54e512
ggml : sync latest (new ops, macros, refactoring) (#2106)
|
2 lat temu |
 jwj7140
|
f257fd2550
Add an API example using server.cpp similar to OAI. (#2009)
|
2 lat temu |
|
Tobias Lütke
|
7ee76e45af
Simple webchat for server (#1998)
|
2 lat temu |
 Henri Vasserman
|
acc111caf9
Allow old Make to build server. (#2098)
|
2 lat temu |
 ZhouYuChen
|
23c7c6fc91
Update Makefile: clean simple (#2097)
|
2 lat temu |
 Erik Scholz
|
698efad5fb
CI: make the brew update temporarily optional. (#2092)
|
2 lat temu |
 Govlzkoy
|
14a2cc71f6
[ggml] fix index for ne03 value in ggml_cl_mul_f32 (#2088)
|
2 lat temu |
|
Henri Vasserman
|
1cf14ccef1
fix server crashes (#2076)
|
2 lat temu |
