 fairydreaming
|
fbca2f27fc
Add support for ArcticForCausalLM (#7020)
|
1 year ago |
 Neo Zhang
|
0df0aa8e43
add build shared lib in win release package (#7438)
|
1 year ago |
 Georgi Gerganov
|
74f33adf5f
readme : remove trailing space (#7469)
|
1 year ago |
|
Georgi Gerganov
|
1debe72737
ggml : silence UB sanitizer error during iq2_xxs quantization (#0)
|
1 year ago |
 Tristan Druyen
|
007489e895
Fix phi3 chat template confusion with zephyr (#7449)
|
1 year ago |
 Raj Hammeer Singh Hada
|
8b94e799df
readme : add Bunny in supported models [no ci] (#7469)
|
1 year ago |
 Daniel Bevenius
|
3015851c5a
llama : add getters for n_threads/n_threads_batch (#7464)
|
1 year ago |
|
Georgi Gerganov
|
55ac3b7aea
ci : use Pythia models instead of OpenLlama (#7470)
|
1 year ago |
 Victor Nogueira
|
dacfcebd60
readme : add GPT-NeoX + Pythia to the list of supported models (#7491)
|
1 year ago |
|
fairydreaming
|
9b82476ee9
Add missing inference support for GPTNeoXForCausalLM (Pythia and GPT-NeoX base models) (#7461)
|
1 year ago |
|
Georgi Gerganov
|
a61a94e543
llama : rename n_ctx -> cache.size, less confusing (#0)
|
1 year ago |
 Brian
|
152da28ae5
labeler.yml: add embedding label detector [no ci] (#7482)
|
1 year ago |
|
Georgi Gerganov
|
d48c88cbd5
ggml : remove ggml_flash_attn and ggml_flash_ff (#7463)
|
1 year ago |
|
Georgi Gerganov
|
e84b71c2c6
ggml : drop support for QK_K=64 (#7473)
|
1 year ago |
 0cc4m
|
1b1e27cb49
Update vulkan rope implementation to support frequency factors (#7475)
|
1 year ago |
|
Georgi Gerganov
|
fbf777d2b9
main : minor (#7462)
|
1 year ago |
 Johannes Gäßler
|
cd93a28cb1
CUDA: fix FA out-of-bounds reads (#7479)
|
1 year ago |
 HanishKVC
|
1e374365d1
SimpleChat: a simple and dumb web front end for testing /chat/completions and /completions end points and try chat (#7350)
|
1 year ago |
|
Georgi Gerganov
|
197ff91462
build : remove zig (#7471)
|
1 year ago |
|
Georgi Gerganov
|
6ff13987ad
common : normalize naming style (#7462)
|
1 year ago |
|
Johannes Gäßler
|
38c03478a3
CUDA: fix FA out-of-bounds writes (#7465)
|
1 year ago |
 slaren
|
b18532a4ef
phi3 : duplicate rope factors in each layer (#7447)
|
1 year ago |
 k.h.lai
|
fcda1128bc
vulkan: add workaround for iterator boundary check to fix clang-cl debug build (#7426)
|
1 year ago |
 Justine Tunney
|
03d8900ebe
llama : add missing model type names (#7445)
|
1 year ago |
|
Georgi Gerganov
|
9b3d833189
cuda : fix compile warning (#7454)
|
1 year ago |
|
Johannes Gäßler
|
95fb0aefab
CUDA: remove incorrect precision check (#7454)
|
1 year ago |
|
Georgi Gerganov
|
3e5faa8503
cuda : fix rope + add tests (#7452)
|
1 year ago |
 liuwei-git
|
201cc11afa
llama : add phi3 128K model support (#7225)
|
1 year ago |
|
Georgi Gerganov
|
6369bf0433
metal : handle F16 inf values, fix FA partial offload (#7434)
|
1 year ago |
 Olivier Chafik
|
e402de364b
`grammars`: fix resampling logic regression (#7424)
|
1 year ago |
