 compilade
|
a1631e53f6
llama : simplify Mamba with advanced batch splits (#8526)
|
hai 1 ano |
 Xuan Son Nguyen
|
fc54ef0d1c
server : support reading arguments from environment variables (#9105)
|
hai 1 ano |
 Younes Belkada
|
b40eb84895
llama : support for `falcon-mamba` architecture (#9074)
|
hai 1 ano |
 fairydreaming
|
f63f603c87
llava : zero-initialize clip_ctx structure fields with aggregate initialization 908)
|
hai 1 ano |
 Daniel Bevenius
|
8455340b87
llama : std::move llm_bigram_bpe from work_queue (#9062)
|
hai 1 ano |
 Changyeon Kim
|
2f3c1466ff
llava: Add ACC OP for GPU acceleration to the Vulkan backend in the LLAVA CLIP model. (#8984)
|
hai 1 ano |
 Meng, Hengyu
|
50addec9a5
[SYCL] fallback mmvq (#9088)
|
hai 1 ano |
 zhentaoyu
|
4f8d19ff17
[SYCL] Fix SYCL `im2col` and `convert` Overflow with Large Dims (#9052)
|
hai 1 ano |
|
fairydreaming
|
90db8146d5
tests : add missing comma in grammar integration tests (#9099)
|
hai 1 ano |
 wangshuai09
|
cfac111e2b
cann: add doc for cann backend (#8867)
|
hai 1 ano |
 Radoslav Gerganov
|
1b6ff90ff8
rpc : print error message when failed to connect endpoint (#9042)
|
hai 1 ano |
|
Radoslav Gerganov
|
18eaf29f4c
rpc : prevent crashes on invalid input (#9040)
|
hai 1 ano |
 Georgi Gerganov
|
554b049068
flake.lock: Update (#9068)
|
hai 1 ano |
 ltoniazzi
|
2339a0be1c
tests : add integration test for lora adapters (#8957)
|
hai 1 ano |
 Yoshi Suhara
|
2fb9267887
Fix incorrect use of ctx_split for bias tensors (#9063)
|
hai 1 ano |
|
Xuan Son Nguyen
|
8b3befc0e2
server : refactor middleware and /health endpoint (#9056)
|
hai 1 ano |
 tc-mb
|
d565bb2fd5
llava : support MiniCPM-V-2.6 (#8967)
|
hai 1 ano |
 Farbod Bijary
|
ee2984bdaf
py : fix wrong input type for raw_dtype in ggml to gguf scripts (#8928)
|
hai 1 ano |
 Aisuko
|
c8ddce8560
Fix inference example lacks required parameters (#9035)
|
hai 1 ano |
|
compilade
|
23fd453544
gguf-py : bump version from 0.9.1 to 0.10.0 (#9051)
|
hai 1 ano |
 Minsoo Cheong
|
c679e0cb5c
llama : add EXAONE model support (#9025)
|
hai 1 ano |
 Liu Jia
|
fb487bb567
common : add support for cpu_get_num_physical_cores() on Windows (#8771)
|
hai 1 ano |
 Yoshi Suhara
|
2a24c8caa6
Add Nemotron/Minitron GGUF Conversion & Inference Support (#8922)
|
hai 1 ano |
 Nico Bosshard
|
e3f6fd56b1
ggml : dynamic ggml_sched_max_splits based on graph_size (#9047)
|
hai 1 ano |
 gtygo
|
4b9afbbe90
retrieval : fix memory leak in retrieval query handling (#8955)
|
hai 1 ano |
 Riceball LEE
|
37501d9c79
server : fix duplicated n_predict key in the generation_settings (#8994)
|
hai 1 ano |
 Zhenwei Jin
|
4af8420afb
common : remove duplicate function llama_should_add_bos_token (#8778)
|
hai 1 ano |
 Esko Toivonen
|
6bda7ce6c3
llama : add pre-tokenizer regexes for BLOOM and gpt3-finnish (#8850)
|
hai 1 ano |
|
Georgi Gerganov
|
d5492f0525
ci : disable bench workflow (#9010)
|
hai 1 ano |
 Jiří Podivín
|
234b30676a
server : init stop and error fields of the result struct (#9026)
|
hai 1 ano |
