 Henri Vasserman
|
20568fe60f
[Fix] Reenable server embedding endpoint (#1937)
|
2 years ago |
 Randall Fitzgerald
|
794db3e7b9
Server Example Refactor and Improvements (#1570)
|
2 years ago |
 Johannes Gäßler
|
254a7a7a5f
CUDA full GPU acceleration, KV cache in VRAM (#1827)
|
2 years ago |
|
Johannes Gäßler
|
17366df842
Multi GPU support, CUDA refactor, CUDA scratch buffer (#1703)
|
2 years ago |
 Kerfuffle
|
1b78ed2081
Only show -ngl option when relevant + other doc/arg handling updates (#1625)
|
2 years ago |
 Vladimir Zorin
|
337aea1139
examples : add --alias option to gpt_params to set use friendly model name (#1614)
|
2 years ago |
|
Kerfuffle
|
0df7d63e5b
Include server in releases + other build system cleanups (#1610)
|
2 years ago |
 Steward Garcia
|
7e4ea5beff
examples : add server example with REST API (#1443)
|
2 years ago |
