Benjamin Findley e586ee4259 change default temperature of OAI compat API from 0 to 1 (#7226) vor 1 Jahr
..
steps e586ee4259 change default temperature of OAI compat API from 0 to 1 (#7226) vor 1 Jahr
embeddings.feature 8843a98c2b Improve usability of --model-url & related flags (#6930) vor 1 Jahr
environment.py bd60d82d0c server tests : more pythonic process management; fix bare `except:` (#6146) vor 1 Jahr
issues.feature 9731134296 server: tests: passkey challenge / self-extend with context shift demo (#5832) vor 1 Jahr
parallel.feature f482bb2e49 common: llama_load_model_from_url split support (#6192) vor 1 Jahr
passkey.feature 9731134296 server: tests: passkey challenge / self-extend with context shift demo (#5832) vor 1 Jahr
results.feature 3ea0d36000 Server: add tests for batch size, different seeds (#6950) vor 1 Jahr
security.feature 5b7b0ac8df json-schema-to-grammar improvements (+ added to server) (#5978) vor 1 Jahr
server.feature 911b3900dd server : add_special option for tokenize endpoint (#7059) vor 1 Jahr
slotsave.feature beea6e1b16 llama : save and restore kv cache for single seq id (#6341) vor 1 Jahr
wrong_usages.feature 9731134296 server: tests: passkey challenge / self-extend with context shift demo (#5832) vor 1 Jahr