Commit History

Author SHA1 Message Date
  Kerfuffle 6e08281e58 Extend llama_kv_cache_seq_rm to allow matching any sequence (#3843) 2 years ago
  Georgi Gerganov 6961c4bd0b batched-bench : print params at start 2 years ago
  Georgi Gerganov 0e89203b51 speculative : add tree-based sampling example (#3624) 2 years ago
  Georgi Gerganov 8c70a5ff25 batched : add bench tool (#3545) 2 years ago