Georgi Gerganov 0e89203b51 speculative : add tree-based sampling example (#3624) 2 vuotta sitten
..
Sources 0e89203b51 speculative : add tree-based sampling example (#3624) 2 vuotta sitten
.gitignore 24ba3d829e examples : add batched.swift + improve CI for swift (#3562) 2 vuotta sitten
Makefile 24ba3d829e examples : add batched.swift + improve CI for swift (#3562) 2 vuotta sitten
Package.swift 24ba3d829e examples : add batched.swift + improve CI for swift (#3562) 2 vuotta sitten
README.md 24ba3d829e examples : add batched.swift + improve CI for swift (#3562) 2 vuotta sitten

README.md

This is a swift clone of examples/batched.

$ make $ ./swift MODEL_PATH [PROMPT] [PARALLEL]