瀏覽代碼

examples : add readme files

Georgi Gerganov 2 年之前
父節點
當前提交
1f5cd83275
共有 2 個文件被更改,包括 15 次插入0 次删除
  1. 7 0
      examples/lookahead/README.md
  2. 8 0
      examples/speculative/README.md

+ 7 - 0
examples/lookahead/README.md

@@ -0,0 +1,7 @@
+# llama.cpp/examples/lookahead
+
+Demonstartion of lookahead decoding technique:
+
+https://lmsys.org/blog/2023-11-21-lookahead-decoding/
+
+More info: https://github.com/ggerganov/llama.cpp/pull/4207

+ 8 - 0
examples/speculative/README.md

@@ -0,0 +1,8 @@
+# llama.cpp/examples/speculative
+
+Demonstartion of speculative decoding and tree-based speculative decoding techniques
+
+More info:
+
+- https://github.com/ggerganov/llama.cpp/pull/2926
+- https://github.com/ggerganov/llama.cpp/pull/3624