Georgi Gerganov 2 лет назад
Родитель
Сommit
1f5cd83275
2 измененных файлов с 15 добавлено и 0 удалено
  1. 7 0
      examples/lookahead/README.md
  2. 8 0
      examples/speculative/README.md

+ 7 - 0
examples/lookahead/README.md

@@ -0,0 +1,7 @@
+# llama.cpp/examples/lookahead
+
+Demonstartion of lookahead decoding technique:
+
+https://lmsys.org/blog/2023-11-21-lookahead-decoding/
+
+More info: https://github.com/ggerganov/llama.cpp/pull/4207

+ 8 - 0
examples/speculative/README.md

@@ -0,0 +1,8 @@
+# llama.cpp/examples/speculative
+
+Demonstartion of speculative decoding and tree-based speculative decoding techniques
+
+More info:
+
+- https://github.com/ggerganov/llama.cpp/pull/2926
+- https://github.com/ggerganov/llama.cpp/pull/3624