We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 4fea342 commit 1f5cd83Copy full SHA for 1f5cd83
examples/lookahead/README.md
@@ -0,0 +1,7 @@
1
+# llama.cpp/examples/lookahead
2
+
3
+Demonstartion of lookahead decoding technique:
4
5
+https://lmsys.org/blog/2023-11-21-lookahead-decoding/
6
7
+More info: https://github.com/ggerganov/llama.cpp/pull/4207
examples/speculative/README.md
@@ -0,0 +1,8 @@
+# llama.cpp/examples/speculative
+Demonstartion of speculative decoding and tree-based speculative decoding techniques
+More info:
+- https://github.com/ggerganov/llama.cpp/pull/2926
8
+- https://github.com/ggerganov/llama.cpp/pull/3624
0 commit comments