Skip to content

Commit 1f5cd83

Browse files
committed
examples : add readme files
1 parent 4fea342 commit 1f5cd83

File tree

2 files changed

+15
-0
lines changed

2 files changed

+15
-0
lines changed

examples/lookahead/README.md

+7
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
# llama.cpp/examples/lookahead
2+
3+
Demonstartion of lookahead decoding technique:
4+
5+
https://lmsys.org/blog/2023-11-21-lookahead-decoding/
6+
7+
More info: https://github.com/ggerganov/llama.cpp/pull/4207

examples/speculative/README.md

+8
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,8 @@
1+
# llama.cpp/examples/speculative
2+
3+
Demonstartion of speculative decoding and tree-based speculative decoding techniques
4+
5+
More info:
6+
7+
- https://github.com/ggerganov/llama.cpp/pull/2926
8+
- https://github.com/ggerganov/llama.cpp/pull/3624

0 commit comments

Comments
 (0)