Skip to content

Commit

Permalink
examples : add readme files
Browse files Browse the repository at this point in the history
  • Loading branch information
ggerganov committed Nov 29, 2023
1 parent 4fea342 commit 1f5cd83
Show file tree
Hide file tree
Showing 2 changed files with 15 additions and 0 deletions.
7 changes: 7 additions & 0 deletions examples/lookahead/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# llama.cpp/examples/lookahead

Demonstartion of lookahead decoding technique:

https://lmsys.org/blog/2023-11-21-lookahead-decoding/

More info: https://github.com/ggerganov/llama.cpp/pull/4207
8 changes: 8 additions & 0 deletions examples/speculative/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
# llama.cpp/examples/speculative

Demonstartion of speculative decoding and tree-based speculative decoding techniques

More info:

- https://github.com/ggerganov/llama.cpp/pull/2926
- https://github.com/ggerganov/llama.cpp/pull/3624

0 comments on commit 1f5cd83

Please sign in to comment.