Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a C-style API similar to whisper.cpp #77

Closed
wants to merge 18 commits into from
Closed

Create a C-style API similar to whisper.cpp #77

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
8f02f1b
Add llama.cpp and llama.h
thomasantony Mar 16, 2023
9c2109e
Refactor out library code from main.cpp
thomasantony Mar 14, 2023
ebfc622
Move llama_model_quantize() into llama.cpp
thomasantony Mar 13, 2023
0995df5
Add to CMakeLists.txt
thomasantony Mar 14, 2023
b14486e
Refactor code structure in llama.cpp and llama.h
thomasantony Mar 13, 2023
4b4d8a5
Update main.cpp to use new llama library
thomasantony Mar 14, 2023
a81b670
Add make_unique for C++11
thomasantony Mar 16, 2023
7fb4c51
Apply suggestions to CMakeLists.txt
thomasantony Mar 17, 2023
b0ed03b
Apply suggestions to llama.cpp and llama.h
thomasantony Mar 17, 2023
912e624
Apply suggestions to main.cpp
thomasantony Mar 17, 2023
05224ed
Add llama_tokens_to_string() to utils.cpp
thomasantony Mar 18, 2023
3839a08
Refactor llama.cpp and llama.h
thomasantony Mar 17, 2023
660a4d5
Refactor interactive mode in main.cpp
thomasantony Mar 18, 2023
edb52ab
Update llama.cpp to use instruct mode
thomasantony Mar 19, 2023
1c1cf35
Update main.cpp to use instruct mode
thomasantony Mar 19, 2023
b3541ce
Update CMakeLists to rename targets
thomasantony Mar 19, 2023
5195fed
Add support for multiple antiprompts
thomasantony Mar 19, 2023
1c545e5
Update llama_model_load() from master branch
thomasantony Mar 19, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Next Next commit
Add llama.cpp and llama.h
  • Loading branch information
@thomasantony
thomasantony committed Mar 19, 2023
commit 8f02f1b46f66d7a04d4177f733228c235f5ab2ac
7 changes: 5 additions & 2 deletions Makefile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -188,11 +188,14 @@ ggml.o: ggml.c ggml.h
utils.o: utils.cpp utils.h
$(CXX) $(CXXFLAGS) -c utils.cpp -o utils.o

llama.o: llama.cpp llama.h
$(CXX) $(CXXFLAGS) -c llama.cpp -o llama.o

clean:
rm -f *.o main quantize

main: main.cpp ggml.o utils.o
$(CXX) $(CXXFLAGS) main.cpp ggml.o utils.o -o main $(LDFLAGS)
main: main.cpp ggml.o utils.o llama.o
$(CXX) $(CXXFLAGS) main.cpp ggml.o llama.o utils.o -o main $(LDFLAGS)
./main -h

quantize: quantize.cpp ggml.o utils.o
Expand Down
Loading