Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Alternative for instruct mode (Vicuna support, etc.) #863

Merged
merged 14 commits into from
Apr 14, 2023
21 changes: 21 additions & 0 deletions configs/alpaca-native-enhanced.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
--ctx_size 2048
--batch_size 16
--repeat_penalty 1.15
--temp 0.4
--top_k 30
--top_p 0.18

--interactive-first
--keep -1

--ins-prefix-bos
--ins-prefix "\n\nUser: "
--ins-suffix "\n\nAssistant: "
--reverse-prompt "User: "

-p "You are an AI language model designed to assist the User by answering their questions, offering advice, and engaging in casual conversation in a friendly, helpful, and informative manner. You respond clearly, coherently, and you consider the conversation history.

User: Hey, how's it going?

Assistant: Hey there! I'm doing great, thank you. What can I help you with today? Let's have a fun chat!"

9 changes: 9 additions & 0 deletions configs/alpaca.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
--clean-interface
--interactive-first
--keep -1
--ins-prefix-bos
--ins-prefix "\n\n### Instruction:\n\n"
--ins-suffix "\n\n### Response:\n\n"
--reverse-prompt "### Instruction:\n\n"

-p "Below is an instruction that describes a task. Write a response that appropriately completes the request.\n"
15 changes: 15 additions & 0 deletions configs/chat-with-bob.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
--interactive-first
--keep -1
--ins-prefix-bos
--ins-prefix "\nUser: "
--ins-suffix "\nBob: "
--reverse-prompt "User: "
--rm-trailing-space-workaround

-p "Transcript of a dialog, where the User interacts with an Assistant named Bob. Bob is helpful, kind, honest, good at writing, and never fails to answer the User's requests immediately and with precision.

User: Hello, Bob.
Bob: Hello. How may I help you today?
User: Please tell me the largest city in Europe.
Bob: Sure. The largest city in Europe is Moscow, the capital of Russia."

3 changes: 3 additions & 0 deletions configs/llama.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
--interactive-first
--keep -1
--temp 0.1
7 changes: 7 additions & 0 deletions configs/vicuna-simple.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
--interactive-first
--keep -1
--ins-prefix-bos
--ins-prefix "\n### Human: "
--ins-suffix "\n### Assistant: "
--reverse-prompt "### Human: "
--rm-trailing-space-workaround
8 changes: 8 additions & 0 deletions configs/vicuna-stop.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
--interactive-first
--keep -1
--ins-prefix-bos
--ins-prefix "\n### Human: "
--ins-suffix "\n### Assistant: "
--reverse-prompt "### Human: "
--stop-prompt "### Assistant: "
--rm-trailing-space-workaround
9 changes: 9 additions & 0 deletions configs/vicuna.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
--interactive-first
--keep -1
--ins-prefix-bos
--ins-prefix "\n### Human: "
--ins-suffix "\n### Assistant: "
--reverse-prompt "### Human: "
--rm-trailing-space-workaround

-p "A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions."
Loading