Skip to content

Commit

Permalink
Move example prompts from project root
Browse files Browse the repository at this point in the history
  • Loading branch information
danforbes committed May 20, 2023
1 parent bdd89ce commit 35f044d
Show file tree
Hide file tree
Showing 7 changed files with 12 additions and 4 deletions.
8 changes: 4 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -176,11 +176,11 @@ Yes, but certain fine-tuned models (e.g.
[Pygmalion](https://docs.alpindale.dev/)) are more suited to chat use-cases than
so-called "base models". Here's an example of using the `llm` CLI in REPL
(Read-Evaluate-Print Loop) mode with an Alpaca model - note that the
[provided prompt format](./examples/alpaca_prompt.txt) is tailored to the model
[provided prompt format](./utils/prompts/alpaca.txt) is tailored to the model
that is being used:

```shell
llm llama repl -m ggml-alpaca-7b-q4.bin -f examples/alpaca_prompt.txt
llm llama repl -m ggml-alpaca-7b-q4.bin -f utils/prompts/alpaca.txt
```

There is also a [Vicuna chat example](./crates/llm/examples/vicuna-chat.rs) that
Expand Down Expand Up @@ -208,8 +208,8 @@ cargo run --release $MODEL_ARCHITECTURE quantize $MODEL_IN $MODEL_OUT {q4_0,q4_1

### Do you provide support for Docker and NixOS?

The `llm` [Dockerfile](./util/Dockerfile) is in the `util` directory, as is a
[NixOS flake](./util/flake) manifest and lockfile.
The `llm` [Dockerfile](./utils/Dockerfile) is in the `utils` directory, as is a
[NixOS flake](./utils/flake) manifest and lockfile.

### Do you accept contributions?

Expand Down
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
4 changes: 4 additions & 0 deletions utils/prompts/pygmalion.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
Assistant's Persona: Assistant is a highly intelligent language model trained to comply with user requests.
<START>
Assistant: How may I help you?
You: {{PROMPT}}
4 changes: 4 additions & 0 deletions utils/prompts/vicuna.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
A chat between a human ("User") and an AI assistant ("Assistant"). The assistant gives helpful, detailed, and polite answers to the human's questions.

Assistant: How may I help you?
User: {{PROMPT}}

0 comments on commit 35f044d

Please sign in to comment.