Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion website/docs/components/models/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ The model type is inferred based on the model source and files. For more detail,
Spice supports a variety of features for large language models (LLMs):

- **Custom Tools**: Provide models with tools to interact with the Spice runtime. See [Tools](/docs/features/large-language-models/tools).
- **System Prompts**: Declaratively define system prompts and default values for [`v1/chat/completion`](/docs/api/HTTP/post-chat-completions) parameters. See [Parameter Overrides](/docs/features/large-language-models/parameter_overrides). Use Jinja-templating to parameterise system prompts per request see [Parameterized prompts](docs/features/large-language-models/parameterized_prompts).
- **System Prompts**: Declaratively define system prompts and default values for [`v1/chat/completion`](/docs/api/HTTP/post-chat-completions) parameters. See [Parameter Overrides](/docs/features/large-language-models/parameter_overrides.md). Use Jinja-templating to parameterise system prompts per request see [Parameterized prompts](docs/features/large-language-models/parameterized_prompts.md).
- **Memory**: Provide LLMs with memory persistence tools to store and retrieve information across conversations. See [Memory](/docs/features/large-language-models/memory).
- **Vector Search**: Perform advanced vector-based searches using embeddings. See [Vector Search](/docs/features/search/vector-search).
- **Evals**: Evaluate, track, compare, and improve language model performance for specific tasks. See [Evals](/docs/features/large-language-models/evals).
Expand Down
2 changes: 1 addition & 1 deletion website/docs/features/large-language-models/evals.md
Original file line number Diff line number Diff line change
Expand Up @@ -160,4 +160,4 @@ Spicepod models can be used to provide eval scores for other models. To do so in
"rationale": "It was a good story, they both are about love."
}
```
2. Use [Parameterized prompts](docs/features/large-language-models/parameterized_prompts) to provide details about the eval step. When used as an eval scorer, the model will be provided with the following variables: `input`, 'actual` & `ideal`. The type of these variables will depend on the dataset, as per the [dataset format](#dataset-formats).
2. Use [Parameterized prompts](docs/features/large-language-models/parameterized_prompts.md) to provide details about the eval step. When used as an eval scorer, the model will be provided with the following variables: `input`, 'actual` & `ideal`. The type of these variables will depend on the dataset, as per the [dataset format](#dataset-formats).
2 changes: 1 addition & 1 deletion website/docs/features/large-language-models/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ Spice supports a variety of LLMs (see [Model Providers](/docs/components/models/
### Core Features

- **Custom Tools**: Provide models with tools to interact with the Spice runtime. See [Tools](/docs/features/large-language-models/tools).
- **System Prompts**: Customize system prompts and override defaults for [`v1/chat/completion`](/docs/api/HTTP/post-chat-completions). See [Parameter Overrides](/docs/features/large-language-models/parameter_overrides).
- **System Prompts**: Customize system prompts and override defaults for [`v1/chat/completion`](/docs/api/HTTP/post-chat-completions). See [Parameter Overrides](/docs/features/large-language-models/parameter_overrides.md).
- **Memory**: Provide LLMs with memory persistence tools to store and retrieve information across conversations. See [Memory](/docs/features/large-language-models/memory).
- **Vector Search**: Perform advanced vector-based searches using embeddings. See [Vector Search](/docs/features/search/vector-search).
- **Evals**: Evaluate, track, compare, and improve language model performance for specific tasks. See [Evals](/docs/features/large-language-models/evals).
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ tags:
- configuration
---

Spice supports defining system prompts for Large Language Models (LLM)s in the [spicepod](/docs/features/large-language-models/parameter_overrides#system_prompt).
Spice supports defining system prompts for Large Language Models (LLM)s in the [spicepod](/docs/features/large-language-models/parameter_overrides.md#system-prompt).

**Example**:
```yaml
Expand Down
2 changes: 1 addition & 1 deletion website/docs/reference/spicepod/evals.md
Original file line number Diff line number Diff line change
Expand Up @@ -40,4 +40,4 @@ The [dataset](/docs/reference/spicepod/datasets) to use for this evaluation. Mus

A list of scoring methods to apply during the evaluation. Each scorer defines how a [model's](/docs/reference/spicepod/models) outputs will be measured against an expected result.

A full list of scorers can be found [here](/docs/features/large-language-models/evals#eval_scorers).
A full list of scorers can be found [here](/docs/features/large-language-models/evals.md#eval-scorers).