You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: messages/agent.generate.test-spec.md
+2Lines changed: 2 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -12,6 +12,8 @@ To generate a specific agent test case, this command prompts you for this inform
12
12
- Expected topic: API name of the topic you expect the agent to use when responding to the utterance.
13
13
- Expected actions: One or more API names of the expection actions the agent takes.
14
14
- Expected outcome: Natural language description of the outcome you expect.
15
+
- (Optional) Custom evaluation: Test an agent's response for specific strings or numbers.
16
+
- (Optional) Conversation history: Boilerplate for additional context you can add to the test in the form of a conversation history.
15
17
16
18
When your test spec is ready, you then run the "agent test create" command to actually create the test in your org and synchronize the metadata with your DX project. The metadata type for an agent test is AiEvaluationDefinition.
0 commit comments