Skip to content
This repository was archived by the owner on Jun 5, 2025. It is now read-only.

Update the _chat integration tests to be more deterministic #861

Merged
merged 1 commit into from
Jan 31, 2025
Merged

Update the _chat integration tests to be more deterministic #861

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
24 changes: 12 additions & 12 deletions tests/integration/testcases.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,15 +21,15 @@ testcases:
{
"messages":[
{
"content":"Hello",
"content":"Reply with that exact sentence: Hello from the integration tests!",
"role":"user"
}
],
"model":"gpt-4o",
"stream":true
}
likes: |
Hello! How can I assist you today?
Hello from the integration tests!

copilot_malicious_package_question:
name: Copilot User asks about a malicious package
Expand Down Expand Up @@ -64,7 +64,7 @@ testcases:
"role":"system"
},
{
"content":"Hello",
"content":"Reply with that exact sentence: Hello from the integration tests!",
"role":"user"
}
],
Expand All @@ -73,7 +73,7 @@ testcases:
"temperature":0
}
likes: |
Hello! How can I assist you today?
Hello from the integration tests!

llamacpp_fim:
name: LlamaCPP FIM
Expand Down Expand Up @@ -107,7 +107,7 @@ testcases:
"role":"system"
},
{
"content":"Hello",
"content":"Reply with that exact sentence: Hello from the integration tests!",
"role":"user"
}
],
Expand All @@ -116,7 +116,7 @@ testcases:
"temperature":0
}
likes: |
Hello! How can I assist you today?
Hello from the integration tests!

openai_fim:
name: OpenAI FIM
Expand Down Expand Up @@ -157,7 +157,7 @@ testcases:
"role":"system"
},
{
"content":"Hello",
"content":"Reply with that exact sentence: Hello from the integration tests!",
"role":"user"
}
],
Expand All @@ -166,7 +166,7 @@ testcases:
"temperature":0
}
likes: |
Hello! How can I assist you today?
Hello from the integration tests!

vllm_fim:
name: VLLM FIM
Expand Down Expand Up @@ -217,7 +217,7 @@ testcases:
"role":"system"
},
{
"content":"Hello",
"content":"Reply with that exact sentence: Hello from the integration tests!",
"role":"user"
}
],
Expand All @@ -226,7 +226,7 @@ testcases:
"temperature":0
}
likes: |
Hello! How can I assist you today?
Hello from the integration tests!

anthropic_fim:
name: Anthropic FIM
Expand Down Expand Up @@ -280,7 +280,7 @@ testcases:
"role":"system"
},
{
"content":"Hello",
"content":"Reply with that exact sentence: Hello from the integration tests!",
"role":"user"
}
],
Expand All @@ -289,7 +289,7 @@ testcases:
"temperature":0
}
likes: |
Hello! How can I assist you today?
Hello from the integration tests!

ollama_fim:
name: Ollama FIM
Expand Down