Getting Started

Getting Started

Prerequisites

Requirement	Details
.NET 9 SDK	Download — verify with dotnet --version (must show 9.0.x)
Copilot Studio agent	A published agent with Direct Line Web Channel enabled
Direct Line secret	From Copilot Studio → Settings → Security → Web channel security
Bot ID	Visible in the agent's Direct Line URI
AI Foundry endpoint	Azure AI Foundry or any OpenAI-compatible endpoint for judge evaluation
AI Foundry API key	API key for the judge model deployment

Optional Prerequisites

Requirement	When Needed
Microsoft Entra ID tenant	Only when enabling authentication for team use
Docker	For containerized deployment
Azure subscription	For Azure App Service / ACI / AKS deployment

---

Installation

# Clone the repository
git clone <repository-url>
cd MaaJforMCS

# Restore and build all projects
dotnet build --configuration Release

The build compiles all five projects: Domain, Data, Core, WebUI, and CLI.

---

Starting the Web UI

# From the project root (Debug build — development)
cd CopilotStudioTestRunner.WebUI\bin\Debug\net9.0
CopilotStudioTestRunner.WebUI.exe

# Or via dotnet run
cd CopilotStudioTestRunner.WebUI
dotnet run

Open the URL shown in the console output (typically http://localhost:5062).

On first run, the Setup Wizard appears automatically. See Setup Wizard for the step-by-step guide.

---

Starting the CLI

cd CopilotStudioTestRunner.CLI
dotnet run -- list             # List all test suites
dotnet run -- run --suite "My Suite" --output ./results

See CLI Reference for all commands.

---

Data Storage

All application data is stored locally:

Path	Contents
./data/app.db	SQLite database (agents, suites, runs, results)
./data/index/	Lucene.NET BM25 search index
./data/uploads/	Uploaded document files
./logs/	Rolling Serilog log files

No external database server is required.

---

Next Steps

1. Follow Quick Start to run your first test in 5 minutes
2. Use the Setup Wizard for guided first-time configuration
3. Read Multi-Agent Testing to set up multiple environments
4. Configure Authentication before sharing with your team