Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 9 additions & 9 deletions docs/docs/benchmarks/AsyncTests.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ sidebar_position: 2
# AsyncTests Benchmark

:::info Last Updated
This benchmark was automatically generated on **2026-01-04** from the latest CI run.
This benchmark was automatically generated on **2026-01-05** from the latest CI run.

**Environment:** Ubuntu Latest • .NET SDK 10.0.101
:::
Expand All @@ -16,11 +16,11 @@ This benchmark was automatically generated on **2026-01-04** from the latest CI

| Framework | Version | Mean | Median | StdDev |
|-----------|---------|------|--------|--------|
| **TUnit** | 1.8.9 | 673.9 ms | 673.6 ms | 4.96 ms |
| NUnit | 4.4.0 | 710.4 ms | 709.3 ms | 4.72 ms |
| MSTest | 4.0.2 | 652.6 ms | 653.1 ms | 7.88 ms |
| xUnit3 | 3.2.1 | 728.9 ms | 728.6 ms | 3.42 ms |
| **TUnit (AOT)** | 1.8.9 | 124.2 ms | 124.1 ms | 0.36 ms |
| **TUnit** | 1.9.2 | 653.2 ms | 652.5 ms | 4.34 ms |
| NUnit | 4.4.0 | 689.4 ms | 689.9 ms | 5.09 ms |
| MSTest | 4.0.2 | 635.1 ms | 635.3 ms | 5.36 ms |
| xUnit3 | 3.2.1 | 718.3 ms | 717.1 ms | 7.72 ms |
| **TUnit (AOT)** | 1.9.2 | 125.9 ms | 126.0 ms | 0.44 ms |

## 📈 Visual Comparison

Expand Down Expand Up @@ -58,8 +58,8 @@ This benchmark was automatically generated on **2026-01-04** from the latest CI
xychart-beta
title "AsyncTests Performance Comparison"
x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT"]
y-axis "Time (ms)" 0 --> 875
bar [673.9, 710.4, 652.6, 728.9, 124.2]
y-axis "Time (ms)" 0 --> 862
bar [653.2, 689.4, 635.1, 718.3, 125.9]
```

## 🎯 Key Insights
Expand All @@ -72,4 +72,4 @@ This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3 using
View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
:::

*Last generated: 2026-01-04T00:33:06.814Z*
*Last generated: 2026-01-05T00:32:10.822Z*
14 changes: 7 additions & 7 deletions docs/docs/benchmarks/BuildTime.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ sidebar_position: 8
# Build Performance Benchmark

:::info Last Updated
This benchmark was automatically generated on **2026-01-04** from the latest CI run.
This benchmark was automatically generated on **2026-01-05** from the latest CI run.

**Environment:** Ubuntu Latest • .NET SDK 10.0.101
:::
Expand All @@ -18,10 +18,10 @@ Compilation time comparison across frameworks:

| Framework | Version | Mean | Median | StdDev |
|-----------|---------|------|--------|--------|
| **TUnit** | 1.8.9 | 1.991 s | 1.993 s | 0.0170 s |
| Build_NUnit | 4.4.0 | 1.609 s | 1.604 s | 0.0155 s |
| Build_MSTest | 4.0.2 | 1.680 s | 1.680 s | 0.0124 s |
| Build_xUnit3 | 3.2.1 | 1.587 s | 1.585 s | 0.0137 s |
| **TUnit** | 1.9.2 | 2.074 s | 2.077 s | 0.0215 s |
| Build_NUnit | 4.4.0 | 1.664 s | 1.665 s | 0.0149 s |
| Build_MSTest | 4.0.2 | 1.739 s | 1.735 s | 0.0146 s |
| Build_xUnit3 | 3.2.1 | 1.647 s | 1.646 s | 0.0132 s |

## 📈 Visual Comparison

Expand Down Expand Up @@ -60,7 +60,7 @@ xychart-beta
title "Build Time Comparison"
x-axis ["Build_TUnit", "Build_NUnit", "Build_MSTest", "Build_xUnit3"]
y-axis "Time (s)" 0 --> 3
bar [1.991, 1.609, 1.68, 1.587]
bar [2.074, 1.664, 1.739, 1.647]
```

---
Expand All @@ -69,4 +69,4 @@ xychart-beta
View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
:::

*Last generated: 2026-01-04T00:33:06.816Z*
*Last generated: 2026-01-05T00:32:10.824Z*
18 changes: 9 additions & 9 deletions docs/docs/benchmarks/DataDrivenTests.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ sidebar_position: 3
# DataDrivenTests Benchmark

:::info Last Updated
This benchmark was automatically generated on **2026-01-04** from the latest CI run.
This benchmark was automatically generated on **2026-01-05** from the latest CI run.

**Environment:** Ubuntu Latest • .NET SDK 10.0.101
:::
Expand All @@ -16,11 +16,11 @@ This benchmark was automatically generated on **2026-01-04** from the latest CI

| Framework | Version | Mean | Median | StdDev |
|-----------|---------|------|--------|--------|
| **TUnit** | 1.8.9 | 627.13 ms | 626.23 ms | 12.783 ms |
| NUnit | 4.4.0 | 596.92 ms | 598.23 ms | 7.501 ms |
| MSTest | 4.0.2 | 610.06 ms | 607.69 ms | 6.423 ms |
| xUnit3 | 3.2.1 | 607.56 ms | 606.34 ms | 5.915 ms |
| **TUnit (AOT)** | 1.8.9 | 24.19 ms | 24.14 ms | 0.164 ms |
| **TUnit** | 1.9.2 | 603.06 ms | 602.59 ms | 9.844 ms |
| NUnit | 4.4.0 | 572.23 ms | 571.66 ms | 10.109 ms |
| MSTest | 4.0.2 | 572.96 ms | 571.54 ms | 17.749 ms |
| xUnit3 | 3.2.1 | 589.79 ms | 588.52 ms | 7.424 ms |
| **TUnit (AOT)** | 1.9.2 | 25.00 ms | 24.78 ms | 0.555 ms |

## 📈 Visual Comparison

Expand Down Expand Up @@ -58,8 +58,8 @@ This benchmark was automatically generated on **2026-01-04** from the latest CI
xychart-beta
title "DataDrivenTests Performance Comparison"
x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT"]
y-axis "Time (ms)" 0 --> 753
bar [627.13, 596.92, 610.06, 607.56, 24.19]
y-axis "Time (ms)" 0 --> 724
bar [603.06, 572.23, 572.96, 589.79, 25]
```

## 🎯 Key Insights
Expand All @@ -72,4 +72,4 @@ This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3 using
View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
:::

*Last generated: 2026-01-04T00:33:06.814Z*
*Last generated: 2026-01-05T00:32:10.822Z*
18 changes: 9 additions & 9 deletions docs/docs/benchmarks/MassiveParallelTests.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ sidebar_position: 4
# MassiveParallelTests Benchmark

:::info Last Updated
This benchmark was automatically generated on **2026-01-04** from the latest CI run.
This benchmark was automatically generated on **2026-01-05** from the latest CI run.

**Environment:** Ubuntu Latest • .NET SDK 10.0.101
:::
Expand All @@ -16,11 +16,11 @@ This benchmark was automatically generated on **2026-01-04** from the latest CI

| Framework | Version | Mean | Median | StdDev |
|-----------|---------|------|--------|--------|
| **TUnit** | 1.8.9 | 720.4 ms | 718.3 ms | 11.51 ms |
| NUnit | 4.4.0 | 1,244.1 ms | 1,240.3 ms | 11.72 ms |
| MSTest | 4.0.2 | 3,005.9 ms | 3,003.5 ms | 16.53 ms |
| xUnit3 | 3.2.1 | 3,070.9 ms | 3,066.7 ms | 13.65 ms |
| **TUnit (AOT)** | 1.8.9 | 132.5 ms | 132.4 ms | 0.47 ms |
| **TUnit** | 1.9.2 | 697.6 ms | 696.0 ms | 5.86 ms |
| NUnit | 4.4.0 | 1,224.7 ms | 1,224.6 ms | 10.65 ms |
| MSTest | 4.0.2 | 2,977.5 ms | 2,977.5 ms | 3.40 ms |
| xUnit3 | 3.2.1 | 3,079.9 ms | 3,080.8 ms | 5.61 ms |
| **TUnit (AOT)** | 1.9.2 | 132.7 ms | 132.9 ms | 0.68 ms |

## 📈 Visual Comparison

Expand Down Expand Up @@ -58,8 +58,8 @@ This benchmark was automatically generated on **2026-01-04** from the latest CI
xychart-beta
title "MassiveParallelTests Performance Comparison"
x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT"]
y-axis "Time (ms)" 0 --> 3686
bar [720.4, 1244.1, 3005.9, 3070.9, 132.5]
y-axis "Time (ms)" 0 --> 3696
bar [697.6, 1224.7, 2977.5, 3079.9, 132.7]
```

## 🎯 Key Insights
Expand All @@ -72,4 +72,4 @@ This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3 using
View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
:::

*Last generated: 2026-01-04T00:33:06.814Z*
*Last generated: 2026-01-05T00:32:10.822Z*
18 changes: 9 additions & 9 deletions docs/docs/benchmarks/MatrixTests.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ sidebar_position: 5
# MatrixTests Benchmark

:::info Last Updated
This benchmark was automatically generated on **2026-01-04** from the latest CI run.
This benchmark was automatically generated on **2026-01-05** from the latest CI run.

**Environment:** Ubuntu Latest • .NET SDK 10.0.101
:::
Expand All @@ -16,11 +16,11 @@ This benchmark was automatically generated on **2026-01-04** from the latest CI

| Framework | Version | Mean | Median | StdDev |
|-----------|---------|------|--------|--------|
| **TUnit** | 1.8.9 | 719.70 ms | 719.93 ms | 6.625 ms |
| NUnit | 4.4.0 | 1,613.11 ms | 1,611.94 ms | 5.491 ms |
| MSTest | 4.0.2 | 1,544.09 ms | 1,544.61 ms | 6.387 ms |
| xUnit3 | 3.2.1 | 1,632.14 ms | 1,633.25 ms | 5.253 ms |
| **TUnit (AOT)** | 1.8.9 | 79.25 ms | 79.36 ms | 0.369 ms |
| **TUnit** | 1.9.2 | 663.90 ms | 664.63 ms | 8.676 ms |
| NUnit | 4.4.0 | 1,580.27 ms | 1,582.11 ms | 8.704 ms |
| MSTest | 4.0.2 | 1,514.48 ms | 1,516.66 ms | 8.146 ms |
| xUnit3 | 3.2.1 | 1,605.08 ms | 1,603.01 ms | 12.836 ms |
| **TUnit (AOT)** | 1.9.2 | 79.46 ms | 79.42 ms | 0.419 ms |

## 📈 Visual Comparison

Expand Down Expand Up @@ -58,8 +58,8 @@ This benchmark was automatically generated on **2026-01-04** from the latest CI
xychart-beta
title "MatrixTests Performance Comparison"
x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT"]
y-axis "Time (ms)" 0 --> 1959
bar [719.7, 1613.11, 1544.09, 1632.14, 79.25]
y-axis "Time (ms)" 0 --> 1927
bar [663.9, 1580.27, 1514.48, 1605.08, 79.46]
```

## 🎯 Key Insights
Expand All @@ -72,4 +72,4 @@ This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3 using
View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
:::

*Last generated: 2026-01-04T00:33:06.815Z*
*Last generated: 2026-01-05T00:32:10.823Z*
18 changes: 9 additions & 9 deletions docs/docs/benchmarks/ScaleTests.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ sidebar_position: 6
# ScaleTests Benchmark

:::info Last Updated
This benchmark was automatically generated on **2026-01-04** from the latest CI run.
This benchmark was automatically generated on **2026-01-05** from the latest CI run.

**Environment:** Ubuntu Latest • .NET SDK 10.0.101
:::
Expand All @@ -16,11 +16,11 @@ This benchmark was automatically generated on **2026-01-04** from the latest CI

| Framework | Version | Mean | Median | StdDev |
|-----------|---------|------|--------|--------|
| **TUnit** | 1.8.9 | 631.33 ms | 628.29 ms | 7.034 ms |
| NUnit | 4.4.0 | 622.73 ms | 625.70 ms | 8.386 ms |
| MSTest | 4.0.2 | 621.62 ms | 621.13 ms | 10.767 ms |
| xUnit3 | 3.2.1 | 616.92 ms | 619.05 ms | 10.301 ms |
| **TUnit (AOT)** | 1.8.9 | 40.63 ms | 40.69 ms | 3.148 ms |
| **TUnit** | 1.9.2 | 625.70 ms | 625.21 ms | 8.807 ms |
| NUnit | 4.4.0 | 622.92 ms | 622.27 ms | 8.522 ms |
| MSTest | 4.0.2 | 613.05 ms | 613.58 ms | 7.337 ms |
| xUnit3 | 3.2.1 | 606.81 ms | 605.86 ms | 5.166 ms |
| **TUnit (AOT)** | 1.9.2 | 40.66 ms | 40.45 ms | 2.956 ms |

## 📈 Visual Comparison

Expand Down Expand Up @@ -58,8 +58,8 @@ This benchmark was automatically generated on **2026-01-04** from the latest CI
xychart-beta
title "ScaleTests Performance Comparison"
x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT"]
y-axis "Time (ms)" 0 --> 758
bar [631.33, 622.73, 621.62, 616.92, 40.63]
y-axis "Time (ms)" 0 --> 751
bar [625.7, 622.92, 613.05, 606.81, 40.66]
```

## 🎯 Key Insights
Expand All @@ -72,4 +72,4 @@ This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3 using
View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
:::

*Last generated: 2026-01-04T00:33:06.815Z*
*Last generated: 2026-01-05T00:32:10.823Z*
18 changes: 9 additions & 9 deletions docs/docs/benchmarks/SetupTeardownTests.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ sidebar_position: 7
# SetupTeardownTests Benchmark

:::info Last Updated
This benchmark was automatically generated on **2026-01-04** from the latest CI run.
This benchmark was automatically generated on **2026-01-05** from the latest CI run.

**Environment:** Ubuntu Latest • .NET SDK 10.0.101
:::
Expand All @@ -16,11 +16,11 @@ This benchmark was automatically generated on **2026-01-04** from the latest CI

| Framework | Version | Mean | Median | StdDev |
|-----------|---------|------|--------|--------|
| **TUnit** | 1.8.9 | 643.8 ms | 644.9 ms | 7.94 ms |
| NUnit | 4.4.0 | 1,178.8 ms | 1,180.3 ms | 8.12 ms |
| MSTest | 4.0.2 | 1,114.4 ms | 1,112.4 ms | 11.12 ms |
| xUnit3 | 3.2.1 | 1,197.6 ms | 1,197.0 ms | 9.27 ms |
| **TUnit (AOT)** | 1.8.9 | NA | NA | NA |
| **TUnit** | 1.9.2 | 639.4 ms | 640.3 ms | 6.70 ms |
| NUnit | 4.4.0 | 1,147.0 ms | 1,145.0 ms | 6.39 ms |
| MSTest | 4.0.2 | 1,098.1 ms | 1,097.5 ms | 4.27 ms |
| xUnit3 | 3.2.1 | 1,186.2 ms | 1,185.6 ms | 7.12 ms |
| **TUnit (AOT)** | 1.9.2 | NA | NA | NA |

## 📈 Visual Comparison

Expand Down Expand Up @@ -58,8 +58,8 @@ This benchmark was automatically generated on **2026-01-04** from the latest CI
xychart-beta
title "SetupTeardownTests Performance Comparison"
x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT"]
y-axis "Time (ms)" 0 --> 1438
bar [643.8, 1178.8, 1114.4, 1197.6, 0]
y-axis "Time (ms)" 0 --> 1424
bar [639.4, 1147, 1098.1, 1186.2, 0]
```

## 🎯 Key Insights
Expand All @@ -72,4 +72,4 @@ This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3 using
View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
:::

*Last generated: 2026-01-04T00:33:06.815Z*
*Last generated: 2026-01-05T00:32:10.823Z*
6 changes: 3 additions & 3 deletions docs/docs/benchmarks/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ sidebar_position: 1
# Performance Benchmarks

:::info Last Updated
These benchmarks were automatically generated on **2026-01-04** from the latest CI run.
These benchmarks were automatically generated on **2026-01-05** from the latest CI run.

**Environment:** Ubuntu Latest • .NET SDK 10.0.101
:::
Expand Down Expand Up @@ -37,7 +37,7 @@ These benchmarks compare TUnit against the most popular .NET testing frameworks:

| Framework | Version Tested |
|-----------|----------------|
| **TUnit** | 1.8.9 |
| **TUnit** | 1.9.2 |
| **xUnit v3** | 3.2.1 |
| **NUnit** | 4.4.0 |
| **MSTest** | 4.0.2 |
Expand Down Expand Up @@ -80,4 +80,4 @@ These benchmarks run automatically daily via [GitHub Actions](https://github.com
Each benchmark runs multiple iterations with statistical analysis to ensure accuracy. Results may vary based on hardware and test characteristics.
:::

*Last generated: 2026-01-04T00:33:06.816Z*
*Last generated: 2026-01-05T00:32:10.824Z*
46 changes: 23 additions & 23 deletions docs/static/benchmarks/AsyncTests.json
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
{
"timestamp": "2026-01-04T00:33:06.814Z",
"timestamp": "2026-01-05T00:32:10.822Z",
"category": "AsyncTests",
"environment": {
"benchmarkDotNetVersion": "BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04.3 LTS (Noble Numbat)",
Expand All @@ -9,43 +9,43 @@
"results": [
{
"Method": "TUnit",
"Version": "1.8.9",
"Mean": "673.9 ms",
"Error": "5.59 ms",
"StdDev": "4.96 ms",
"Median": "673.6 ms"
"Version": "1.9.2",
"Mean": "653.2 ms",
"Error": "4.89 ms",
"StdDev": "4.34 ms",
"Median": "652.5 ms"
},
{
"Method": "NUnit",
"Version": "4.4.0",
"Mean": "710.4 ms",
"Error": "5.65 ms",
"StdDev": "4.72 ms",
"Median": "709.3 ms"
"Mean": "689.4 ms",
"Error": "5.74 ms",
"StdDev": "5.09 ms",
"Median": "689.9 ms"
},
{
"Method": "MSTest",
"Version": "4.0.2",
"Mean": "652.6 ms",
"Error": "8.42 ms",
"StdDev": "7.88 ms",
"Median": "653.1 ms"
"Mean": "635.1 ms",
"Error": "6.42 ms",
"StdDev": "5.36 ms",
"Median": "635.3 ms"
},
{
"Method": "xUnit3",
"Version": "3.2.1",
"Mean": "728.9 ms",
"Error": "4.09 ms",
"StdDev": "3.42 ms",
"Median": "728.6 ms"
"Mean": "718.3 ms",
"Error": "8.71 ms",
"StdDev": "7.72 ms",
"Median": "717.1 ms"
},
{
"Method": "TUnit_AOT",
"Version": "1.8.9",
"Mean": "124.2 ms",
"Error": "0.43 ms",
"StdDev": "0.36 ms",
"Median": "124.1 ms"
"Version": "1.9.2",
"Mean": "125.9 ms",
"Error": "0.47 ms",
"StdDev": "0.44 ms",
"Median": "126.0 ms"
}
]
}
Loading
Loading