Skip to content

Conversation

@thomhurst
Copy link
Owner

Automated Benchmark Update

This PR updates the benchmark documentation with the latest results from the Speed Comparison workflow.

Benchmarks Produced

Individual benchmark artifacts are available for download:

  • benchmark-DataDrivenTests
  • benchmark-AsyncTests
  • benchmark-ScaleTests
  • benchmark-MatrixTests
  • benchmark-MassiveParallelTests
  • benchmark-SetupTeardownTests
  • benchmark-BuildTime
  • benchmark-summary (aggregated overview)

Runtime Benchmarks

  • AsyncTests
  • DataDrivenTests
  • MassiveParallelTests
  • MatrixTests
  • ScaleTests
  • SetupTeardownTests

Build Benchmarks

  • BuildTime
  • 2026-01-05
  • Ubuntu Latest • .NET SDK 10.0.101

Changes

  • Updated benchmark data in docs/static/benchmarks/latest.json
  • Updated historical trends in docs/static/benchmarks/historical.json
  • Regenerated benchmark documentation in docs/docs/benchmarks/index.md
  • Updated benchmark summary in docs/static/benchmarks/summary.json

Workflow Run

  • Run ID: 20701499437
  • Triggered: schedule
  • Date:

🤖 This PR was automatically created and will be merged automatically once CI checks pass.

Copilot AI review requested due to automatic review settings January 5, 2026 00:32
@thomhurst thomhurst added automated benchmarks documentation Improvements or additions to documentation ignore-for-release labels Jan 5, 2026
@thomhurst thomhurst merged commit c5ff03b into main Jan 5, 2026
12 of 13 checks passed
@thomhurst thomhurst deleted the automated-benchmarks-update branch January 5, 2026 00:32
@thomhurst
Copy link
Owner Author

Summary

Automated benchmark documentation update with latest results from the Speed Comparison workflow (updated TUnit version from 1.8.9 to 1.9.2).

Critical Issues

None found ✅

This PR:

  • Only touches documentation files in docs/ directory (no source code changes)
  • Updates benchmark results with new performance metrics
  • Updates version numbers from 1.8.9 to 1.9.2
  • Updates timestamps from 2026-01-04 to 2026-01-05
  • Adds historical data entry for the new benchmark run
  • Is auto-generated and will be auto-merged upon CI passing

TUnit Rules Assessment:

  • ❌ Not applicable: No changes to TUnit.Core.SourceGenerator or TUnit.Engine
  • ❌ Not applicable: No source generator output changes (no .verified.txt files needed)
  • ❌ Not applicable: No public API changes
  • ❌ Not applicable: No reflection code changes
  • ❌ Not applicable: No hot path changes
  • ✅ Confirmed: No use of Microsoft.VisualStudio.TestPlatform

Verdict

APPROVE - No critical issues

This is a routine automated documentation update with no code changes. The benchmark data updates are consistent and properly formatted.

Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This automated PR updates the TUnit benchmark documentation with the latest performance results from the January 5, 2026 CI run, comparing TUnit version 1.9.2 against other .NET testing frameworks (NUnit 4.4.0, MSTest 4.0.2, and xUnit3 3.2.1).

  • Updates all benchmark result data from 2026-01-04 to 2026-01-05
  • Updates TUnit version from 1.8.9 to 1.9.2 across all benchmarks
  • Adds historical tracking entry for the new benchmark run

Reviewed changes

Copilot reviewed 18 out of 18 changed files in this pull request and generated no comments.

Show a summary per file
File Description
docs/static/benchmarks/summary.json Updates timestamp to 2026-01-05
docs/static/benchmarks/latest.json Updates comprehensive benchmark data with new timing results and version 1.9.2
docs/static/benchmarks/historical.json Adds entry for 2026-01-05 benchmark run
docs/static/benchmarks/SetupTeardownTests.json Updates SetupTeardownTests benchmark results with new timings
docs/static/benchmarks/ScaleTests.json Updates ScaleTests benchmark results with new timings
docs/static/benchmarks/MatrixTests.json Updates MatrixTests benchmark results with new timings
docs/static/benchmarks/MassiveParallelTests.json Updates MassiveParallelTests benchmark results with new timings
docs/static/benchmarks/DataDrivenTests.json Updates DataDrivenTests benchmark results with new timings
docs/static/benchmarks/BuildTime.json Updates BuildTime benchmark results with new timings
docs/static/benchmarks/AsyncTests.json Updates AsyncTests benchmark results with new timings
docs/docs/benchmarks/index.md Updates main benchmark documentation page with new date and TUnit version
docs/docs/benchmarks/SetupTeardownTests.md Updates SetupTeardownTests documentation with new results and visualizations
docs/docs/benchmarks/ScaleTests.md Updates ScaleTests documentation with new results and visualizations
docs/docs/benchmarks/MatrixTests.md Updates MatrixTests documentation with new results and visualizations
docs/docs/benchmarks/MassiveParallelTests.md Updates MassiveParallelTests documentation with new results and visualizations
docs/docs/benchmarks/DataDrivenTests.md Updates DataDrivenTests documentation with new results and visualizations
docs/docs/benchmarks/BuildTime.md Updates BuildTime documentation with new results and visualizations
docs/docs/benchmarks/AsyncTests.md Updates AsyncTests documentation with new results and visualizations

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

automated benchmarks documentation Improvements or additions to documentation ignore-for-release

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants