Skip to content

Conversation

@thomhurst
Copy link
Owner

Automated Benchmark Update

This PR updates the benchmark documentation with the latest results from the Speed Comparison workflow.

Benchmarks Produced

Individual benchmark artifacts are available for download:

  • benchmark-DataDrivenTests
  • benchmark-AsyncTests
  • benchmark-ScaleTests
  • benchmark-MatrixTests
  • benchmark-MassiveParallelTests
  • benchmark-SetupTeardownTests
  • benchmark-BuildTime
  • benchmark-summary (aggregated overview)

Runtime Benchmarks

  • AsyncTests
  • DataDrivenTests
  • MassiveParallelTests
  • MatrixTests
  • ScaleTests
  • SetupTeardownTests

Build Benchmarks

  • BuildTime
  • 2026-01-06
  • Ubuntu Latest • .NET SDK 10.0.101

Changes

  • Updated benchmark data in docs/static/benchmarks/latest.json
  • Updated historical trends in docs/static/benchmarks/historical.json
  • Regenerated benchmark documentation in docs/docs/benchmarks/index.md
  • Updated benchmark summary in docs/static/benchmarks/summary.json

Workflow Run

  • Run ID: 20733502888
  • Triggered: schedule
  • Date:

🤖 This PR was automatically created and will be merged automatically once CI checks pass.

Copilot AI review requested due to automatic review settings January 6, 2026 00:30
@thomhurst thomhurst added automated benchmarks documentation Improvements or additions to documentation ignore-for-release labels Jan 6, 2026
@thomhurst thomhurst merged commit 6016933 into main Jan 6, 2026
12 of 13 checks passed
@thomhurst thomhurst deleted the automated-benchmarks-update branch January 6, 2026 00:30
@thomhurst
Copy link
Owner Author

Summary

Automated benchmark documentation update from the scheduled workflow run on 2026-01-06.

Critical Issues

None found ✅

This PR only updates benchmark results documentation - markdown files and JSON data files in the docs/ directory. The changes are:

  • Updated timestamps from 2026-01-05 to 2026-01-06
  • Updated benchmark performance metrics (mean, median, stddev, error values)
  • Added a new entry to historical.json for 2026-01-06
  • All changes are in documentation files under docs/

TUnit Rules Analysis:

  • ❌ No source generator changes (TUnit.Core.SourceGenerator)
  • ❌ No engine changes (TUnit.Engine)
  • ❌ No public API changes
  • ❌ No reflection code
  • ❌ No hot path changes
  • ❌ No VSTest usage
  • ✅ Documentation-only update

This is a safe, automated documentation update with no code changes.

Verdict

APPROVE - No critical issues

Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This is an automated pull request that updates benchmark documentation with the latest performance comparison results from the Speed Comparison workflow. The PR updates both JSON data files and Markdown documentation with new benchmark measurements for TUnit and competing test frameworks.

Key Changes:

  • Updated timestamps from 2026-01-05 to 2026-01-06 across all benchmark files
  • Refreshed performance metrics for 6 runtime benchmark categories and 1 build benchmark
  • Added new historical entry for 2026-01-06 benchmarks

Reviewed changes

Copilot reviewed 18 out of 18 changed files in this pull request and generated no comments.

Show a summary per file
File Description
docs/static/benchmarks/summary.json Updated timestamp metadata to 2026-01-06
docs/static/benchmarks/latest.json Updated all benchmark results with new performance metrics and timestamps
docs/static/benchmarks/historical.json Added new historical entry for 2026-01-06 run
docs/static/benchmarks/SetupTeardownTests.json Updated SetupTeardown benchmark data with new results
docs/static/benchmarks/ScaleTests.json Updated Scale benchmark data with new results
docs/static/benchmarks/MatrixTests.json Updated Matrix benchmark data with new results
docs/static/benchmarks/MassiveParallelTests.json Updated MassiveParallel benchmark data with new results
docs/static/benchmarks/DataDrivenTests.json Updated DataDriven benchmark data with new results
docs/static/benchmarks/BuildTime.json Updated BuildTime benchmark data with new results
docs/static/benchmarks/AsyncTests.json Updated AsyncTests benchmark data with new results
docs/docs/benchmarks/index.md Updated main benchmarks documentation page with new date and timestamp
docs/docs/benchmarks/SetupTeardownTests.md Updated SetupTeardown documentation with new metrics and visualizations
docs/docs/benchmarks/ScaleTests.md Updated ScaleTests documentation with new metrics and visualizations
docs/docs/benchmarks/MatrixTests.md Updated MatrixTests documentation with new metrics and visualizations
docs/docs/benchmarks/MassiveParallelTests.md Updated MassiveParallelTests documentation with new metrics and visualizations
docs/docs/benchmarks/DataDrivenTests.md Updated DataDrivenTests documentation with new metrics and visualizations
docs/docs/benchmarks/BuildTime.md Updated BuildTime documentation with new metrics and visualizations
docs/docs/benchmarks/AsyncTests.md Updated AsyncTests documentation with new metrics and visualizations

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

automated benchmarks documentation Improvements or additions to documentation ignore-for-release

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants