Skip to content

feat: intelligent test failure diagnosis and categorization #4895

@thomhurst

Description

@thomhurst

Description

When tests fail, error messages are basic with no intelligent diagnosis. There's no automated categorization or suggested fixes.

Why

Developers spend time debugging obvious failures. There's no way to automatically distinguish between test failures and infrastructure problems.

Proposed Approach

  • Create ITestFailureDiagnostics analyzing exception type, test dependencies, resource state
  • Implement TestFailureCategorizer: InfrastructureFail, TestCodeFail, ProductionFail, EnvironmentFail
  • Generate diagnostic suggestions, e.g.: "This test timed out after 5s. The slow operation was Database.Query(). Consider [Timeout(10000)]."
  • Show dependency chain when a test fails due to a dependency failure

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requesthelp wantedExtra attention is needed

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions