Do not consider tests that do not unregister their error handlers or exception handlers as risky when they are run in an isolated process

Author: sebastianbergmann

ChangeLog-11.0.md

@@ -4,9 +4,13 @@ All notable changes of the PHPUnit 11.0 release series are documented in this fi
 
 ## [11.0.3] - 2024-MM-DD
 
+### Changed
+
+* Tests that do not unregister their error handlers or exception handlers are no longer considered risky when they are run in an isolated process
+
 ### Fixed
 
-* When a test (or the code called from it) does not remove its own error handlers and its own exception handlers then only the latter was reported
+* When a test (or the code called from it) does not unregister its own error handlers and its own exception handlers then only the latter was reported
 * Resource usage information is printed when the `--debug` CLI option is used
 
 ## [11.0.2] - 2024-04-04

src/Framework/TestCase.php

@@ -1836,7 +1836,9 @@ private function restoreGlobalErrorExceptionHandlers(): void
 
         if ($activeErrorHandlers !== $this->backupGlobalErrorHandlers) {
             if (count($activeErrorHandlers) > count($this->backupGlobalErrorHandlers)) {
-                $message = 'Test code or tested code did not remove its own error handlers';
+                if (!$this->inIsolation) {
+                    $message = 'Test code or tested code did not remove its own error handlers';
+                }
             } else {
                 $message = 'Test code or tested code removed error handlers other than its own';
             }
@@ -1863,7 +1865,9 @@ private function restoreGlobalErrorExceptionHandlers(): void
 
         if ($activeExceptionHandlers !== $this->backupGlobalExceptionHandlers) {
             if (count($activeExceptionHandlers) > count($this->backupGlobalExceptionHandlers)) {
-                $message = 'Test code or tested code did not remove its own exception handlers';
+                if (!$this->inIsolation) {
+                    $message = 'Test code or tested code did not remove its own exception handlers';
+                }
             } else {
                 $message = 'Test code or tested code removed exception handlers other than its own';
             }

tests/end-to-end/regression/5592-process-isolation.phpt

@@ -0,0 +1,55 @@
+--TEST--
+https://github.com/sebastianbergmann/phpunit/pull/5592
+--FILE--
+<?php declare(strict_types=1);
+$_SERVER['argv'][] = '--do-not-cache-result';
+$_SERVER['argv'][] = '--no-configuration';
+$_SERVER['argv'][] = '--process-isolation';
+$_SERVER['argv'][] = __DIR__ . '/5592/Issue5592Test.php';
+
+set_exception_handler(static fn () => null);
+
+require_once __DIR__ . '/../../bootstrap.php';
+(new PHPUnit\TextUI\Application)->run($_SERVER['argv']);
+--EXPECTF--
+PHPUnit %s by Sebastian Bergmann and contributors.
+
+Runtime: %s
+
+.FF.FF                                                              6 / 6 (100%)
+
+Time: %s, Memory: %s
+
+There were 4 failures:
+
+1) PHPUnit\TestFixture\Issue5592Test::testAddedErrorHandler
+Failed asserting that false is true.
+
+%sIssue5592Test.php:%i
+
+2) PHPUnit\TestFixture\Issue5592Test::testRemovedErrorHandler
+Failed asserting that false is true.
+
+%sIssue5592Test.php:%i
+
+3) PHPUnit\TestFixture\Issue5592Test::testAddedExceptionHandler
+Failed asserting that false is true.
+
+%sIssue5592Test.php:%i
+
+4) PHPUnit\TestFixture\Issue5592Test::testRemovedExceptionHandler
+Failed asserting that false is true.
+
+%sIssue5592Test.php:%i
+
+--
+
+There was 1 risky test:
+
+1) PHPUnit\TestFixture\Issue5592Test::testRemovedErrorHandler
+Test code or tested code removed error handlers other than its own
+
+%sIssue5592Test.php:%i
+
+FAILURES!
+Tests: 6, Assertions: 6, Failures: 4, Risky: 1.