System.Net tests failing with System.TimeoutException

[jkotas]

For example:

• Test: System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClientHandler_ConnectionPooling_Test.Http2_SmallConnectionTimeout_SubsequentRequestUsesDifferentConnection

      System.TimeoutException : The operation has timed out.
      Stack Trace:
        /_/src/libraries/Common/tests/System/Net/Http/Http2LoopbackServer.cs(196,0): at System.Net.Test.Common.Http2LoopbackServerFactory.CreateServerAsync(Func`3 funcAsync, Int32 millisecondsTimeout)
        /_/src/libraries/System.Net.Http/tests/FunctionalTests/SocketsHttpHandlerTest.cs(1441,0): at System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClientHandler_ConnectionPooling_Test.Http2_SmallConnectionTimeout_SubsequentRequestUsesDifferentConnection(String timeoutPropertyName)
        --- End of stack trace from previous location ---

Tagging subscribers to this area: @dotnet/ncl
See info in area-owners.md if you want to be subscribed.

Issue Details

---

For example:

      System.TimeoutException : The operation has timed out.
      Stack Trace:
        /_/src/libraries/Common/tests/System/Net/Http/Http2LoopbackServer.cs(196,0): at System.Net.Test.Common.Http2LoopbackServerFactory.CreateServerAsync(Func`3 funcAsync, Int32 millisecondsTimeout)
        /_/src/libraries/System.Net.Http/tests/FunctionalTests/SocketsHttpHandlerTest.cs(1441,0): at System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClientHandler_ConnectionPooling_Test.Http2_SmallConnectionTimeout_SubsequentRequestUsesDifferentConnection(String timeoutPropertyName)
        --- End of stack trace from previous location ---

Author:	jkotas
Assignees:	-
Labels:	area-System.Net.Http, untriaged
Milestone:	-

[jkotas]

Failed in #54656

Examples:

• Test: System.Net.Http.Functional.Tests.SyncHttpHandler_HttpProtocolTests_Dribble.GetAsync_ResponseHasNormalLineEndings_Success

      System.TimeoutException : The operation has timed out.
      Stack Trace:
        /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs(49,0): at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks, Int32 millisecondsTimeout)
        /_/src/libraries/Common/tests/System/Net/Http/HttpProtocolTests.cs(377,0): at System.Net.Http.Functional.Tests.HttpProtocolTests.<>c__DisplayClass19_0.<<GetAsync_ResponseHasNormalLineEndings_Success>b__0>d.MoveNext()
        --- End of stack trace from previous location ---
        /_/src/libraries/Common/tests/System/Net/Http/LoopbackServer.cs(101,0): at System.Net.Test.Common.LoopbackServer.CreateServerAsync(Func`2 funcAsync, Options options)
        /_/src/libraries/Common/tests/System/Net/Http/HttpProtocolTests.cs(369,0): at System.Net.Http.Functional.Tests.HttpProtocolTests.GetAsync_ResponseHasNormalLineEndings_Success(String lineEnding)
        --- End of stack trace from previous location ---
    System.Net.Http.Functional.Tests.SocketsHttpHandler_Http

• Test: System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_Cookies_Http3_Mock.GetAsync_Redirect_CookiesArePreserved

    System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_Cookies_Http3_Mock.GetAsync_Redirect_CookiesArePreserved [FAIL]
      System.TimeoutException : The operation has timed out.
      Stack Trace:
        /_/src/libraries/Common/tests/System/Net/Http/HttpClientHandlerTest.Cookies.cs(479,0): at System.Net.Http.Functional.Tests.HttpClientHandlerTest_Cookies.GetAsync_Redirect_CookiesArePreserved()
        --- End of stack trace from previous location ---

[jkotas]

Failed in #54774

Examples:

• Test: System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_Cookies_Http3_Mock.GetAsyncWithRedirect_SetCookieContainer_CorrectCookiesSent

      System.TimeoutException : The operation has timed out.
      Stack Trace:
        /_/src/libraries/Common/tests/System/Net/Http/HttpClientHandlerTest.Cookies.cs(303,0): at System.Net.Http.Functional.Tests.HttpClientHandlerTest_Cookies.GetAsyncWithRedirect_SetCookieContainer_CorrectCookiesSent()
        --- End of stack trace from previous location ---

• Test: System.Net.Http.Functional.Tests.SyncHttpHandlerTest_HttpClientHandlerTest_Headers.SendAsync_RequestWithSimpleHeader_ResponseReferencesUnmodifiedRequestHeaders

System.Net.Http.Functional.Tests.SyncHttpHandlerTest_HttpClientHandlerTest_Headers.SendAsync_RequestWithSimpleHeader_ResponseReferencesUnmodifiedRequestHeaders [FAIL]
      System.TimeoutException : The operation has timed out.
      Stack Trace:
        /_/src/libraries/System.Net.Http/tests/FunctionalTests/HttpClientHandlerTest.Headers.cs(30,0): at System.Net.Http.Functional.Tests.HttpClientHandlerTest_Headers.SendAsync_RequestWithSimpleHeader_ResponseReferencesUnmodifiedRequestHeaders()
        --- End of stack trace from previous location ---

[karelz]

Failures 4/28-6/27 (incl. PRs):

• 6/8:
  • (Http2) GetAsync_Redirect_CookiesArePreserved - 5 failures in PR rework SocketsHttpHandler request queue handling for HTTP/1.1 and HTTP/2 #53851 - 2 Windows, 3 Linux
  • (Http2) GetAsyncWithRedirect_SetCookieContainer_CorrectCookiesSent - 1 failure in PR rework SocketsHttpHandler request queue handling for HTTP/1.1 and HTTP/2 #53851 - Windows
• 6/18:
  • Http2_SmallConnectionTimeout_SubsequentRequestUsesDifferentConnection - 2 failures in PR Add ActivitySource support to DiagnosticsHandler #54437 - all Linux
  • GetAsync_ResponseHasNormalLineEndings_Success - 1 failure in PR Add ActivitySource support to DiagnosticsHandler #54437 - Linux
  • SendAsync_RequestWithSimpleHeader_ResponseReferencesUnmodifiedRequestHeaders - 2 failures in PRs - Windows and Linux
• 6/23:
  • Http2_SmallConnectionTimeout_SubsequentRequestUsesDifferentConnection - 8 failures in PRs - some Windows (7 failures in PR rework SocketsHttpHandler request queue handling for HTTP/1.1 and HTTP/2 #53851)
  • SendAsync_RequestWithSimpleHeader_ResponseReferencesUnmodifiedRequestHeaders - 1 failure in PR Add ActivitySource support to DiagnosticsHandler #54437 - Linux
• 6/24:
  • Http2_SmallConnectionTimeout_SubsequentRequestUsesDifferentConnection - 2 failures in PRs - all Linux
  • GetAsync_ResponseHasNormalLineEndings_Success - 1 failure PR Add ActivitySource support to DiagnosticsHandler #54437 - Linux
  • SocketsHttpHandlerTest_Cookies_Http3_Mock.GetAsyncWithRedirect_SetCookieContainer_CorrectCookiesSent - 1 failure in PR HTTP3: Fix an issue with GOAWAY handling and enable cookie tests #54700 - Linux
  • SendAsync_RequestWithSimpleHeader_ResponseReferencesUnmodifiedRequestHeaders - 1 failure in PR Enable win registry install location for all architectures #54698 - Linux
• 6/25:
  • Http2_SmallConnectionTimeout_SubsequentRequestUsesDifferentConnection - 29 failures in PRs - all Linux
  • GetAsync_ResponseHasNormalLineEndings_Success - 15 failures in PRs - all Linux
  • SocketsHttpHandlerTest_Cookies_Http3_Mock.GetAsyncWithRedirect_SetCookieContainer_CorrectCookiesSent - 1 failure in PR HTTP3: Re-enable cookie and cancellation tests #54727 - Windows
  • SendAsync_RequestWithSimpleHeader_ResponseReferencesUnmodifiedRequestHeaders - 19 failures in PRs - all Linux
• 6/26:
  • Http2_SmallConnectionTimeout_SubsequentRequestUsesDifferentConnection - 12 failures in PRs - all Linux
  • GetAsync_ResponseHasNormalLineEndings_Success - 4 failures in PRs - all Linux
  • SocketsHttpHandlerTest_Cookies_Http3_Mock.GetAsync_Redirect_CookiesArePreserved - 14 failures (8 in Official runs, 6 in PRs) - 2x Windows, 2x OSX, 10x Linux
  • SocketsHttpHandlerTest_Cookies_Http3_Mock.GetAsyncWithRedirect_SetCookieContainer_CorrectCookiesSent - 7 failures (2 in Official runs, 5 in PRs) - 2x Windows, 5x Linux
  • SendAsync_RequestWithSimpleHeader_ResponseReferencesUnmodifiedRequestHeaders - 8 failures in PRs - all Linux
• 6/27:
  • Http2_SmallConnectionTimeout_SubsequentRequestUsesDifferentConnection - 4 failures in PRs - all Linux
  • GetAsync_ResponseHasNormalLineEndings_Success - 4 failures in PRs - all Linux
  • SocketsHttpHandlerTest_Cookies_Http3_Mock.GetAsync_Redirect_CookiesArePreserved - 5 failures on Official runs - 1 OSX, 4 Linux
  • SocketsHttpHandlerTest_Cookies_Http3_Mock.GetAsyncWithRedirect_SetCookieContainer_CorrectCookiesSent - 3 failures in PRs - 1x Windows, 2x Linux
  • SendAsync_RequestWithSimpleHeader_ResponseReferencesUnmodifiedRequestHeaders - 5 failures in PRs - all Linux
• 6/28:
  • Http2_SmallConnectionTimeout_SubsequentRequestUsesDifferentConnection - 7 failures in PRs - all Linux
  • SocketsHttpHandlerTest_Cookies_Http3_Mock.GetAsync_Redirect_CookiesArePreserved - 2 failures (1 Official run, 1 PR) - all Linux
  • SocketsHttpHandlerTest_Cookies_Http3_Mock.GetAsyncWithRedirect_SetCookieContainer_CorrectCookiesSent - 2 failures (1 Official run, 1 PR) - all Linux
  • SendAsync_RequestWithSimpleHeader_ResponseReferencesUnmodifiedRequestHeaders - 3 failures in PRs - all Linux

[karelz]

Looks like a regression around 6/18-6/23 ... @dotnet/ncl any idea what might have caused the regression?

[karelz]

@geoffkizer 2 of the tests are HTTP/3 Mock cookies tests -- is it perhaps caused by your PR #54727?

[geoffkizer]

Yes, these tests were disabled until that PR.

Looks like these are still flaky, and apparently much flakier on Linux than Windows for whatever reason.

We should disable these again. I'll put up a PR.