Skip to content

Conversation

@TanayParikh
Copy link
Contributor

MacOS jobs have had a significant increase in failure rates due to timing out when attempting to retrieve from blob storage. This PR increases the timeout value.

##[error]src/Framework/App.Runtime/src/Microsoft.AspNetCore.App.Runtime.csproj(458,5): error : (NETCORE_ENGINEERING_TELEMETRY=Build) Problems downloading file from 'https://dotnetbuilds.blob.core.windows.net/public/Runtime/7.0.0-alpha.1.21609.9/dotnet-runtime-7.0.0-alpha.1.21609.9-osx-x64.tar.gz'. The request was canceled due to the configured HttpClient.Timeout of 300 seconds elapsing. at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) 
 at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) 
 at RepoTasks.DownloadFile.DownloadWithRetriesAsync(String source, String target, List`1 errorMessages) in /_/eng/tools/RepoTasks/DownloadFile.cs:line 109 
/Users/runner/work/1/s/src/Framework/App.Runtime/src/Microsoft.AspNetCore.App.Runtime.csproj(458,5): error : Problems downloading file from 'https://dotnetbuilds.blob.core.windows.net/public/Runtime/7.0.0-alpha.1.21609.9/dotnet-runtime-7.0.0-alpha.1.21609.9-osx-x64.tar.gz'. The request was canceled due to the configured HttpClient.Timeout of 300 seconds elapsing. at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) 
/Users/runner/work/1/s/src/Framework/App.Runtime/src/Microsoft.AspNetCore.App.Runtime.csproj(458,5): error : at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) 
/Users/runner/work/1/s/src/Framework/App.Runtime/src/Microsoft.AspNetCore.App.Runtime.csproj(458,5): error : at RepoTasks.DownloadFile.DownloadWithRetriesAsync(String source, String target, List`1 errorMessages) in /_/eng/tools/RepoTasks/DownloadFile.cs:line 109 

Example Pipeline: https://dev.azure.com/dnceng/public/_build/results?buildId=1507432&view=logs&jobId=9895f7d8-b062-540b-461c-07f8695bfcc6&j=9895f7d8-b062-540b-461c-07f8695bfcc6&t=a6c33838-4cf4-594d-88cb-801ae7f8db2f

I contacted first responders, there doesn't seem to be a known network/blob storage issue which would cause this.

@TanayParikh TanayParikh requested a review from a team as a code owner December 13, 2021 20:13
@ghost ghost added the area-infrastructure Includes: MSBuild projects/targets, build scripts, CI, Installers and shared framework label Dec 13, 2021
@TanayParikh TanayParikh enabled auto-merge (squash) December 13, 2021 20:19
@TanayParikh TanayParikh merged commit 0114538 into main Dec 13, 2021
@TanayParikh TanayParikh deleted the TanayParikh-patch-1 branch December 13, 2021 21:51
@ghost ghost added this to the 7.0-preview1 milestone Dec 13, 2021
@TanayParikh
Copy link
Contributor Author

/backport to release/6.0

@github-actions
Copy link
Contributor

Started backporting to release/6.0: https://github.com/dotnet/aspnetcore/actions/runs/1580522418

@TanayParikh
Copy link
Contributor Author

/backport to release/5.0

@TanayParikh
Copy link
Contributor Author

/backport to release/3.1

@github-actions
Copy link
Contributor

Started backporting to release/5.0: https://github.com/dotnet/aspnetcore/actions/runs/1580523692

@TanayParikh
Copy link
Contributor Author

/backport to release/2.1

@github-actions
Copy link
Contributor

Started backporting to release/3.1: https://github.com/dotnet/aspnetcore/actions/runs/1580524289

@github-actions
Copy link
Contributor

Started backporting to release/2.1: https://github.com/dotnet/aspnetcore/actions/runs/1580524544

@github-actions
Copy link
Contributor

@TanayParikh backporting to release/3.1 failed, the patch most likely resulted in conflicts:

$ git am --3way --ignore-whitespace --keep-non-patch changes.patch

Applying: Bump up download file timeout
Using index info to reconstruct a base tree...
M	eng/tools/RepoTasks/DownloadFile.cs
Falling back to patching base and 3-way merge...
Auto-merging eng/tools/RepoTasks/DownloadFile.cs
CONFLICT (content): Merge conflict in eng/tools/RepoTasks/DownloadFile.cs
error: Failed to merge in the changes.
hint: Use 'git am --show-current-patch=diff' to see the failed patch
Patch failed at 0001 Bump up download file timeout
When you have resolved this problem, run "git am --continue".
If you prefer to skip this patch, run "git am --skip" instead.
To restore the original branch and stop patching, run "git am --abort".
Error: The process '/usr/bin/git' failed with exit code 128

Please backport manually!

@github-actions
Copy link
Contributor

@TanayParikh backporting to release/2.1 failed, the patch most likely resulted in conflicts:

$ git am --3way --ignore-whitespace --keep-non-patch changes.patch

Applying: Bump up download file timeout
Using index info to reconstruct a base tree...
A	eng/tools/RepoTasks/DownloadFile.cs
Falling back to patching base and 3-way merge...
CONFLICT (modify/delete): eng/tools/RepoTasks/DownloadFile.cs deleted in HEAD and modified in Bump up download file timeout. Version Bump up download file timeout of eng/tools/RepoTasks/DownloadFile.cs left in tree.
error: Failed to merge in the changes.
hint: Use 'git am --show-current-patch=diff' to see the failed patch
Patch failed at 0001 Bump up download file timeout
When you have resolved this problem, run "git am --continue".
If you prefer to skip this patch, run "git am --skip" instead.
To restore the original branch and stop patching, run "git am --abort".
Error: The process '/usr/bin/git' failed with exit code 128

Please backport manually!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area-infrastructure Includes: MSBuild projects/targets, build scripts, CI, Installers and shared framework

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants