File upload failed even after retry

[jeffschwMSFT]

Build

https://dev.azure.com/dnceng/internal/_build/results?buildId=2365835

Error:

Fail to upload '/mnt/vss/_work/1/a/IntermediateArtifacts/MonoRuntimePacks/Shipping/Microsoft.NETCore.App.Ref.9.0.0-preview.2.24080.4.symbols.nupkg' due to 'Bad Request'.
Microsoft.VisualStudio.Services.WebApi.VssServiceResponseException: Bad Request
   at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.HandleResponseAsync(HttpResponseMessage response, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.SendAsync(HttpRequestMessage message, HttpCompletionOption completionOption, Object userState, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.FileContainer.Client.FileContainerHttpClient.UploadFileAsync(Int64 containerId, String itemPath, Stream fileStream, Byte[] contentId, Int64 fileLength, Boolean isGzipped, Guid scopeIdentifier, CancellationToken cancellationToken, Int32 chunkSize, Int32 chunkRetryTimes, Boolean uploadFirstChunk, Object userState)
   at Microsoft.VisualStudio.Services.FileContainer.Client.FileContainerHttpClient.UploadFileAsync(Int64 containerId, String itemPath, Stream fileStream, Guid scopeIdentifier, CancellationToken cancellationToken, Int32 chunkSize, Boolean uploadFirstChunk, Object userState, Boolean compressStream)
   at Microsoft.VisualStudio.Services.Agent.Worker.Build.FileContainerServer.UploadAsync(IAsyncCommandContext context, Int32 uploaderId, CancellationToken token) in /home/vsts/work/1/s/src/Agent.Worker/Build/FileContainerServer.cs:line 250
Detail upload trace for file that fail to upload: IntermediateArtifacts/MonoRuntimePacks/Shipping/Microsoft.NETCore.App.Ref.9.0.0-preview.2.24080.4.symbols.nupkg

Chunk '2' attempt '1' of file 'IntermediateArtifacts/MonoRuntimePacks/Shipping/Microsoft.NETCore.App.Ref.9.0.0-preview.2.24080.4.symbols.nupkg' fail to send request to server. Error: Microsoft.VisualStudio.Services.Common.VssServiceException: TF203009: The size of the file that you uploaded does not match the size that the client computer provided.
   at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.HandleResponseAsync(HttpResponseMessage response, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.SendAsync(HttpRequestMessage message, HttpCompletionOption completionOption, Object userState, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.FileContainer.Client.FileContainerHttpClient.UploadFileAsync(Int64 containerId, String itemPath, Stream fileStream, Byte[] contentId, Int64 fileLength, Boolean isGzipped, Guid scopeIdentifier, CancellationToken cancellationToken, Int32 chunkSize, Int32 chunkRetryTimes, Boolean uploadFirstChunk, Object userState).

##[error]File upload failed even after retry.

Build leg reported

No response

Pull Request

No response

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "##[error]File upload failed even after retry",
    "BuildRetry": false,
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Report

Build	Definition	Step Name	Console log	Pull Request
1026579	dotnet/arcade	Unix Build / Publish	Log
2693386	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2693174	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2693091	dotnet-runtime	Publish Test Assets	Log	#49383
1022819	dotnet/arcade	Unix Build / Publish	Log	dotnet/arcade#15766
1022618	dotnet/arcade	Unix Build / Publish	Log	dotnet/arcade#15765
1022435	dotnet/arcade	Unix Build / Publish	Log	dotnet/arcade#15763
1022018	dotnet/xharness	Build and run tests	Log	dotnet/xharness#1345
2689990	dotnet-runtime	Publish Logs	Log	#49311
1019891	dotnet/arcade	Unix Build / Publish	Log	dotnet/arcade#15727
2689847	dotnet-runtime	Publish Logs	Log	#49308
2687939	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2687938	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2687420	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2687421	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2687383	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2687195	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2687101	dotnet-runtime	🔒 Publish intermediate artifacts	Log
1015072	dotnet/xharness	Build and run tests	Log	dotnet/xharness#1398
2685759	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2685310	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2684278	dotnet-winforms	Pack, Sign, and Publish	Log
1011053	dotnet/runtime	Publish Build Assets	Log	dotnet/runtime#114448
2678698	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2678678	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2678677	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2678676	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2677724	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2676947	dotnet-runtime	🔒 Publish intermediate artifacts	Log
999857	dotnet/xharness	Build and run tests	Log
2675552	dotnet-runtime	🔒 Publish intermediate artifacts	Log
998803	dotnet/xharness	Build and run tests	Log	dotnet/xharness#1387

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	7	32

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng/internal/_build/results?buildId=2365835
Error message validated: [##[error]File upload failed even after retry]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 2/7/2024 2:03:27 AM UTC

[lewing]

This is often an from multiple lanes attempting to upload the same artifact

[markwilkie]

@lewing is right - there's usually not a whole lot dnceng can do to help.