Skip to content

[main] Update dependencies from dotnet/runtime #24195

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 21 commits into from
Mar 9, 2022

Conversation

dotnet-maestro[bot]
Copy link
Contributor

@dotnet-maestro dotnet-maestro bot commented Mar 3, 2022

This pull request updates the following dependencies

From https://github.com/dotnet/runtime

  • Subscription: aa69f164-2492-460a-3914-08d8e9750bf8
  • Build: 20220308.2
  • Date Produced: March 8, 2022 5:36:53 PM UTC
  • Commit: 8342a08b8bf0ff2ffb64cd5992e2d60c8d6d63c1
  • Branch: refs/heads/main

…0302.5

Microsoft.NETCore.App.Runtime.win-x64 , Microsoft.NETCore.Platforms , Microsoft.NETCore.DotNetHostResolver , System.Reflection.MetadataLoadContext , System.Resources.Extensions , System.Text.Encoding.CodePages , System.Security.Cryptography.ProtectedData , System.CodeDom , Microsoft.NET.HostModel , Microsoft.Extensions.DependencyModel , Microsoft.NETCore.App.Host.win-x64 , Microsoft.NETCore.App.Ref , VS.Redist.Common.NetCore.TargetingPack.x64.7.0 , VS.Redist.Common.NetCore.SharedFramework.x64.7.0
 From Version 7.0.0-preview.3.22151.6 -> To Version 7.0.0-preview.3.22152.5
@ghost ghost added the Area-CodeFlow label Mar 3, 2022
@dotnet-maestro
Copy link
Contributor Author

dotnet-maestro bot commented Mar 3, 2022

Notification for subscribed users from https://github.com/dotnet/runtime:

@dnr-codeflow

Action requested: Please take a look at this failing automated dependency-flow pull request's checks; failures may be related to changes which originated in your repo.

  • This pull request contains changes from your source repo (https://github.com/dotnet/runtime) and seems to have failed checks in this PR. Please take a peek at the failures and comment if they seem relevant to your changes.
  • If you're being tagged in this comment it is due to an entry in the related Maestro Subscription of the Build Asset Registry. If you feel this entry has added your GitHub login or your GitHub team in error, please update the subscription to reflect this.
  • For more details, please read the Arcade Darc documentation

@pranavkm
Copy link
Contributor

pranavkm commented Mar 3, 2022

CSC(0,0): error CS8032: (NETCORE_ENGINEERING_TELEMETRY=Build) An instance of analyzer System.Text.RegularExpressions.Generator.RegexGenerator cannot be created from /Users/runner/work/1/s/.packages/microsoft.netcore.app.ref/7.0.0-preview.3.22152.5/analyzers/dotnet/cs/System.Text.RegularExpressions.Generator.dll : Could not load file or assembly 'Microsoft.CodeAnalysis, Version=4.2.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35'. The system cannot find the file specified.

FYI @jkoritzinsky

@jkoritzinsky
Copy link
Member

We just updated the version of Roslyn that we build the source generators that will ship in .NET 7 build against. We did this to pick up new Roslyn APIs and bug fixes. Can the SDK update which Roslyn toolset it builds against?

@danmoseley
Copy link
Member

Perhaps that is happening in #24188?

@jkoritzinsky
Copy link
Member

That PR looks like it's actually downgrading Roslyn for some odd reason...

@pranavkm
Copy link
Contributor

pranavkm commented Mar 4, 2022

FYI @jaredpar because of the fun discussion from today.

@v-wuzhai
Copy link
Member

v-wuzhai commented Mar 4, 2022

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

…0304.1

Microsoft.NETCore.App.Runtime.win-x64 , Microsoft.NETCore.Platforms , Microsoft.NETCore.DotNetHostResolver , System.Reflection.MetadataLoadContext , System.Text.Encoding.CodePages , System.Security.Cryptography.ProtectedData , System.Resources.Extensions , System.CodeDom , Microsoft.NET.HostModel , Microsoft.Extensions.DependencyModel , Microsoft.NETCore.App.Host.win-x64 , Microsoft.NETCore.App.Ref , VS.Redist.Common.NetCore.TargetingPack.x64.7.0 , VS.Redist.Common.NetCore.SharedFramework.x64.7.0
 From Version 7.0.0-preview.3.22151.6 -> To Version 7.0.0-preview.3.22154.1
@marcpopMSFT
Copy link
Member

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@danmoseley
Copy link
Member

❌[Log] CSC(0,0): error CS8032: An instance of analyzer System.Text.RegularExpressions.Generator.RegexGenerator cannot be created from D:\a_work\1\s.packages\microsoft.netcore.app.ref\7.0.0-preview.3.22154.1\analyzers\dotnet\cs\System.Text.RegularExpressions.Generator.dll : Could not load file or assembly 'Microsoft.CodeAnalysis, Version=4.2.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35'. The system cannot find the file specified..

dotnet-maestro bot added 2 commits March 5, 2022 13:19
…0304.8

Microsoft.NETCore.App.Runtime.win-x64 , Microsoft.NETCore.Platforms , Microsoft.NETCore.DotNetHostResolver , System.Reflection.MetadataLoadContext , System.Text.Encoding.CodePages , System.Security.Cryptography.ProtectedData , System.Resources.Extensions , System.CodeDom , Microsoft.NET.HostModel , Microsoft.Extensions.DependencyModel , Microsoft.NETCore.App.Host.win-x64 , Microsoft.NETCore.App.Ref , VS.Redist.Common.NetCore.TargetingPack.x64.7.0 , VS.Redist.Common.NetCore.SharedFramework.x64.7.0
 From Version 7.0.0-preview.3.22151.6 -> To Version 7.0.0-preview.3.22154.8
…0305.4

Microsoft.NETCore.App.Runtime.win-x64 , Microsoft.NETCore.Platforms , Microsoft.NETCore.DotNetHostResolver , System.Reflection.MetadataLoadContext , System.Text.Encoding.CodePages , System.Security.Cryptography.ProtectedData , System.Resources.Extensions , System.CodeDom , Microsoft.NET.HostModel , Microsoft.Extensions.DependencyModel , Microsoft.NETCore.App.Host.win-x64 , Microsoft.NETCore.App.Ref , VS.Redist.Common.NetCore.TargetingPack.x64.7.0 , VS.Redist.Common.NetCore.SharedFramework.x64.7.0
 From Version 7.0.0-preview.3.22151.6 -> To Version 7.0.0-preview.3.22155.4
@danmoseley
Copy link
Member

@dotnet/domestic-cat @stephentoub could you throw any light on this error above? What might have changed here?

@jkoritzinsky
Copy link
Member

My comment above has the explanation: #24195 (comment)

…0307.1

Microsoft.NETCore.App.Runtime.win-x64 , Microsoft.NETCore.Platforms , Microsoft.NETCore.DotNetHostResolver , System.Reflection.MetadataLoadContext , System.Text.Encoding.CodePages , System.Security.Cryptography.ProtectedData , System.Resources.Extensions , System.CodeDom , Microsoft.NET.HostModel , Microsoft.Extensions.DependencyModel , Microsoft.NETCore.App.Host.win-x64 , Microsoft.NETCore.App.Ref , VS.Redist.Common.NetCore.TargetingPack.x64.7.0 , VS.Redist.Common.NetCore.SharedFramework.x64.7.0
 From Version 7.0.0-preview.3.22151.6 -> To Version 7.0.0-preview.3.22157.1
@danmoseley
Copy link
Member

Ah I see. The last one updated up to 3 days ago. I guess another should go up soon (?)

@jeffschwMSFT
Copy link
Member

I am taking over helping @danmoseley with this issue. @jaredpar, @jkoritzinsky @pranavkm what is the latest status? Who has the next action? Thanks

@jkoritzinsky
Copy link
Member

If dotnet/sdk can update the version of Roslyn they reference when building (so the Microsoft.Net.Compilers.Toolset package version) to at least 4.2.0-2.22128.1, then this PR should become green. I know the sdk repo is more intimately affected by the "stage 0" sdk version, so although I think just updating the version of that package that is referenced should work totally fine, I don't know 100% for sure.

@jeffschwMSFT
Copy link
Member

Thanks @jkoritzinsky. @dotnet/domestic-cat is there someone able to help investigate updating the version of Roslyn?

@jkoritzinsky do we know what about this payload that is leading to this situation? Is it a faster path to revert that work until we resolve these downstream impacts? (Asking especially if this impact is likely to happen in more repos).

@jaredpar
Copy link
Member

jaredpar commented Mar 7, 2022

do we know what about this payload that is leading to this situation?

Yes. Roughly what is happening here is that all of our source generators depend on the latest Roslyn API. The Roslyn API is just another NuPkg, that dependency moves forward like any other dependency. This PR is pulling down an SDK from the 6.0.300 flavor, based on the version in the error, which means the generators in it depend on the 4.2.0.0 version of the Roslyn API. The SDK though has pinned the actual compiler used to build which means it did not roll forward to 6.0.300 versions and it has a version of 4.1.0.0 or earlier. Hence when the generators attempt to run in the compiler there is a version mismatch.

This is a danger of pinning compiler toolsets. It's a component that essentially has plugin support. If you move the plugins forward but keep the host backwards eventually you hit a version mismatch.

@marcpopMSFT
Copy link
Member

@jaredpar, the SDK being pulled down is actually 5 months old at 7.0.100-alpha.1.21478.48. Is updating to the preview 1 SDK sufficient or will we need something even newer?

@jaredpar
Copy link
Member

jaredpar commented Mar 7, 2022

Could not load file or assembly 'Microsoft.CodeAnalysis, Version=4.2.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35'. The system cannot find the file specified..

That is the error in the thread and that is a 6.0.300 compiler version. Something is trying to load it during build.

marcpopMSFT and others added 3 commits March 7, 2022 12:48
…0308.1

Microsoft.NETCore.App.Runtime.win-x64 , Microsoft.NETCore.Platforms , Microsoft.NETCore.DotNetHostResolver , System.Reflection.MetadataLoadContext , System.Text.Encoding.CodePages , System.Security.Cryptography.ProtectedData , System.Resources.Extensions , System.CodeDom , Microsoft.NET.HostModel , Microsoft.Extensions.DependencyModel , Microsoft.NETCore.App.Host.win-x64 , Microsoft.NETCore.App.Ref , VS.Redist.Common.NetCore.TargetingPack.x64.7.0 , VS.Redist.Common.NetCore.SharedFramework.x64.7.0
 From Version 7.0.0-preview.3.22151.6 -> To Version 7.0.0-preview.3.22158.1
@wtgodbe
Copy link
Member

wtgodbe commented Mar 8, 2022

Test failures seem more ordinary now, e.g.

Microsoft.NET.Build.Tests.ReferenceExeTests.ExeProjectCanReferenceTestProject(testTemplateName: \"mstest\")

StdErr:
Project C:\h\w\BC3209FC\t\dotnetSdkTests\clnzv4vx.33x\ExeProjectCan---317DC12F\TestProject\TestProject.csproj cannot be added due to incompatible targeted frameworks between the two projects. Review the project you are trying to add and verify that is compatible with the following targets: net6.0

And:

Microsoft.NET.Build.Tests.WorkloadTests.Given_multi_target_It_should_get_suggested_workload_by_GetRequiredWorkloads_target(mainTfm: \"net6.0\", referencingTfm: \"net6.0\", expected: \"macos\")

Expected collection {"wasm-tools"} to contain "macos".

@dsplaisted @marcpopMSFT who knows about these tests?

@danmoseley
Copy link
Member

possibly @lewing knows about that.

@jeffschwMSFT
Copy link
Member

Test failures seem more ordinary now, e.g.

Microsoft.NET.Build.Tests.ReferenceExeTests.ExeProjectCanReferenceTestProject(testTemplateName: "mstest")

StdErr:
Project C:\h\w\BC3209FC\t\dotnetSdkTests\clnzv4vx.33x\ExeProjectCan---317DC12F\TestProject\TestProject.csproj cannot be > added due to incompatible targeted frameworks between the two projects. Review the project you are trying to add and verify that is compatible with the following targets: net6.0

@marcpopMSFT can you help take a look?

Microsoft.NET.Build.Tests.WorkloadTests.Given_multi_target_It_should_get_suggested_workload_by_GetRequiredWorkloads_target(mainTfm: "net6.0", referencingTfm: "net6.0", expected: "macos")

Expected collection {"wasm-tools"} to contain "macos".

@marek-safar and @lewing can you help take a look?

@joeloff
Copy link
Member

joeloff commented Mar 9, 2022

@marcpopMSFT I wonder if this is the known workloads.txt file that's missing again when the stage0 and stage2 SDKs are merged to run tests.

marek-safar and others added 2 commits March 9, 2022 10:28
…0308.2

Microsoft.NETCore.App.Runtime.win-x64 , Microsoft.NETCore.Platforms , Microsoft.NETCore.DotNetHostResolver , System.Reflection.MetadataLoadContext , System.Text.Encoding.CodePages , System.Security.Cryptography.ProtectedData , System.Resources.Extensions , System.CodeDom , Microsoft.NET.HostModel , Microsoft.Extensions.DependencyModel , Microsoft.NETCore.App.Host.win-x64 , Microsoft.NETCore.App.Ref , VS.Redist.Common.NetCore.TargetingPack.x64.7.0 , VS.Redist.Common.NetCore.SharedFramework.x64.7.0
 From Version 7.0.0-preview.3.22151.6 -> To Version 7.0.0-preview.3.22158.2
@marcpopMSFT
Copy link
Member

@joeloff @wtgodbe That second issue is definitely because of the workloads text file. That's the same behavior we saw when trying to update to 6.0.101 with an empty file. We either need to disable the tests for now or fix the stage0/stage2 merge. I'd probably default to disabling since 7.0 doesn't support maui at the moment so overall workload support is minimal.

@marcpopMSFT
Copy link
Member

@wtgodbe for ExeProjectCanReferenceTestProject, we should try updating the target framework value in the test to net7.0.

@marcpopMSFT
Copy link
Member

@javiercn , can you investigate the failure in Publish60Hosted_Works? Looks like it's expecting an rc2 runtime but we updated to the 6.0.0 version.

"_framework/dotnet.6.0.0-rc.2.21452.2.[[hash]].js.gz" with a length of 51, but
"_framework/dotnet.6.0.2.[[hash]].js.gz" has a length of 38.

@wtgodbe
Copy link
Member

wtgodbe commented Mar 9, 2022

Still seeing a source-build issue:

/__w/1/s/artifacts/source-build/self/package-cache/microsoft.net.compilers.toolset/4.2.0-2.22158.15/tasks/net6.0/Microsoft.CSharp.Core.targets(75,5): error : CompilerServer: fatal error - server reports different hash version than build task - 92730825-cec3-4fc9-a08f-b5b1a2d893c2 [/__w/1/s/artifacts/source-build/self/src/src/Cli/Microsoft.DotNet.InternalAbstractions/Microsoft.DotNet.InternalAbstractions.csproj]

@dagood @MichaelSimons I see dotnet/source-build#1473, is this related? Is there a known fix?

@javiercn
Copy link
Member

javiercn commented Mar 9, 2022

@marcpopMSFT looking at it.

@dagood
Copy link
Member

dagood commented Mar 9, 2022

/__w/1/s/artifacts/source-build/self/package-cache/microsoft.net.compilers.toolset/4.2.0-2.22158.15/tasks/net6.0/Microsoft.CSharp.Core.targets(75,5): error : CompilerServer: fatal error - server reports different hash version than build task - 92730825-cec3-4fc9-a08f-b5b1a2d893c2 [/__w/1/s/artifacts/source-build/self/src/src/Cli/Microsoft.DotNet.InternalAbstractions/Microsoft.DotNet.InternalAbstractions.csproj]

I see dotnet/source-build#1473, is this related? Is there a known fix?

Should be able to disable shared compilation (compiler server) to stop the machine from finding two versions of the compiler with different hashes: dotnet/source-build#1527. @dotnet/source-build-internal

@wtgodbe
Copy link
Member

wtgodbe commented Mar 9, 2022

Looks like the SDK enables it by default:

<PropertyGroup Condition="'$(UseSharedCompilation)' == ''">
<UseSharedCompilation>true</UseSharedCompilation>
</PropertyGroup>
. Seems like disabling that would be a pretty big change - @dsplaisted @marcpopMSFT is that the direction we want to go?

@jkoritzinsky
Copy link
Member

That file is included in the produced SDK and is not imported by MSBuild during the build of this repo. I think the property setter should be added in eng/SourceBuild.props as part of the InnerBuildArgs https://github.com/dotnet/sdk/blob/main/eng/SourceBuild.props

@TanayParikh TanayParikh merged commit b69e8f5 into main Mar 9, 2022
@TanayParikh TanayParikh deleted the darc-main-4e4c3a83-79d4-4dbf-a084-18667262c049 branch March 9, 2022 23:47
@jeffschwMSFT
Copy link
Member

:) thank you everyone for helping to get this merged!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.