Allow modification of entry assembly and probing after startup hooks are run

[steveisok]

In certain custom hosting scenarios, it is desirable to prime the runtime by running a dummy application with a startup hook and then give the host the ability to change the application being run by altering its entry assembly and probing paths.

The way the custom host can achieve this is by:

• Update the HOST_RUNTIME_CONTRACT to contain the entry assembly, TPA list, and paths for native and satellite assembly probing.
• Propose a new managed API to support changing the entry assembly
• Add functions to https://github.com/dotnet/runtime/blob/main/src/native/corehost/hostpolicy/hostpolicy_context.cpp so the host can provide the runtime with this new info.
• Expand https://github.com/dotnet/runtime/blob/main/src/coreclr/vm/hostinformation.cpp so the runtime can more easily get at the new info
• Update the runtime to use this new info instead of directly reading from properties.
• Add a check if the entry assembly changed and re-query the entry assembly and lookup paths after the startup hooks are run.

Rules of note

• We should start with only allowing System.Private.CoreLib to be loaded because once it's loaded, we cannot replace it
• The exception to the rule is the entry assembly.
• If the thread apartment state changes, the main thread needs updated. See Streamline Windows Forms application configuration and bootstrap designs#223 (comment)
• It is the responsibility of the custom host to check if the new runtime config is compatible via hostfxr_initialize_for_runtime_config
  • Success_HostAlreadyInitialized: compatible
  • Success_DifferentRuntimeProperties: technically compatible, but may impact runtime behavior. Not advised to use
  • CoreHostIncompatibleConfig: incompatible

Considerations

• For inspiration of the HOST_RUNTIME_CONTRACT structure, mono has an equivalent-ish implementation.

[dotnet-policy-service]

Tagging subscribers to this area: @vitek-karas, @agocke, @VSadov
See info in area-owners.md if you want to be subscribed.

[jkotas]

Add env variable or runtime config setting to identify this mode

I do not think this bundle of features should be a special runtime mode, we should break it down into general purpose individual features that can be used independently. Also, we should prefer exposing new features via managed APIs as much as possible.

Enable replacing entry assembly and lookup paths after startup hooks are run.

We should add a managed API to allow setting the entry assembly. It comes up every once in a while.

.NET Framework allowed overriding the entry assembly via AppDomainManager.EntryAssembly. And we have undocumented test hook to reset the entry assembly. (Yes, people can shoot themselves into foot by using this API - but it is their problem.)

We should start with only allowing System.Private.CoreLib to be loaded because once it's loaded, we cannot replace it

It should be fine to load all assemblies that are tightly coupled with CoreLib too (e.g. System.Runtime.dll).

thread apartment state needs to match and if it does not, then it's an error.

It does not need to be an error. You can reset the apartment state of the main thread: dotnet/designs#223 (comment)

[steveisok]

I do not think this bundle of features should be a special runtime mode, we should break it down into general purpose individual features that can be used independently. Also, we should prefer exposing new features via managed APIs as much as possible.

OK, then maybe we check if the entry assembly has changed and if so, have the runtime query the contract again after the startup hooks are run. That's what I meant by having some env variable to opt into the re-query.

[jkotas]

if so, have the runtime query the contract again after the startup hooks are run

I do not think that this would work well. The list of app dependencies needs to be updated before the new entry assembly is loaded. Otherwise, there can be situations where the assembly fails to load due to missing dependencies.

[steveisok]

I do not think that this would work well. The list of app dependencies needs to be updated before the new entry assembly is loaded. Otherwise, there can be situations where the assembly fails to load due to missing dependencies.

Unless I'm missing something, I think it's a compound operation. You have to change not only the entry assembly, but specify new deps and other probing paths before this has a chance to work.

[jkotas]

My understanding that the scenario we are going after is:

1. Start the runtime with only a small set of dependencies. We may need something new for this, I am not sure.
2. Execute startup hook. Startup hook receives the path to the actual app to execute via some RPC channel.
3. Resolve the dependencies of the actuall app to execute. It should be possible via System.Runtime.Loader.AssemblyDependencyResolver today.
4. Append additional assemblies to the list of app dependencies. Appending to the list of app dependencies is possible today by handling AssemblyLoadContext.Default.Resolving event (e.g. for do it for COM hosting here ) and updating the properties in AppContext.
5. Load and set the actual entry assembly. We need a new API for that.
6. Execute entrypoint of the actual entry assembly

Does this sound right?

[elinor-fung]

4. Append additional assemblies to the list of app dependencies. Appending to the list of app dependencies is possible today by handling AssemblyLoadContext.Default.Resolving event (e.g. for do it for COM hosting here ) and updating the properties in AppContext.

My understanding is that a key part of the scenario is that the app dependencies takes precedence over what would be in the default probing for the default ALC, as overriding framework assemblies can be a common use case for the actual app to execute. cc @davidwrighton