0.5% customers will fail to Start my App when run as Windows Service

[mingtong]

Is there an existing issue for this?

• I have searched the existing issues

Describe the bug

OS: 10.0.19044.0, 10.0.19043.0, 10.0.22000.0
.net: 6.0.4 (self container)
For short, my App have around 3m live users per day, now about 15k users per day report error log with the folloing.

System.InvalidOperationException: Stopped without starting
at Microsoft.Extensions.Hosting.Internal.Host.StartAsync(CancellationToken cancellationToken)

My starting code is like

            IHost host = CreateHostBuilder(argsWithoutConsole, hostIP, hostPort).Build();
            await host.StartAsync().ConfigureAwait(false);

        private static IHostBuilder CreateHostBuilder(string[] args, string hostIP, int hostPort)
        {
            var ipAddress = hostIP;
            int availablePort = hostPort;

            var builder = Host.CreateDefaultBuilder(args);

            if (!ServiceUtil.IsRunningAsAdministrator())
            {
                logger.Debug("Is Running As service");
                builder.UseWindowsService();
            }
            builder.ConfigureHostOptions(config =>
                       {
                           //config.ShutdownTimeout = TimeSpan.FromSeconds(5);
                       })
                       .UseServiceProviderFactory<ContainerBuilder>(new AutofacServiceProviderFactory())
                       .ConfigureWebHost(webBuilder =>
                       {
                           webBuilder
                               .UseStartup<ServiceConfig>()
                               .UseKestrel((hostingContext, options) =>
                               {
                                   options.Listen(IPAddress.Parse(ipAddress), availablePort);
                               });
                       });

            return builder;
        }

what will be the probable reason for this?
Since the exception is just kind of easy, so I cant find useful information of the "Stopped without starting".

Expected Behavior

No response

Steps To Reproduce

It happened to customers only, so there is no clear steps to reproduce, that is also why I am posting here.

Exceptions (if any)

System.InvalidOperationException: Stopped without starting
at Microsoft.Extensions.Hosting.Internal.Host.StartAsync(CancellationToken cancellationToken)

.NET Version

6.0.4

Anything else?

No response

[Tratcher]

It sounds like the service host was created but not started. I don't know why that would happen.

runtime/src/libraries/Microsoft.Extensions.Hosting.WindowsServices/src/WindowsServiceLifetime.cs

Lines 88 to 89 in bd7e1cb

	Run(this); // This blocks until the service is stopped.
	_delayStart.TrySetException(new InvalidOperationException("Stopped without starting"));

runtime/src/libraries/Microsoft.Extensions.Hosting.WindowsServices/src/WindowsServiceLifetime.cs

Lines 105 to 110 in bd7e1cb

	// Called by base.Run when the service is ready to start.
	/// <inheritdoc />
	protected override void OnStart(string[] args)
	{
	_delayStart.TrySetResult(null);
	base.OnStart(args);

Moving this issue to Runtime.

I couldn't figure out the best area label to add to this issue. If you have write-permissions please help me learn by adding exactly one area label.

Tagging subscribers to this area: @dotnet/area-system-serviceprocess
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Is there an existing issue for this?

• I have searched the existing issues

Describe the bug

OS: 10.0.19044.0, 10.0.19043.0, 10.0.22000.0
.net: 6.0.4 (self container)
For short, my App have around 3m live users per day, now about 15k users per day report error log with the folloing.

System.InvalidOperationException: Stopped without starting
at Microsoft.Extensions.Hosting.Internal.Host.StartAsync(CancellationToken cancellationToken)

My starting code is like

            IHost host = CreateHostBuilder(argsWithoutConsole, hostIP, hostPort).Build();
            await host.StartAsync().ConfigureAwait(false);

        private static IHostBuilder CreateHostBuilder(string[] args, string hostIP, int hostPort)
        {
            var ipAddress = hostIP;
            int availablePort = hostPort;

            var builder = Host.CreateDefaultBuilder(args);

            if (!ServiceUtil.IsRunningAsAdministrator())
            {
                logger.Debug("Is Running As service");
                builder.UseWindowsService();
            }
            builder.ConfigureHostOptions(config =>
                       {
                           //config.ShutdownTimeout = TimeSpan.FromSeconds(5);
                       })
                       .UseServiceProviderFactory<ContainerBuilder>(new AutofacServiceProviderFactory())
                       .ConfigureWebHost(webBuilder =>
                       {
                           webBuilder
                               .UseStartup<ServiceConfig>()
                               .UseKestrel((hostingContext, options) =>
                               {
                                   options.Listen(IPAddress.Parse(ipAddress), availablePort);
                               });
                       });

            return builder;
        }

what will be the probable reason for this?
Since the exception is just kind of easy, so I cant find useful information of the "Stopped without starting".

Expected Behavior

No response

Steps To Reproduce

It happened to customers only, so there is no clear steps to reproduce, that is also why I am posting here.

Exceptions (if any)

System.InvalidOperationException: Stopped without starting
at Microsoft.Extensions.Hosting.Internal.Host.StartAsync(CancellationToken cancellationToken)

.NET Version

6.0.4

Anything else?

No response

Author:	mingtong
Assignees:	-
Labels:	area-System.ServiceProcess, untriaged, area-Extensions-Hosting
Milestone:	-

[teo-tsirpanis]

(FYI issues get only one area)

[hez2010]

Is it possible that the service is blocked by an Antivirus software?

[mingtong]

Is it possible that the service is blocked by an Antivirus software?

Only Microsoft can answer this.

[Clockwork-Muse]

Is it possible that the service is blocked by an Antivirus software?

Only Microsoft can answer this.

... there are multiple other AV vendors. You'd have to engage with your failing customers to find out their AV vendor, and have them check their logs to see if the application is being blocked.
Although I would expect it wouldn't even be allowed to try to start/be quarantined in such a case, so wouldn't be getting this far.

It's maybe more likely that the Windows firewall is blocking it - I would imagine Kestrel crashes if it can't get the port. If that's the case, the firewall should have logs for it. You should be able to get a log message in such a case, though...

[mingtong]

I guess it's not about the port, cause I use 0, means random port.
The promblem is we have no effective way to contact end users, you know there is a long process though Developer-->USER.

[Clockwork-Muse]

I guess it's not about the port, cause I use 0, means random port.

Random or specific port isn't relevant - if the firewall/AV decides you shouldn't get a port, your process is just not going to get any port.

[mingtong]

I guess it's not about the port, cause I use 0, means random port.

Random or specific port isn't relevant - if the firewall/AV decides you shouldn't get a port, your process is just not going to get any port.

So you mean firewall is blocking my App, then in what case my requested port will be blocked?
1, App has signtuare.
2, Both service and client are on same PC, means IP = 127.0.0.1