Benchmarks for #121102 (EgorBo)

[EgorBot]

Processing dotnet/runtime#121102 (comment) command:

Command

-windows_intel -intel -arm

using BenchmarkDotNet.Attributes;
using BenchmarkDotNet.Running;

public class Benchmarks
{
    static void Main(string[] args)
    {
        BenchmarkSwitcher.FromAssembly(typeof(Benchmarks).Assembly).Run(args);
    }

    public static IEnumerable<object> TestData()
    {
        yield return new object[] { @"C:\a", @"C:\a\b" };
        yield return new object[] { @"C:\a\", @"C:\a\b\c" };
        yield return new object[] {
            @"C:\projects\runtime\src\libraries",
            @"C:\projects\runtime\src\libraries\System.Text.Json\tests"
        };
        yield return new object[] {
            @"C:\a\b\c\d\e\f\g\h\i\j\k\l\m\n\o\p",
            @"C:\a\b\c\d\e\f\g\h\i\j\k\l\m\n\o\p\q\r\s\t\u\v\w\x\y\z"
        };
        yield return new object[] {
            @"C:\projects\runtime-main2\src\libraries\Microsoft.Extensions.DependencyInjection.Specification.Tests\src\Fakes",
            @"C:\projects\runtime-main2\src\libraries\Microsoft.Extensions.DependencyInjection.Specification.Tests\src\"
        };
        yield return new object[] { @"C:\foo\bar", @"D:\foo\bar" };
        yield return new object[] { @"C:\foo\bar\baz", @"C:\foo\bar\..\qux\." };
        yield return new object[] { @"\\server\share\folder1", @"\\server\share\folder1\folder2\folder3" };
        yield return new object[] {
            @"C:\Program Files\MyApp",
            @"C:\Program Files\MyApp\bin\Debug\net8.0"
        };
    }

    [Benchmark]
    [ArgumentsSource(nameof(TestData))]
    public string GetFoo(string relativeTo, string path) => 
        Path.GetRelativePath(relativeTo, path);
}

(EgorBot will reply in this issue)

[EgorBot]

Benchmark results on linux_azure_cobalt100

BenchmarkDotNet v0.15.0, Linux Ubuntu 24.04.3 LTS (Noble Numbat)
Neoverse-N2, 16 physical cores
  Job-QOATJN : .NET 10.0.0 (42.42.42.42424), Arm64 RyuJIT AdvSIMD
  Job-VVWKBD : .NET 10.0.0 (42.42.42.42424), Arm64 RyuJIT AdvSIMD

Method	Toolchain	relativeTo	path	Mean	Error	Ratio
GetFoo	Main	\\ser(...)lder1 [22]	\\ser(...)lder3 [38]	1.501 μs	0.0029 μs	1.00
GetFoo	PR	\\ser(...)lder1 [22]	\\ser(...)lder3 [38]	1.512 μs	0.0030 μs	1.01
GetFoo	Main	C:\a	C:\a\b	1.365 μs	0.0018 μs	1.00
GetFoo	PR	C:\a	C:\a\b	1.387 μs	0.0018 μs	1.02
GetFoo	Main	C:\a\	C:\a\b\c	1.370 μs	0.0031 μs	1.00
GetFoo	PR	C:\a\	C:\a\b\c	1.392 μs	0.0020 μs	1.02
GetFoo	Main	C:\a\(...)n\o\p [34]	C:\a\(...)x\y\z [54]	1.572 μs	0.0021 μs	1.00
GetFoo	PR	C:\a\(...)n\o\p [34]	C:\a\(...)x\y\z [54]	1.599 μs	0.0027 μs	1.02
GetFoo	Main	C:\foo\bar	D:\foo\bar	1.389 μs	0.0019 μs	1.00
GetFoo	PR	C:\foo\bar	D:\foo\bar	1.392 μs	0.0019 μs	1.00
GetFoo	Main	C:\foo\bar\baz	C:\foo\bar\..\qux\.	1.428 μs	0.0019 μs	1.00
GetFoo	PR	C:\foo\bar\baz	C:\foo\bar\..\qux\.	1.433 μs	0.0018 μs	1.00
GetFoo	Main	C:\Pr(...)MyApp [22]	C:\Pr(...)et8.0 [39]	1.498 μs	0.0015 μs	1.00
GetFoo	PR	C:\Pr(...)MyApp [22]	C:\Pr(...)et8.0 [39]	1.510 μs	0.0017 μs	1.01
GetFoo	Main	C:\p(...)akes [110]	C:\p(...)src\ [105]	1.936 μs	0.0032 μs	1.00
GetFoo	PR	C:\p(...)akes [110]	C:\p(...)src\ [105]	1.995 μs	0.0078 μs	1.03
GetFoo	Main	C:\pr(...)aries [33]	C:\pr(...)tests [56]	1.574 μs	0.0024 μs	1.00
GetFoo	PR	C:\pr(...)aries [33]	C:\pr(...)tests [56]	1.599 μs	0.0014 μs	1.02

Artifacts.zip

cc @EgorBo (agent_logs.txt). EgorBot manual: link.

[EgorBot]

Benchmark results on linux_azure_cascadelake

BenchmarkDotNet v0.15.0, Linux Ubuntu 24.04.3 LTS (Noble Numbat)
Intel Xeon Platinum 8370C CPU 2.80GHz, 1 CPU, 16 logical and 8 physical cores
  Job-JOUSRX : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
  Job-XIQLUD : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI

Method	Toolchain	relativeTo	path	Mean	Error	Ratio
GetFoo	Main	\\ser(...)lder1 [22]	\\ser(...)lder3 [38]	1.769 μs	0.0040 μs	1.00
GetFoo	PR	\\ser(...)lder1 [22]	\\ser(...)lder3 [38]	1.681 μs	0.0011 μs	0.95
GetFoo	Main	C:\a	C:\a\b	1.573 μs	0.0027 μs	1.00
GetFoo	PR	C:\a	C:\a\b	1.550 μs	0.0021 μs	0.99
GetFoo	Main	C:\a\	C:\a\b\c	1.621 μs	0.0048 μs	1.00
GetFoo	PR	C:\a\	C:\a\b\c	1.542 μs	0.0029 μs	0.95
GetFoo	Main	C:\a\(...)n\o\p [34]	C:\a\(...)x\y\z [54]	1.911 μs	0.0024 μs	1.00
GetFoo	PR	C:\a\(...)n\o\p [34]	C:\a\(...)x\y\z [54]	1.782 μs	0.0034 μs	0.93
GetFoo	Main	C:\foo\bar	D:\foo\bar	1.605 μs	0.0086 μs	1.00
GetFoo	PR	C:\foo\bar	D:\foo\bar	1.533 μs	0.0030 μs	0.95
GetFoo	Main	C:\foo\bar\baz	C:\foo\bar\..\qux\.	1.655 μs	0.0043 μs	1.00
GetFoo	PR	C:\foo\bar\baz	C:\foo\bar\..\qux\.	1.596 μs	0.0026 μs	0.96
GetFoo	Main	C:\Pr(...)MyApp [22]	C:\Pr(...)et8.0 [39]	1.750 μs	0.0041 μs	1.00
GetFoo	PR	C:\Pr(...)MyApp [22]	C:\Pr(...)et8.0 [39]	1.711 μs	0.0025 μs	0.98
GetFoo	Main	C:\p(...)akes [110]	C:\p(...)src\ [105]	2.455 μs	0.0084 μs	1.00
GetFoo	PR	C:\p(...)akes [110]	C:\p(...)src\ [105]	2.295 μs	0.0029 μs	0.93
GetFoo	Main	C:\pr(...)aries [33]	C:\pr(...)tests [56]	1.906 μs	0.0019 μs	1.00
GetFoo	PR	C:\pr(...)aries [33]	C:\pr(...)tests [56]	1.767 μs	0.0049 μs	0.93

Artifacts.zip

cc @EgorBo (agent_logs.txt). EgorBot manual: link.

[EgorBot]

Benchmark results on windows_azure_cascadelake

BenchmarkDotNet v0.15.4, Windows 11 (10.0.26100.2314/24H2/2024Update/HudsonValley) (Hyper-V)
Intel Xeon Platinum 8370C CPU 2.80GHz (Max: 2.79GHz), 1 CPU, 16 logical and 8 physical cores
  Job-VROSIH : .NET 10.0.0 (10.0.0-dev, 42.42.42.42424), X64 RyuJIT x86-64-v4
  Job-LHTYKG : .NET 10.0.0 (10.0.0-dev, 42.42.42.42424), X64 RyuJIT x86-64-v4

Method	Toolchain	relativeTo	path	Mean	Error	Ratio
GetFoo	Main.exe	\\ser(...)lder1 [22]	\\ser(...)lder3 [38]	348.7 ns	0.65 ns	1.00
GetFoo	PR.exe	\\ser(...)lder1 [22]	\\ser(...)lder3 [38]	341.4 ns	0.58 ns	0.98
GetFoo	Main.exe	C:\a	C:\a\b	185.8 ns	0.51 ns	1.00
GetFoo	PR.exe	C:\a	C:\a\b	186.5 ns	0.26 ns	1.00
GetFoo	Main.exe	C:\a\	C:\a\b\c	196.4 ns	0.16 ns	1.00
GetFoo	PR.exe	C:\a\	C:\a\b\c	197.5 ns	0.20 ns	1.01
GetFoo	Main.exe	C:\a\(...)n\o\p [34]	C:\a\(...)x\y\z [54]	413.8 ns	1.02 ns	1.00
GetFoo	PR.exe	C:\a\(...)n\o\p [34]	C:\a\(...)x\y\z [54]	420.7 ns	0.47 ns	1.02
GetFoo	Main.exe	C:\foo\bar	D:\foo\bar	167.2 ns	0.28 ns	1.00
GetFoo	PR.exe	C:\foo\bar	D:\foo\bar	167.8 ns	0.32 ns	1.00
GetFoo	Main.exe	C:\foo\bar\baz	C:\foo\bar\..\qux\.	270.3 ns	0.36 ns	1.00
GetFoo	PR.exe	C:\foo\bar\baz	C:\foo\bar\..\qux\.	273.8 ns	0.37 ns	1.01
GetFoo	Main.exe	C:\Pr(...)MyApp [22]	C:\Pr(...)et8.0 [39]	323.1 ns	0.19 ns	1.00
GetFoo	PR.exe	C:\Pr(...)MyApp [22]	C:\Pr(...)et8.0 [39]	321.1 ns	0.42 ns	0.99
GetFoo	Main.exe	C:\p(...)akes [110]	C:\p(...)src\ [105]	628.3 ns	0.64 ns	1.00
GetFoo	PR.exe	C:\p(...)akes [110]	C:\p(...)src\ [105]	662.9 ns	9.25 ns	1.06
GetFoo	Main.exe	C:\pr(...)aries [33]	C:\pr(...)tests [56]	370.1 ns	0.77 ns	1.00
GetFoo	PR.exe	C:\pr(...)aries [33]	C:\pr(...)tests [56]	378.3 ns	0.27 ns	1.02

Artifacts.zip

cc @EgorBo (agent_logs.txt). EgorBot manual: link.