Closed
Description
Run Information
Name | Value |
---|---|
Architecture | x64 |
OS | Windows 10.0.18362 |
Queue | TigerWindows |
Baseline | af874399a0de79c9364f3f0e8cebbd0c60e16dfa |
Compare | 957ab2f239fa1c425079cdb9eeb483380241dedb |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
135.08 μs | 149.55 μs | 1.11 | 0.07 | False | ||||
65.10 μs | 69.86 μs | 1.07 | 0.04 | False | ||||
2.25 ms | 2.48 ms | 1.11 | 0.04 | False | ||||
33.34 ms | 36.04 ms | 1.08 | 0.12 | False | ||||
2.15 ms | 2.31 ms | 1.07 | 0.08 | False | ||||
15.07 ms | 18.20 ms | 1.21 | 0.01 | True | ||||
891.52 μs | 947.71 μs | 1.06 | 0.05 | False | ||||
10.48 ms | 13.83 ms | 1.32 | 0.11 | False | ||||
161.55 μs | 171.27 μs | 1.06 | 0.02 | False | ||||
1.22 ms | 1.37 ms | 1.12 | 0.03 | False | ||||
119.02 μs | 130.73 μs | 1.10 | 0.04 | False | ||||
60.55 μs | 68.16 μs | 1.13 | 0.05 | False | ||||
771.94 μs | 867.45 μs | 1.12 | 0.15 | False | ||||
4.72 ms | 5.66 ms | 1.20 | 0.11 | False | ||||
304.37 μs | 336.30 μs | 1.10 | 0.02 | False | ||||
13.65 ms | 15.99 ms | 1.17 | 0.03 | True | ||||
25.28 ms | 30.01 ms | 1.19 | 0.02 | True | ||||
206.77 μs | 224.74 μs | 1.09 | 0.03 | False | ||||
1.31 ms | 1.67 ms | 1.28 | 0.02 | True | ||||
214.99 μs | 233.57 μs | 1.09 | 0.01 | False | ||||
181.70 μs | 202.02 μs | 1.11 | 0.02 | False | ||||
10.46 ms | 12.18 ms | 1.16 | 0.14 | False | ||||
332.07 μs | 368.11 μs | 1.11 | 0.03 | True |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'
Payloads
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock|Holmes", Options: NonBacktracking)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "[a-q][^u-z]{13}x", Options: NonBacktracking)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock|Holmes|Watson|Irene|Adler|John|Baker", Options: None)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\p{L}", Options: NonBacktracking)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\p{Lu}", Options: NonBacktracking)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\s[a-zA-Z]{0,12}ing\s", Options: None)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)the", Options: NonBacktracking)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\w+\s+Holmes", Options: None)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sher[a-z]+|Hol[a-z]+", Options: NonBacktracking)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "the\s+\w+", Options: NonBacktracking)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: NonBacktracking)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "[a-q][^u-z]{13}x", Options: None)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "the", Options: NonBacktracking)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sher[a-z]+|Hol[a-z]+", Options: None)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock|Holmes|Watson", Options: None)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "[a-zA-Z]+ing", Options: None)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock|Holmes|Watson|Irene|Adler|John|Baker", Options: None)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock|Holmes", Options: None)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?s).*", Options: None)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sher[a-z]+|Hol[a-z]+", Options: None)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock|Holmes|Watson", Options: NonBacktracking)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\w+\s+Holmes\s+\w+", Options: None)
ETL Files
Histogram
JIT Disasms
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes.{0,25}Watson|Watson.{0,25}Holmes", Options: None)
ETL Files
Histogram
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Name | Value |
---|---|
Architecture | x64 |
OS | Windows 10.0.18362 |
Queue | TigerWindows |
Baseline | af874399a0de79c9364f3f0e8cebbd0c60e16dfa |
Compare | 957ab2f239fa1c425079cdb9eeb483380241dedb |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Regressions in System.Numerics.Tests.Perf_BigInteger
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
3.91 ns | 6.03 ns | 1.54 | 0.04 | True | ||||
4.52 ns | 6.48 ns | 1.43 | 0.04 | False | ||||
10.90 ns | 14.18 ns | 1.30 | 0.06 | True | ||||
3.90 ns | 6.07 ns | 1.56 | 0.04 | True | ||||
4.22 ns | 6.94 ns | 1.64 | 0.09 | False | ||||
7.05 ns | 9.19 ns | 1.30 | 0.01 | True | ||||
7.33 ns | 8.51 ns | 1.16 | 0.05 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_BigInteger*'
Payloads
System.Numerics.Tests.Perf_BigInteger.Equals(arguments: 259 bytes, DiffFirstByte)
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_BigInteger.Equals(arguments: 67 bytes, DiffMiddleByte)
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_BigInteger.Ctor_ByteArray(numberString: -2147483648)
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_BigInteger.Equals(arguments: 67 bytes, DiffFirstByte)
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_BigInteger.Equals(arguments: 67 bytes, Same)
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_BigInteger.Ctor_ByteArray(numberString: 123)
ETL Files
Histogram
JIT Disasms
System.Numerics.Tests.Perf_BigInteger.Equals(arguments: 259 bytes, DiffMiddleByte)
ETL Files
Histogram
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment