Closed
Description
Run Information
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 18.04 |
Queue | TigerUbuntu |
Baseline | 764f77412ef4ec1a7e5dc521608247487a66cd7e |
Compare | bc23bf4ee16cbd1999105b1916e1f2f76baef6a7 |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Collections.ContainsTrue<String>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
358.01 μs | 270.83 μs | 0.76 | 0.36 | False | ||||
363.66 μs | 299.80 μs | 0.82 | 0.30 | False | ||||
359.64 μs | 297.99 μs | 0.83 | 0.36 | False | ||||
361.47 μs | 329.97 μs | 0.91 | 0.42 | False | ||||
345.06 μs | 296.55 μs | 0.86 | 0.43 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsTrue<String>*'
Payloads
System.Collections.ContainsTrue<String>.Queue(Size: 512)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 270.8288779094827 < 326.90757353946475.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/2/2023 3:18:41 PM, 7/26/2023 12:02:55 AM, 8/3/2023 7:53:20 AM falls between 7/25/2023 7:04:35 PM and 8/3/2023 7:53:20 AM.
IsImprovementStdDev: Marked as improvement because 24.010973275668903 (T) = (0 -277543.05899253563) / Math.Sqrt((241611364.6775331 / (299)) + (213369922.11033118 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.2091330912465909 = (350935.228065122 - 277543.05899253563) / 350935.228065122 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Collections.ContainsTrue<String>.ImmutableArray(Size: 512)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 299.8013205974843 < 330.8658225911265.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/2/2023 3:18:41 PM, 7/26/2023 12:02:55 AM, 8/3/2023 7:53:20 AM falls between 7/25/2023 7:04:35 PM and 8/3/2023 7:53:20 AM.
IsImprovementStdDev: Marked as improvement because 68.65460592922649 (T) = (0 -300187.4769129907) / Math.Sqrt((202927466.05487454 / (299)) + (1591275.8261415744 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.16461350622916587 = (359339.63399142417 - 300187.4769129907) / 359339.63399142417 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Collections.ContainsTrue<String>.List(Size: 512)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 297.98940380727765 < 315.0950215816084.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/1/2023 6:56:14 PM, 7/25/2023 7:04:35 PM, 8/3/2023 7:53:20 AM falls between 7/25/2023 7:04:35 PM and 8/3/2023 7:53:20 AM.
IsImprovementStdDev: Marked as improvement because 27.35357526516063 (T) = (0 -293557.12729078735) / Math.Sqrt((236991245.27249724 / (299)) + (95365035.56860806 / (27))) is greater than 1.9673127716992511 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (27) - 2, .975) and 0.16232097875474036 = (350441.0637554194 - 293557.12729078735) / 350441.0637554194 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Collections.ContainsTrue<String>.Stack(Size: 512)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 329.97433702256944 < 342.67216843563983.
IsChangePoint: Marked as a change because one of 5/25/2023 10:38:38 PM, 7/25/2023 7:04:35 PM, 8/3/2023 7:53:20 AM falls between 7/25/2023 7:04:35 PM and 8/3/2023 7:53:20 AM.
IsImprovementStdDev: Marked as improvement because 14.390205541541391 (T) = (0 -321816.0801382395) / Math.Sqrt((639393853.163297 / (299)) + (146148834.2519185 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.11076307689301178 = (361901.39182909334 - 321816.0801382395) / 361901.39182909334 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Collections.ContainsTrue<String>.ICollection(Size: 512)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 296.5479494496855 < 327.7321921559588.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/2/2023 3:18:41 PM, 7/26/2023 12:02:55 AM, 8/3/2023 7:53:20 AM falls between 7/25/2023 7:04:35 PM and 8/3/2023 7:53:20 AM.
IsImprovementStdDev: Marked as improvement because 27.461341495455773 (T) = (0 -293622.48020728264) / Math.Sqrt((214145565.527984 / (299)) + (71374337.46261697 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.15019561333340956 = (345517.7271548747 - 293622.48020728264) / 345517.7271548747 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 18.04 |
Queue | TigerUbuntu |
Baseline | 764f77412ef4ec1a7e5dc521608247487a66cd7e |
Compare | bc23bf4ee16cbd1999105b1916e1f2f76baef6a7 |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
10.24 μs | 8.39 μs | 0.82 | 0.02 | False | ||||
9.60 μs | 7.68 μs | 0.80 | 0.02 | False | ||||
9.45 μs | 7.51 μs | 0.79 | 0.04 | False | ||||
9.37 μs | 7.51 μs | 0.80 | 0.03 | False | ||||
10.31 μs | 8.48 μs | 0.82 | 0.03 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>*'
Payloads
System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>.SerializeToString(Mode: Reflection)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 8.387667492086317 < 9.743592842948306.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 7/26/2023 12:02:55 AM, 8/3/2023 7:53:20 AM falls between 7/25/2023 7:04:35 PM and 8/3/2023 7:53:20 AM.
IsImprovementStdDev: Marked as improvement because 33.52135642513105 (T) = (0 -8310.101334035873) / Math.Sqrt((1122608.8925413797 / (299)) + (10178.252218297674 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.20649102570242386 = (10472.59905458798 - 8310.101334035873) / 10472.59905458798 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>.SerializeToUtf8Bytes(Mode: Reflection)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 7.682038214688734 < 9.33830379253827.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 7/26/2023 12:02:55 AM, 8/3/2023 7:53:20 AM falls between 7/25/2023 7:04:35 PM and 8/3/2023 7:53:20 AM.
IsImprovementStdDev: Marked as improvement because 30.62777123157574 (T) = (0 -7888.0862881161365) / Math.Sqrt((1220463.3163435087 / (299)) + (14798.35091287066 / (24))) is greater than 1.967381707010986 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (24) - 2, .975) and 0.21020147164002143 = (9987.466429566279 - 7888.0862881161365) / 9987.466429566279 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>.SerializeToStream(Mode: Reflection)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 7.505028945341675 < 9.128676973516232.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 7/26/2023 12:02:55 AM, 8/3/2023 7:53:20 AM falls between 7/25/2023 7:04:35 PM and 8/3/2023 7:53:20 AM.
IsImprovementStdDev: Marked as improvement because 31.270384848937482 (T) = (0 -7778.6712251257695) / Math.Sqrt((1112542.310867881 / (299)) + (14396.65412252977 / (24))) is greater than 1.967381707010986 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (24) - 2, .975) and 0.20901407262551955 = (9834.146166096169 - 7778.6712251257695) / 9834.146166096169 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>.SerializeToWriter(Mode: Reflection)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 7.511441165624499 < 8.915659808889854.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 7/26/2023 12:02:55 AM, 8/3/2023 7:53:20 AM falls between 7/25/2023 7:04:35 PM and 8/3/2023 7:53:20 AM.
IsImprovementStdDev: Marked as improvement because 30.384035009487114 (T) = (0 -7489.4962794775165) / Math.Sqrt((1226192.5118229326 / (299)) + (12739.235948466805 / (24))) is greater than 1.967381707010986 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (24) - 2, .975) and 0.21636250392097692 = (9557.34803011808 - 7489.4962794775165) / 9557.34803011808 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>.SerializeObjectProperty(Mode: Reflection)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 7/26/2023 12:02:55 AM, 8/3/2023 7:53:20 AM falls between 7/25/2023 7:04:35 PM and 8/3/2023 7:53:20 AM.
IsImprovementStdDev: Marked as improvement because 30.738477508014768 (T) = (0 -8442.714851470706) / Math.Sqrt((1714733.3168956446 / (299)) + (9516.060339686524 / (24))) is greater than 1.967381707010986 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (24) - 2, .975) and 0.22184356960124954 = (10849.637067375268 - 8442.714851470706) / 10849.637067375268 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 18.04 |
Queue | TigerUbuntu |
Baseline | 764f77412ef4ec1a7e5dc521608247487a66cd7e |
Compare | bc23bf4ee16cbd1999105b1916e1f2f76baef6a7 |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Improvements in LinqBenchmarks
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
213.06 ms | 158.76 ms | 0.75 | 0.12 | False | ||||
213.90 ms | 154.59 ms | 0.72 | 0.10 | False | ||||
382.74 ms | 299.91 ms | 0.78 | 0.09 | False | ||||
387.24 ms | 300.63 ms | 0.78 | 0.10 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'LinqBenchmarks*'
Payloads
LinqBenchmarks.Where01LinqMethodX
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 7/26/2023 12:02:55 AM, 8/3/2023 7:53:20 AM falls between 7/25/2023 7:04:35 PM and 8/3/2023 7:53:20 AM.
IsImprovementStdDev: Marked as improvement because 60.508499642147484 (T) = (0 -155490414.458) / Math.Sqrt((346798912034273.6 / (299)) + (2237538157127.1704 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.3031203328764283 = (223123764.10664916 - 155490414.458) / 223123764.10664916 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
LinqBenchmarks.Where01LinqQueryX
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 7/26/2023 12:02:55 AM, 8/3/2023 7:53:20 AM falls between 7/25/2023 7:04:35 PM and 8/3/2023 7:53:20 AM.
IsImprovementStdDev: Marked as improvement because 59.905065246428364 (T) = (0 -155369830.4021739) / Math.Sqrt((325000971679405.44 / (299)) + (4437211786146.839 / (23))) is greater than 1.9674049737480528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (23) - 2, .975) and 0.30371627632753195 = (223141551.5254237 - 155369830.4021739) / 223141551.5254237 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
LinqBenchmarks.Where00LinqMethodX
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 7/26/2023 12:02:55 AM, 8/3/2023 7:53:20 AM falls between 7/25/2023 7:04:35 PM and 8/3/2023 7:53:20 AM.
IsImprovementStdDev: Marked as improvement because 38.54588714002906 (T) = (0 -302371778.2374113) / Math.Sqrt((2785818612103319 / (299)) + (25751702420322.76 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.2908105752931528 = (426362503.02576166 - 302371778.2374113) / 426362503.02576166 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
LinqBenchmarks.Where00LinqQueryX
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 7/26/2023 12:02:55 AM, 8/3/2023 7:53:20 AM falls between 7/25/2023 7:04:35 PM and 8/3/2023 7:53:20 AM.
IsImprovementStdDev: Marked as improvement because 39.34372174821219 (T) = (0 -301767944.94014037) / Math.Sqrt((2664306181073825.5 / (299)) + (22376934654723.04 / (24))) is greater than 1.967381707010986 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (24) - 2, .975) and 0.29029807814054454 = (425203787.1751747 - 301767944.94014037) / 425203787.1751747 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository