Closed
Description
Run Information
Architecture | x64 |
---|---|
OS | ubuntu 18.04 |
Baseline | 5108757b997c59ab8ba1fc5309ab0d4e730e2b77 |
Compare | f4b715f1cfadcbf85486f369724528c051be5733 |
Diff | Diff |
Improvements in System.Text.Json.Tests.Perf_Strings
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
WriteStringsUtf16 - Duration of single invocation | 50.84 ms | 48.20 ms | 0.95 | 0.01 | False | |||||
WriteStringsUtf16 - Duration of single invocation | 51.25 ms | 47.75 ms | 0.93 | 0.01 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Strings*'
Related Issues
Regressions
- [Perf] Alpine/x64: 12 Regressions on 10/25/2022 12:27:43 PM
- [Perf] Windows/x64: 6 Regressions on 10/25/2022 12:27:43 PM
- [Perf] Linux/x64: 8 Regressions on 10/25/2022 12:27:43 PM
Improvements
Payloads
Histogram
Edge Detector Info
System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: True, Escaped: AllEscaped)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 48.200128660714284 < 48.67420657083334.
IsChangePoint: Marked as a change because one of 9/20/2022 8:04:40 PM, 9/21/2022 8:46:36 AM, 10/25/2022 8:17:52 AM, 11/1/2022 2:33:16 AM falls between 10/23/2022 1:14:54 PM and 11/1/2022 2:33:16 AM.
IsImprovementStdDev: Marked as improvement because 26.427241626746053 (T) = (0 -47886030.57272493) / Math.Sqrt((1005579789598.8131 / (299)) + (347634044117.41376 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.06176024649835246 = (51038159.9095618 - 47886030.57272493) / 51038159.9095618 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: False, Escaped: AllEscaped)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 47.75195273333333 < 48.492198030208336.
IsChangePoint: Marked as a change because one of 10/25/2022 8:17:52 AM, 11/1/2022 2:33:16 AM falls between 10/23/2022 1:14:54 PM and 11/1/2022 2:33:16 AM.
IsImprovementStdDev: Marked as improvement because 23.845480695258487 (T) = (0 -47648549.32896204) / Math.Sqrt((225044607134.53577 / (299)) + (656205821977.9751 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.06800521397711053 = (51125338.94346466 - 47648549.32896204) / 51125338.94346466 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository