[Perf] Linux/arm64: 3 Improvements on 10/25/2022 10:16:52 PM

[performanceautofiler]

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	afdd009ff95ea3da2e5b34f09f4a00c548f9be33
Compare	a8ea8e67dc20689aa2e4c738a2f84ea3483ec872
Diff	Diff

Improvements in System.Text.Json.Document.Tests.Perf_EnumerateObject

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
PropertyIndexer - Duration of single invocation	3.85 μs	3.64 μs	0.94	0.00	False

Test Report

Repro

git clone /~https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Document.Tests.Perf_EnumerateObject*'

Related Issues

Regressions

• [Perf] Linux/arm64: 8 Regressions on 10/25/2022 10:16:52 PM
• [Perf] Windows/arm64: 11 Regressions on 10/25/2022 10:16:52 PM
• [Perf] Windows/arm64: 1 Regression on 10/25/2022 10:16:52 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: ObjectProperties)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.637019988738738 < 3.652433998859739.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/30/2022 12:52:21 AM, 9/7/2022 11:31:53 PM, 10/25/2022 5:34:05 PM, 10/27/2022 12:34:03 AM falls between 10/18/2022 9:26:37 AM and 10/27/2022 12:34:03 AM.
IsImprovementStdDev: Marked as improvement because 48.77510728651714 (T) = (0 -3632.2153030014188) / Math.Sqrt((636.4927484760143 / (299)) + (78.73851142312965 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.05372595013577477 = (3838.439090158482 - 3632.2153030014188) / 3838.439090158482 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	afdd009ff95ea3da2e5b34f09f4a00c548f9be33
Compare	a8ea8e67dc20689aa2e4c738a2f84ea3483ec872
Diff	Diff

Improvements in System.Buffers.Text.Tests.Utf8ParserTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
TryParseDouble - Duration of single invocation	94.10 ns	88.86 ns	0.94	0.01	False

Test Report

Repro

git clone /~https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Text.Tests.Utf8ParserTests*'

Related Issues

Regressions

• [Perf] Linux/arm64: 8 Regressions on 10/25/2022 10:16:52 PM
• [Perf] Windows/arm64: 11 Regressions on 10/25/2022 10:16:52 PM
• [Perf] Windows/arm64: 1 Regression on 10/25/2022 10:16:52 PM

Improvements

• [Perf] Windows/arm64: 4 Improvements on 10/25/2022 10:16:52 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Buffers.Text.Tests.Utf8ParserTests.TryParseDouble(value: -1.7976931348623157e+308)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 88.86321059099735 < 89.5942127806259.
IsChangePoint: Marked as a change because one of 7/27/2022 9:27:06 AM, 8/16/2022 3:23:21 AM, 8/17/2022 3:53:31 PM, 10/25/2022 5:34:05 PM, 10/27/2022 12:34:03 AM falls between 10/18/2022 9:26:37 AM and 10/27/2022 12:34:03 AM.
IsImprovementStdDev: Marked as improvement because 47.0906304989152 (T) = (0 -89.12402065574003) / Math.Sqrt((2.6267109147973264 / (299)) + (0.044532858320599694 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.0656637913104657 = (95.38752734493947 - 89.12402065574003) / 95.38752734493947 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	afdd009ff95ea3da2e5b34f09f4a00c548f9be33
Compare	a8ea8e67dc20689aa2e4c738a2f84ea3483ec872
Diff	Diff

Improvements in System.MathBenchmarks.Single

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Min - Duration of single invocation	4.60 μs	3.35 μs	0.73	0.01	False

Test Report

Repro

git clone /~https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.MathBenchmarks.Single*'

Related Issues

Regressions

• [Perf] Linux/arm64: 8 Regressions on 10/25/2022 10:16:52 PM
• [Perf] Windows/arm64: 11 Regressions on 10/25/2022 10:16:52 PM
• [Perf] Windows/arm64: 1 Regression on 10/25/2022 10:16:52 PM

Improvements

• [Perf] Windows/arm64: 4 Improvements on 10/25/2022 10:16:52 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.MathBenchmarks.Single.Min

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.3465374763359055 < 4.372863511672756.
IsChangePoint: Marked as a change because one of 7/28/2022 12:19:57 AM, 10/7/2022 4:12:34 PM, 10/25/2022 5:34:05 PM, 10/27/2022 12:34:03 AM falls between 10/18/2022 9:26:37 AM and 10/27/2022 12:34:03 AM.
IsImprovementStdDev: Marked as improvement because 7.442055493592797 (T) = (0 -3346.676440131848) / Math.Sqrt((211676.32426170603 / (299)) + (0.9406460732434512 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.05586885216276926 = (3544.715633837788 - 3346.676440131848) / 3544.715633837788 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository