Skip to content

[benchmark] BucketSort gardening and adjustments #24364

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Apr 29, 2019

Conversation

palimondo
Copy link
Contributor

Increased workload to sorting of 10k items.
Used SplitMix64 PRNG for randomness.
Adjusted formatting and naming to match Swift conventions.
Adjusted documentation.

Increased workload to sorting of 10k items.
Used SplitMix64 PRNG for randomness.
Adjusted formatting and naming to match Swift conventions.
Adjusted documentation.
@palimondo palimondo requested review from atrick and rajbarik April 29, 2019 17:42
@palimondo
Copy link
Contributor Author

@rajbarik, @atrick I took a swing at adjusting the BucketSort benchmark along the comments in #24206. Please review.

@palimondo
Copy link
Contributor Author

@swift-ci please benchmark

@palimondo
Copy link
Contributor Author

@swift-ci please smoke test

@palimondo palimondo changed the title [benchmark] BucketSort gardening [benchmark] BucketSort gardening and adjustments Apr 29, 2019
@swift-ci
Copy link
Contributor

Performance: -O

TEST OLD NEW DELTA RATIO
Improvement
BucketSort 24940 2539 -89.8% 9.82x
ObjectiveCBridgeStubToNSStringRef 80 73 -8.7% 1.10x (?)

Code size: -O

TEST OLD NEW DELTA RATIO
Regression
BucketSort.o 9400 11056 +17.6% 0.85x

Performance: -Osize

TEST OLD NEW DELTA RATIO
Regression
StringBuilderWithLongSubstring 950 1070 +12.6% 0.89x (?)
Improvement
BucketSort 24620 2536 -89.7% 9.71x
SuffixCountableRangeLazy 5 4 -20.0% 1.25x (?)

Code size: -Osize

TEST OLD NEW DELTA RATIO
Regression
BucketSort.o 9402 11162 +18.7% 0.84x

Performance: -Onone

TEST OLD NEW DELTA RATIO
Improvement
BucketSort 40570 8554 -78.9% 4.74x
How to read the data The tables contain differences in performance which are larger than 8% and differences in code size which are larger than 1%.

If you see any unexpected regressions, you should consider fixing the
regressions before you merge the PR.

Noise: Sometimes the performance results (not code size!) contain false
alarms. Unexpected regressions which are marked with '(?)' are probably noise.
If you see regressions which you cannot explain you can try to run the
benchmarks again. If regressions still show up, please consult with the
performance team (@eeckstein).

Hardware Overview
  Model Name: Mac mini
  Model Identifier: Macmini8,1
  Processor Name: Intel Core i7
  Processor Speed: 3.2 GHz
  Number of Processors: 1
  Total Number of Cores: 6
  L2 Cache (per Core): 256 KB
  L3 Cache: 12 MB
  Memory: 64 GB

@palimondo
Copy link
Contributor Author

Note: the reported performance change is caused by the removal of legacyFactor.

Copy link
Contributor

@atrick atrick left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks.

@atrick
Copy link
Contributor

atrick commented Apr 29, 2019

Merging now since this changes legacyFactor to have a stable baseline before @rajbarik enables Existential Specialization.

@atrick atrick merged commit 8103416 into swiftlang:master Apr 29, 2019
@palimondo palimondo deleted the bucketsort-gardening branch April 29, 2019 19:41
@palimondo palimondo restored the bucketsort-gardening branch April 29, 2019 19:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants