Skip to content

[benchmark] SR-4572 Remove jinja2 dependency from test harness generation #9193

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
May 11, 2017

Conversation

palimondo
Copy link
Contributor

I've replaced jinja2 with GYB, as requested by @dabrahams in review of #8641

Resolves SR-4572.

@palimondo
Copy link
Contributor Author

I'm thinking about reducing those 3 methods for adding test in main.swift to one with the appropriate list parameter…

@palimondo palimondo force-pushed the SR-4572 branch 2 times, most recently from e87d73c to 11b80c8 Compare May 2, 2017 16:58
@palimondo
Copy link
Contributor Author

Please review.

@swift-ci Please benchmark

@palimondo palimondo changed the title SR-4572 Remove jinja2 dependency from benchmark test harness generation [benchmark] SR-4572 Remove jinja2 dependency from test harness generation May 4, 2017
@slavapestov
Copy link
Contributor

@swift-ci Please benchmark

1 similar comment
@CodaFi
Copy link
Contributor

CodaFi commented May 4, 2017

@swift-ci Please benchmark

@slavapestov
Copy link
Contributor

@palimondo You need commit access to request CI. Once you've got a few PRs merged you can ask for commit access (email code-owners@swift.org with your github username and a list of five merged PRs).

@slavapestov
Copy link
Contributor

Looks good to me if the benchmark suite completes without error.

@slavapestov slavapestov self-assigned this May 4, 2017
@swift-ci
Copy link
Contributor

swift-ci commented May 5, 2017

Build comment file:

Optimized (O)

Regression (9)
TEST OLD NEW DELTA SPEEDUP
StringHasSuffix 669 798 +19.3% 0.84x
PrefixArrayLazy 29 33 +13.8% 0.88x
StringHasPrefix 608 691 +13.7% 0.88x
OpenClose 48 54 +12.5% 0.89x
DropWhileArrayLazy 80 89 +11.2% 0.90x
NopDeinit 28992 31971 +10.3% 0.91x
Calculator 43 47 +9.3% 0.91x
MapReduce 302 330 +9.3% 0.92x
SuffixArrayLazy 11 12 +9.1% 0.92x
Improvement (11)
TEST OLD NEW DELTA SPEEDUP
ProtocolDispatch 3030 2424 -20.0% 1.25x
ArrayAppendAscii 27270 22125 -18.9% 1.23x
DropLastArrayLazy 12 10 -16.7% 1.20x
DropWhileSequenceLazy 76 67 -11.8% 1.13x
ObjectiveCBridgeStubNSDateRefAccess 346 315 -9.0% 1.10x
ArrayAppendFromGeneric 653 596 -8.7% 1.10x
MapReduceAnyCollection 331 303 -8.5% 1.09x
ArrayAppendOptionals 1315 1228 -6.6% 1.07x
CaptureProp 4851 4563 -5.9% 1.06x
PrefixWhileArray 70 66 -5.7% 1.06x
ArrayAppendLazyMap 988 934 -5.5% 1.06x (?)
No Changes (249)
TEST OLD NEW DELTA SPEEDUP
AngryPhonebook 2957 2904 -1.8% 1.02x
AnyHashableWithAClass 67604 66778 -1.2% 1.01x
Array2D 2063 2026 -1.8% 1.02x (?)
ArrayAppend 785 774 -1.4% 1.01x
ArrayAppendArrayOfInt 625 596 -4.6% 1.05x
ArrayAppendGenericStructs 1291 1231 -4.6% 1.05x (?)
ArrayAppendLatin1 44603 43487 -2.5% 1.03x (?)
ArrayAppendRepeatCol 846 837 -1.1% 1.01x
ArrayAppendReserved 533 533 +0.0% 1.00x
ArrayAppendSequence 946 946 +0.0% 1.00x
ArrayAppendStrings 13620 13611 -0.1% 1.00x (?)
ArrayAppendToFromGeneric 596 596 +0.0% 1.00x
ArrayAppendToGeneric 596 596 +0.0% 1.00x
ArrayAppendUTF16 40778 40928 +0.4% 1.00x (?)
ArrayInClass 61 61 +0.0% 1.00x
ArrayLiteral 1214 1210 -0.3% 1.00x (?)
ArrayOfGenericPOD 219 219 +0.0% 1.00x
ArrayOfGenericRef 3989 3990 +0.0% 1.00x (?)
ArrayOfPOD 166 166 +0.0% 1.00x
ArrayOfRef 3906 3903 -0.1% 1.00x (?)
ArrayPlusEqualArrayOfInt 596 596 +0.0% 1.00x
ArrayPlusEqualFiveElementCollection 4655 4669 +0.3% 1.00x (?)
ArrayPlusEqualSingleElementCollection 773 773 +0.0% 1.00x
ArrayPlusEqualThreeElements 1589 1591 +0.1% 1.00x (?)
ArraySubscript 1491 1491 +0.0% 1.00x
ArrayValueProp 6 6 +0.0% 1.00x
ArrayValueProp2 6 6 +0.0% 1.00x
ArrayValueProp3 6 6 +0.0% 1.00x
ArrayValueProp4 6 6 +0.0% 1.00x
BitCount 0 0 +0.0% 1.00x
ByteSwap 0 0 +0.0% 1.00x
CStringLongAscii 5066 5043 -0.5% 1.00x (?)
CStringLongNonAscii 2113 2141 +1.3% 0.99x (?)
CStringShortAscii 5246 5299 +1.0% 0.99x (?)
CharacterLiteralsLarge 8650 8862 +2.5% 0.98x (?)
CharacterLiteralsSmall 310 312 +0.6% 0.99x
Chars 1839 1777 -3.4% 1.03x
ClassArrayGetter 13 13 +0.0% 1.00x
DeadArray 182 183 +0.5% 0.99x (?)
Dictionary 573 567 -1.0% 1.01x (?)
Dictionary2 1806 1808 +0.1% 1.00x (?)
Dictionary2OfObjects 3300 3304 +0.1% 1.00x (?)
Dictionary3 454 455 +0.2% 1.00x (?)
Dictionary3OfObjects 897 896 -0.1% 1.00x (?)
DictionaryBridge 2614 2610 -0.2% 1.00x (?)
DictionaryLiteral 1490 1486 -0.3% 1.00x (?)
DictionaryOfObjects 2338 2338 +0.0% 1.00x
DictionaryRemove 3286 3296 +0.3% 1.00x (?)
DictionaryRemoveOfObjects 23285 23337 +0.2% 1.00x (?)
DictionarySwap 370 370 +0.0% 1.00x
DictionarySwapOfObjects 6951 6928 -0.3% 1.00x (?)
DropFirstAnyCollection 127 127 +0.0% 1.00x
DropFirstAnyCollectionLazy 44894 44899 +0.0% 1.00x (?)
DropFirstAnySeqCRangeIter 27418 27412 -0.0% 1.00x (?)
DropFirstAnySeqCRangeIterLazy 27412 27418 +0.0% 1.00x (?)
DropFirstAnySeqCntRange 115 116 +0.9% 0.99x (?)
DropFirstAnySeqCntRangeLazy 115 116 +0.9% 0.99x (?)
DropFirstAnySequence 6760 6801 +0.6% 0.99x (?)
DropFirstAnySequenceLazy 6788 6798 +0.1% 1.00x (?)
DropFirstArray 29 29 +0.0% 1.00x
DropFirstArrayLazy 29 29 +0.0% 1.00x
DropFirstCountableRange 23 23 +0.0% 1.00x
DropFirstCountableRangeLazy 23 23 +0.0% 1.00x
DropFirstSequence 3067 3067 +0.0% 1.00x
DropFirstSequenceLazy 3031 3028 -0.1% 1.00x (?)
DropLastAnyCollection 52 52 +0.0% 1.00x
DropLastAnyCollectionLazy 14920 14925 +0.0% 1.00x (?)
DropLastAnySeqCRangeIter 4609 4609 +0.0% 1.00x
DropLastAnySeqCRangeIterLazy 4610 4608 -0.0% 1.00x (?)
DropLastAnySeqCntRange 40 40 +0.0% 1.00x
DropLastAnySeqCntRangeLazy 40 40 +0.0% 1.00x
DropLastAnySequence 6597 6858 +4.0% 0.96x
DropLastAnySequenceLazy 6519 6522 +0.0% 1.00x (?)
DropLastArray 10 10 +0.0% 1.00x
DropLastCountableRange 8 8 +0.0% 1.00x
DropLastCountableRangeLazy 8 8 +0.0% 1.00x
DropLastSequence 515 531 +3.1% 0.97x
DropLastSequenceLazy 516 531 +2.9% 0.97x (?)
DropWhileAnyCollection 133 133 +0.0% 1.00x
DropWhileAnyCollectionLazy 96 96 +0.0% 1.00x
DropWhileAnySeqCRangeIter 21986 22020 +0.2% 1.00x (?)
DropWhileAnySeqCRangeIterLazy 96 96 +0.0% 1.00x
DropWhileAnySeqCntRange 128 128 +0.0% 1.00x
DropWhileAnySeqCntRangeLazy 96 96 +0.0% 1.00x
DropWhileAnySequence 7645 7645 +0.0% 1.00x
DropWhileAnySequenceLazy 2108 2108 +0.0% 1.00x
DropWhileArray 42 42 +0.0% 1.00x
DropWhileCountableRange 35 36 +2.9% 0.97x
DropWhileCountableRangeLazy 79 79 +0.0% 1.00x
DropWhileSequence 3128 3125 -0.1% 1.00x (?)
ErrorHandling 2884 2851 -1.1% 1.01x (?)
GlobalClass 0 0 +0.0% 1.00x
Hanoi 3424 3443 +0.6% 0.99x (?)
HashQuadratic 6037981 6346058 +5.1% 0.95x
HashTest 1707 1699 -0.5% 1.00x (?)
Histogram 246 250 +1.6% 0.98x
Integrate 263 263 +0.0% 1.00x
IterateData 761 762 +0.1% 1.00x (?)
Join 435 435 +0.0% 1.00x
LazilyFilteredArrays 64924 64823 -0.2% 1.00x (?)
LazilyFilteredRange 4040 3931 -2.7% 1.03x (?)
LinkedList 7065 7059 -0.1% 1.00x (?)
MapReduceAnyCollectionShort 1996 1996 +0.0% 1.00x
MapReduceClass 3068 3070 +0.1% 1.00x (?)
MapReduceClassShort 4513 4511 -0.0% 1.00x (?)
MapReduceLazyCollection 15 15 +0.0% 1.00x
MapReduceLazyCollectionShort 44 45 +2.3% 0.98x
MapReduceLazySequence 90 90 +0.0% 1.00x
MapReduceSequence 460 459 -0.2% 1.00x (?)
MapReduceShort 1910 1916 +0.3% 1.00x (?)
MapReduceShortString 21 21 +0.0% 1.00x
MapReduceString 111 111 +0.0% 1.00x
Memset 234 234 +0.0% 1.00x
MonteCarloE 10408 10209 -1.9% 1.02x
MonteCarloPi 43887 43902 +0.0% 1.00x (?)
NSDictionaryCastToSwift 5272 5299 +0.5% 0.99x (?)
NSError 291 290 -0.3% 1.00x (?)
NSStringConversion 773 765 -1.0% 1.01x (?)
ObjectAllocation 180 179 -0.6% 1.01x (?)
ObjectiveCBridgeFromNSArrayAnyObject 23590 23568 -0.1% 1.00x (?)
ObjectiveCBridgeFromNSArrayAnyObjectForced 4475 4474 -0.0% 1.00x (?)
ObjectiveCBridgeFromNSArrayAnyObjectToString 43635 43574 -0.1% 1.00x (?)
ObjectiveCBridgeFromNSArrayAnyObjectToStringForced 37417 37447 +0.1% 1.00x (?)
ObjectiveCBridgeFromNSDictionaryAnyObject 117458 117619 +0.1% 1.00x (?)
ObjectiveCBridgeFromNSDictionaryAnyObjectForced 5165 5161 -0.1% 1.00x (?)
ObjectiveCBridgeFromNSDictionaryAnyObjectToString 95556 94912 -0.7% 1.01x (?)
ObjectiveCBridgeFromNSDictionaryAnyObjectToStringForced 89306 90304 +1.1% 0.99x (?)
ObjectiveCBridgeFromNSSetAnyObject 64254 64026 -0.4% 1.00x (?)
ObjectiveCBridgeFromNSSetAnyObjectForced 4175 4171 -0.1% 1.00x (?)
ObjectiveCBridgeFromNSSetAnyObjectToString 71625 71645 +0.0% 1.00x (?)
ObjectiveCBridgeFromNSSetAnyObjectToStringForced 62171 62613 +0.7% 0.99x (?)
ObjectiveCBridgeFromNSString 1404 1416 +0.9% 0.99x (?)
ObjectiveCBridgeFromNSStringForced 2345 2359 +0.6% 0.99x (?)
ObjectiveCBridgeStubDataAppend 3780 3705 -2.0% 1.02x (?)
ObjectiveCBridgeStubDateAccess 181 181 +0.0% 1.00x
ObjectiveCBridgeStubDateMutation 272 272 +0.0% 1.00x
ObjectiveCBridgeStubFromArrayOfNSString 28535 28455 -0.3% 1.00x (?)
ObjectiveCBridgeStubFromNSDate 3672 3631 -1.1% 1.01x (?)
ObjectiveCBridgeStubFromNSDateRef 3612 3562 -1.4% 1.01x
ObjectiveCBridgeStubFromNSString 914 935 +2.3% 0.98x (?)
ObjectiveCBridgeStubFromNSStringRef 176 173 -1.7% 1.02x
ObjectiveCBridgeStubNSDataAppend 2266 2248 -0.8% 1.01x (?)
ObjectiveCBridgeStubNSDateMutationRef 12550 12575 +0.2% 1.00x (?)
ObjectiveCBridgeStubToArrayOfNSString 29013 28702 -1.1% 1.01x (?)
ObjectiveCBridgeStubToNSDate 14397 14737 +2.4% 0.98x (?)
ObjectiveCBridgeStubToNSDateRef 3411 3416 +0.1% 1.00x (?)
ObjectiveCBridgeStubToNSString 1517 1509 -0.5% 1.01x (?)
ObjectiveCBridgeStubToNSStringRef 108 109 +0.9% 0.99x (?)
ObjectiveCBridgeStubURLAppendPath 215536 213909 -0.8% 1.01x (?)
ObjectiveCBridgeStubURLAppendPathRef 216917 216113 -0.4% 1.00x (?)
ObjectiveCBridgeToNSArray 29325 29342 +0.1% 1.00x (?)
ObjectiveCBridgeToNSDictionary 44484 44539 +0.1% 1.00x (?)
ObjectiveCBridgeToNSSet 39299 39191 -0.3% 1.00x (?)
ObjectiveCBridgeToNSString 1270 1262 -0.6% 1.01x (?)
ObserverClosure 2292 2287 -0.2% 1.00x (?)
ObserverForwarderStruct 1127 1106 -1.9% 1.02x (?)
ObserverPartiallyAppliedMethod 3794 3791 -0.1% 1.00x (?)
ObserverUnappliedMethod 2703 2702 -0.0% 1.00x (?)
Phonebook 9552 9649 +1.0% 0.99x (?)
PolymorphicCalls 22 22 +0.0% 1.00x
PopFrontArray 1070 1070 +0.0% 1.00x
PopFrontArrayGeneric 1069 1071 +0.2% 1.00x (?)
PopFrontUnsafePointer 8886 8888 +0.0% 1.00x (?)
PrefixAnyCollection 127 127 +0.0% 1.00x
PrefixAnyCollectionLazy 44803 44891 +0.2% 1.00x (?)
PrefixAnySeqCRangeIter 21553 21555 +0.0% 1.00x (?)
PrefixAnySeqCRangeIterLazy 21552 21555 +0.0% 1.00x (?)
PrefixAnySeqCntRange 115 115 +0.0% 1.00x
PrefixAnySeqCntRangeLazy 115 115 +0.0% 1.00x
PrefixAnySequence 6092 6101 +0.1% 1.00x (?)
PrefixAnySequenceLazy 6085 6092 +0.1% 1.00x (?)
PrefixArray 29 29 +0.0% 1.00x
PrefixCountableRange 23 23 +0.0% 1.00x
PrefixCountableRangeLazy 23 23 +0.0% 1.00x
PrefixSequence 2637 2637 +0.0% 1.00x
PrefixSequenceLazy 2600 2600 +0.0% 1.00x
PrefixWhileAnyCollection 160 160 +0.0% 1.00x
PrefixWhileAnyCollectionLazy 77 77 +0.0% 1.00x
PrefixWhileAnySeqCRangeIter 12491 12488 -0.0% 1.00x (?)
PrefixWhileAnySeqCRangeIterLazy 77 77 +0.0% 1.00x
PrefixWhileAnySeqCntRange 154 154 +0.0% 1.00x
PrefixWhileAnySeqCntRangeLazy 77 77 +0.0% 1.00x
PrefixWhileAnySequence 14160 14064 -0.7% 1.01x
PrefixWhileAnySequenceLazy 1584 1587 +0.2% 1.00x (?)
PrefixWhileArrayLazy 58 58 +0.0% 1.00x
PrefixWhileCountableRange 36 35 -2.8% 1.03x
PrefixWhileCountableRangeLazy 23 23 +0.0% 1.00x
PrefixWhileSequence 401 401 +0.0% 1.00x
PrefixWhileSequenceLazy 39 39 +0.0% 1.00x
Prims 765 772 +0.9% 0.99x (?)
ProtocolDispatch2 168 160 -4.8% 1.05x
RC4 168 170 +1.2% 0.99x
RGBHistogram 2293 2300 +0.3% 1.00x (?)
RGBHistogramOfObjects 24413 24438 +0.1% 1.00x (?)
RangeAssignment 312 306 -1.9% 1.02x (?)
RecursiveOwnedParameter 2312 2324 +0.5% 0.99x
ReversedArray 49 49 +0.0% 1.00x
ReversedBidirectional 29095 29133 +0.1% 1.00x (?)
ReversedDictionary 108 110 +1.9% 0.98x (?)
SetExclusiveOr 2928 2904 -0.8% 1.01x (?)
SetExclusiveOr_OfObjects 9538 9609 +0.7% 0.99x (?)
SetIntersect 273 281 +2.9% 0.97x
SetIntersect_OfObjects 1725 1725 +0.0% 1.00x
SetIsSubsetOf 286 286 +0.0% 1.00x
SetIsSubsetOf_OfObjects 359 359 +0.0% 1.00x
SetUnion 2676 2644 -1.2% 1.01x (?)
SetUnion_OfObjects 8024 8048 +0.3% 1.00x (?)
SevenBoom 1486 1480 -0.4% 1.00x (?)
Sim2DArray 276 276 +0.0% 1.00x
SortLargeExistentials 8363 8349 -0.2% 1.00x (?)
SortLettersInPlace 1147 1148 +0.1% 1.00x (?)
SortSortedStrings 860 843 -2.0% 1.02x
SortStrings 1638 1655 +1.0% 0.99x (?)
SortStringsUnicode 7957 7960 +0.0% 1.00x (?)
StackPromo 22206 22186 -0.1% 1.00x (?)
StaticArray 21 21 +0.0% 1.00x
StrComplexWalk 984 986 +0.2% 1.00x (?)
StrToInt 4100 4124 +0.6% 0.99x (?)
StringAdder 0 0 +0.0% 1.00x
StringBuilder 1293 1292 -0.1% 1.00x (?)
StringBuilderLong 954 947 -0.7% 1.01x (?)
StringEdits 439773 439545 -0.1% 1.00x (?)
StringEqualPointerComparison 7310 7282 -0.4% 1.00x (?)
StringHasPrefixUnicode 14542 14503 -0.3% 1.00x (?)
StringHasSuffixUnicode 61657 61811 +0.2% 1.00x (?)
StringInterpolation 8233 8275 +0.5% 0.99x (?)
StringMatch 9060 8785 -3.0% 1.03x
StringUTF16Builder 2099 2098 -0.0% 1.00x (?)
StringWalk 6186 6455 +4.3% 0.96x
StringWithCString 120773 120987 +0.2% 1.00x (?)
SuffixAnyCollection 52 52 +0.0% 1.00x
SuffixAnyCollectionLazy 14972 14975 +0.0% 1.00x (?)
SuffixAnySeqCRangeIter 4928 4928 +0.0% 1.00x
SuffixAnySeqCRangeIterLazy 4928 4927 -0.0% 1.00x (?)
SuffixAnySeqCntRange 39 40 +2.6% 0.98x
SuffixAnySeqCntRangeLazy 40 40 +0.0% 1.00x
SuffixAnySequence 6786 6695 -1.3% 1.01x
SuffixAnySequenceLazy 6529 6580 +0.8% 0.99x (?)
SuffixArray 10 10 +0.0% 1.00x
SuffixCountableRange 8 8 +0.0% 1.00x
SuffixCountableRangeLazy 8 8 +0.0% 1.00x
SuffixSequence 4465 4465 +0.0% 1.00x
SuffixSequenceLazy 4465 4465 +0.0% 1.00x
SuperChars 297842 298686 +0.3% 1.00x (?)
TwoSum 918 929 +1.2% 0.99x (?)
TypeFlood 0 0 +0.0% 1.00x
UTF8Decode 254 256 +0.8% 0.99x
Walsh 357 351 -1.7% 1.02x (?)
XorLoop 347 347 +0.0% 1.00x
**Unoptimized (Onone)**
Improvement (2)
TEST OLD NEW DELTA SPEEDUP
StringAdder 48 45 -6.2% 1.07x
ProtocolDispatch 7309 6923 -5.3% 1.06x
No Changes (267)
TEST OLD NEW DELTA SPEEDUP
AngryPhonebook 3105 3106 +0.0% 1.00x (?)
AnyHashableWithAClass 84218 84581 +0.4% 1.00x (?)
Array2D 606153 609582 +0.6% 0.99x (?)
ArrayAppend 3782 3954 +4.5% 0.96x
ArrayAppendArrayOfInt 652 653 +0.2% 1.00x (?)
ArrayAppendAscii 61606 61728 +0.2% 1.00x (?)
ArrayAppendFromGeneric 656 656 +0.0% 1.00x
ArrayAppendGenericStructs 1293 1361 +5.3% 0.95x (?)
ArrayAppendLatin1 83878 83876 -0.0% 1.00x (?)
ArrayAppendLazyMap 207681 207205 -0.2% 1.00x (?)
ArrayAppendOptionals 1338 1307 -2.3% 1.02x (?)
ArrayAppendRepeatCol 210294 210191 -0.0% 1.00x (?)
ArrayAppendReserved 3872 3695 -4.6% 1.05x (?)
ArrayAppendSequence 75762 75717 -0.1% 1.00x (?)
ArrayAppendStrings 13642 13611 -0.2% 1.00x (?)
ArrayAppendToFromGeneric 654 654 +0.0% 1.00x
ArrayAppendToGeneric 656 655 -0.2% 1.00x (?)
ArrayAppendUTF16 81564 81408 -0.2% 1.00x (?)
ArrayInClass 4734 4734 +0.0% 1.00x
ArrayLiteral 1483 1486 +0.2% 1.00x (?)
ArrayOfGenericPOD 3076 3073 -0.1% 1.00x (?)
ArrayOfGenericRef 9583 9581 -0.0% 1.00x (?)
ArrayOfPOD 1892 1832 -3.2% 1.03x
ArrayOfRef 8733 8823 +1.0% 0.99x (?)
ArrayPlusEqualArrayOfInt 653 653 +0.0% 1.00x
ArrayPlusEqualFiveElementCollection 286226 287915 +0.6% 0.99x
ArrayPlusEqualSingleElementCollection 283903 286358 +0.9% 0.99x (?)
ArrayPlusEqualThreeElements 10265 10165 -1.0% 1.01x (?)
ArraySubscript 4156 4166 +0.2% 1.00x (?)
ArrayValueProp 2997 3027 +1.0% 0.99x (?)
ArrayValueProp2 3648 3636 -0.3% 1.00x (?)
ArrayValueProp3 3413 3414 +0.0% 1.00x (?)
ArrayValueProp4 3324 3335 +0.3% 1.00x
BitCount 874 872 -0.2% 1.00x (?)
ByteSwap 262 269 +2.7% 0.97x
CStringLongAscii 5428 5438 +0.2% 1.00x (?)
CStringLongNonAscii 2398 2400 +0.1% 1.00x (?)
CStringShortAscii 8409 8346 -0.7% 1.01x (?)
Calculator 1063 1053 -0.9% 1.01x (?)
CaptureProp 110765 110553 -0.2% 1.00x (?)
CharacterLiteralsLarge 9885 9979 +1.0% 0.99x (?)
CharacterLiteralsSmall 1002 1000 -0.2% 1.00x
Chars 7372 7387 +0.2% 1.00x (?)
ClassArrayGetter 930 931 +0.1% 1.00x
DeadArray 117140 117507 +0.3% 1.00x (?)
Dictionary 1683 1683 +0.0% 1.00x
Dictionary2 3483 3479 -0.1% 1.00x (?)
Dictionary2OfObjects 5754 5763 +0.2% 1.00x (?)
Dictionary3 1316 1319 +0.2% 1.00x (?)
Dictionary3OfObjects 2213 2226 +0.6% 0.99x
DictionaryBridge 2684 2747 +2.3% 0.98x (?)
DictionaryLiteral 8227 8249 +0.3% 1.00x (?)
DictionaryOfObjects 4579 4625 +1.0% 0.99x (?)
DictionaryRemove 21106 21100 -0.0% 1.00x (?)
DictionaryRemoveOfObjects 55067 55854 +1.4% 0.99x
DictionarySwap 5555 5501 -1.0% 1.01x
DictionarySwapOfObjects 19304 19372 +0.4% 1.00x (?)
DropFirstAnyCollection 19163 19281 +0.6% 0.99x (?)
DropFirstAnyCollectionLazy 136696 137876 +0.9% 0.99x (?)
DropFirstAnySeqCRangeIter 29601 29831 +0.8% 0.99x (?)
DropFirstAnySeqCRangeIterLazy 30126 29843 -0.9% 1.01x
DropFirstAnySeqCntRange 19110 19186 +0.4% 1.00x
DropFirstAnySeqCntRangeLazy 19122 19022 -0.5% 1.01x
DropFirstAnySequence 13984 14085 +0.7% 0.99x
DropFirstAnySequenceLazy 14001 13817 -1.3% 1.01x
DropFirstArray 6213 6446 +3.8% 0.96x (?)
DropFirstArrayLazy 45328 45184 -0.3% 1.00x
DropFirstCountableRange 339 341 +0.6% 0.99x
DropFirstCountableRangeLazy 39041 39718 +1.7% 0.98x (?)
DropFirstSequence 12874 12910 +0.3% 1.00x
DropFirstSequenceLazy 12850 12678 -1.3% 1.01x
DropLastAnyCollection 6410 6471 +1.0% 0.99x (?)
DropLastAnyCollectionLazy 45863 45559 -0.7% 1.01x (?)
DropLastAnySeqCRangeIter 44083 44101 +0.0% 1.00x (?)
DropLastAnySeqCRangeIterLazy 44308 43955 -0.8% 1.01x
DropLastAnySeqCntRange 6380 6405 +0.4% 1.00x
DropLastAnySeqCntRangeLazy 6468 6362 -1.6% 1.02x
DropLastAnySequence 29201 29096 -0.4% 1.00x (?)
DropLastAnySequenceLazy 28974 28982 +0.0% 1.00x (?)
DropLastArray 2091 2158 +3.2% 0.97x
DropLastArrayLazy 15131 15091 -0.3% 1.00x (?)
DropLastCountableRange 118 118 +0.0% 1.00x
DropLastCountableRangeLazy 12923 13200 +2.1% 0.98x (?)
DropLastSequence 28657 28652 -0.0% 1.00x (?)
DropLastSequenceLazy 28674 28587 -0.3% 1.00x
DropWhileAnyCollection 25023 25078 +0.2% 1.00x (?)
DropWhileAnyCollectionLazy 27196 26982 -0.8% 1.01x (?)
DropWhileAnySeqCRangeIter 31878 31656 -0.7% 1.01x
DropWhileAnySeqCRangeIterLazy 27076 27073 -0.0% 1.00x (?)
DropWhileAnySeqCntRange 24983 24805 -0.7% 1.01x (?)
DropWhileAnySeqCntRangeLazy 27357 27167 -0.7% 1.01x (?)
DropWhileAnySequence 16164 16101 -0.4% 1.00x (?)
DropWhileAnySequenceLazy 12364 12378 +0.1% 1.00x (?)
DropWhileArray 9857 9842 -0.2% 1.00x (?)
DropWhileArrayLazy 16866 17301 +2.6% 0.97x
DropWhileCountableRange 6147 6118 -0.5% 1.00x
DropWhileCountableRangeLazy 25987 26053 +0.3% 1.00x (?)
DropWhileSequence 15183 14900 -1.9% 1.02x (?)
DropWhileSequenceLazy 11074 11241 +1.5% 0.99x (?)
ErrorHandling 3799 3763 -0.9% 1.01x (?)
GlobalClass 0 0 +0.0% 1.00x
Hanoi 17509 17680 +1.0% 0.99x (?)
HashQuadratic 48250875 48274065 +0.0% 1.00x (?)
HashTest 18386 18323 -0.3% 1.00x (?)
Histogram 8702 8645 -0.7% 1.01x (?)
Integrate 395 399 +1.0% 0.99x
IterateData 12989 12913 -0.6% 1.01x (?)
Join 1249 1247 -0.2% 1.00x (?)
LazilyFilteredArrays 1675912 1688428 +0.7% 0.99x (?)
LazilyFilteredRange 675277 678338 +0.5% 1.00x (?)
LinkedList 33121 33309 +0.6% 0.99x
MapReduce 37821 38071 +0.7% 0.99x
MapReduceAnyCollection 37777 38275 +1.3% 0.99x
MapReduceAnyCollectionShort 50282 50883 +1.2% 0.99x (?)
MapReduceClass 43018 43132 +0.3% 1.00x
MapReduceClassShort 54638 54419 -0.4% 1.00x (?)
MapReduceLazyCollection 32670 32969 +0.9% 0.99x
MapReduceLazyCollectionShort 44156 44474 +0.7% 0.99x (?)
MapReduceLazySequence 25266 25278 +0.0% 1.00x (?)
MapReduceSequence 41410 40959 -1.1% 1.01x
MapReduceShort 49999 50670 +1.3% 0.99x (?)
MapReduceShortString 280 284 +1.4% 0.99x (?)
MapReduceString 2614 2616 +0.1% 1.00x (?)
Memset 43980 43973 -0.0% 1.00x (?)
MonteCarloE 134612 135326 +0.5% 0.99x (?)
MonteCarloPi 52505 52523 +0.0% 1.00x (?)
NSDictionaryCastToSwift 6360 6522 +2.5% 0.98x (?)
NSError 704 710 +0.9% 0.99x (?)
NSStringConversion 1329 1341 +0.9% 0.99x (?)
NopDeinit 50300 51782 +2.9% 0.97x
ObjectAllocation 633 634 +0.2% 1.00x (?)
ObjectiveCBridgeFromNSArrayAnyObject 25695 26145 +1.8% 0.98x (?)
ObjectiveCBridgeFromNSArrayAnyObjectForced 8069 8018 -0.6% 1.01x (?)
ObjectiveCBridgeFromNSArrayAnyObjectToString 44902 44916 +0.0% 1.00x (?)
ObjectiveCBridgeFromNSArrayAnyObjectToStringForced 38681 38578 -0.3% 1.00x (?)
ObjectiveCBridgeFromNSDictionaryAnyObject 121791 121612 -0.1% 1.00x (?)
ObjectiveCBridgeFromNSDictionaryAnyObjectForced 7489 7627 +1.8% 0.98x (?)
ObjectiveCBridgeFromNSDictionaryAnyObjectToString 97899 99250 +1.4% 0.99x (?)
ObjectiveCBridgeFromNSDictionaryAnyObjectToStringForced 95230 92016 -3.4% 1.03x (?)
ObjectiveCBridgeFromNSSetAnyObject 67518 67466 -0.1% 1.00x (?)
ObjectiveCBridgeFromNSSetAnyObjectForced 7252 7208 -0.6% 1.01x (?)
ObjectiveCBridgeFromNSSetAnyObjectToString 76290 76084 -0.3% 1.00x (?)
ObjectiveCBridgeFromNSSetAnyObjectToStringForced 66091 66325 +0.4% 1.00x (?)
ObjectiveCBridgeFromNSString 4069 4070 +0.0% 1.00x (?)
ObjectiveCBridgeFromNSStringForced 2746 2728 -0.7% 1.01x (?)
ObjectiveCBridgeStubDataAppend 3741 3692 -1.3% 1.01x (?)
ObjectiveCBridgeStubDateAccess 1002 1003 +0.1% 1.00x (?)
ObjectiveCBridgeStubDateMutation 515 515 +0.0% 1.00x
ObjectiveCBridgeStubFromArrayOfNSString 28676 28602 -0.3% 1.00x (?)
ObjectiveCBridgeStubFromNSDate 4075 3918 -3.9% 1.04x
ObjectiveCBridgeStubFromNSDateRef 3946 3945 -0.0% 1.00x (?)
ObjectiveCBridgeStubFromNSString 976 986 +1.0% 0.99x (?)
ObjectiveCBridgeStubFromNSStringRef 219 213 -2.7% 1.03x (?)
ObjectiveCBridgeStubNSDataAppend 2615 2672 +2.2% 0.98x
ObjectiveCBridgeStubNSDateMutationRef 15230 15488 +1.7% 0.98x (?)
ObjectiveCBridgeStubNSDateRefAccess 1208 1209 +0.1% 1.00x (?)
ObjectiveCBridgeStubToArrayOfNSString 29276 29112 -0.6% 1.01x (?)
ObjectiveCBridgeStubToNSDate 15062 15784 +4.8% 0.95x (?)
ObjectiveCBridgeStubToNSDateRef 3386 3392 +0.2% 1.00x (?)
ObjectiveCBridgeStubToNSString 1586 1552 -2.1% 1.02x
ObjectiveCBridgeStubToNSStringRef 155 155 +0.0% 1.00x
ObjectiveCBridgeStubURLAppendPath 218669 216505 -1.0% 1.01x (?)
ObjectiveCBridgeStubURLAppendPathRef 218477 218623 +0.1% 1.00x (?)
ObjectiveCBridgeToNSArray 29498 29477 -0.1% 1.00x (?)
ObjectiveCBridgeToNSDictionary 45571 44984 -1.3% 1.01x (?)
ObjectiveCBridgeToNSSet 39790 39854 +0.2% 1.00x (?)
ObjectiveCBridgeToNSString 1322 1308 -1.1% 1.01x
ObserverClosure 6632 6735 +1.6% 0.98x (?)
ObserverForwarderStruct 4684 4691 +0.1% 1.00x (?)
ObserverPartiallyAppliedMethod 8101 8098 -0.0% 1.00x (?)
ObserverUnappliedMethod 8388 8388 +0.0% 1.00x
OpenClose 414 420 +1.4% 0.99x
Phonebook 24763 24831 +0.3% 1.00x (?)
PolymorphicCalls 2916 2905 -0.4% 1.00x
PopFrontArray 9845 9850 +0.1% 1.00x (?)
PopFrontArrayGeneric 8815 9247 +4.9% 0.95x
PopFrontUnsafePointer 97664 97327 -0.3% 1.00x (?)
PrefixAnyCollection 19225 19432 +1.1% 0.99x
PrefixAnyCollectionLazy 136975 135892 -0.8% 1.01x (?)
PrefixAnySeqCRangeIter 24065 24149 +0.3% 1.00x
PrefixAnySeqCRangeIterLazy 24193 24173 -0.1% 1.00x (?)
PrefixAnySeqCntRange 19107 19184 +0.4% 1.00x (?)
PrefixAnySeqCntRangeLazy 19141 19006 -0.7% 1.01x (?)
PrefixAnySequence 11787 11793 +0.1% 1.00x (?)
PrefixAnySequenceLazy 11791 11757 -0.3% 1.00x (?)
PrefixArray 6266 6445 +2.9% 0.97x (?)
PrefixArrayLazy 45422 45263 -0.4% 1.00x (?)
PrefixCountableRange 339 341 +0.6% 0.99x
PrefixCountableRangeLazy 38907 39656 +1.9% 0.98x (?)
PrefixSequence 10779 10758 -0.2% 1.00x
PrefixSequenceLazy 10743 10799 +0.5% 0.99x
PrefixWhileAnyCollection 36547 36642 +0.3% 1.00x (?)
PrefixWhileAnyCollectionLazy 22474 22694 +1.0% 0.99x
PrefixWhileAnySeqCRangeIter 40663 40718 +0.1% 1.00x (?)
PrefixWhileAnySeqCRangeIterLazy 22726 22429 -1.3% 1.01x (?)
PrefixWhileAnySeqCntRange 36735 36287 -1.2% 1.01x (?)
PrefixWhileAnySeqCntRangeLazy 22664 22568 -0.4% 1.00x (?)
PrefixWhileAnySequence 29491 29564 +0.2% 1.00x (?)
PrefixWhileAnySequenceLazy 11223 11255 +0.3% 1.00x
PrefixWhileArray 16923 16943 +0.1% 1.00x (?)
PrefixWhileArrayLazy 14659 14889 +1.6% 0.98x
PrefixWhileCountableRange 17632 17574 -0.3% 1.00x (?)
PrefixWhileCountableRangeLazy 21760 21845 +0.4% 1.00x (?)
PrefixWhileSequence 28522 28382 -0.5% 1.00x
PrefixWhileSequenceLazy 10422 10431 +0.1% 1.00x (?)
Prims 8970 8920 -0.6% 1.01x (?)
ProtocolDispatch2 490 491 +0.2% 1.00x
RC4 19635 19889 +1.3% 0.99x
RGBHistogram 33850 33830 -0.1% 1.00x (?)
RGBHistogramOfObjects 98602 98475 -0.1% 1.00x (?)
RangeAssignment 5759 5763 +0.1% 1.00x (?)
RecursiveOwnedParameter 9648 9648 +0.0% 1.00x
ReversedArray 588 589 +0.2% 1.00x (?)
ReversedBidirectional 75820 75295 -0.7% 1.01x (?)
ReversedDictionary 26476 26641 +0.6% 0.99x
SetExclusiveOr 21448 21145 -1.4% 1.01x
SetExclusiveOr_OfObjects 41255 41523 +0.6% 0.99x
SetIntersect 10728 10638 -0.8% 1.01x
SetIntersect_OfObjects 11235 11285 +0.4% 1.00x
SetIsSubsetOf 1620 1620 +0.0% 1.00x
SetIsSubsetOf_OfObjects 1540 1515 -1.6% 1.02x (?)
SetUnion 12015 12040 +0.2% 1.00x (?)
SetUnion_OfObjects 29670 29643 -0.1% 1.00x (?)
SevenBoom 1611 1594 -1.1% 1.01x (?)
Sim2DArray 30036 30038 +0.0% 1.00x (?)
SortLargeExistentials 17886 17848 -0.2% 1.00x (?)
SortLettersInPlace 2857 2889 +1.1% 0.99x
SortSortedStrings 1414 1407 -0.5% 1.00x
SortStrings 2518 2478 -1.6% 1.02x
SortStringsUnicode 8964 8955 -0.1% 1.00x (?)
StackPromo 103492 102371 -1.1% 1.01x (?)
StaticArray 4636 4588 -1.0% 1.01x
StrComplexWalk 6022 5986 -0.6% 1.01x
StrToInt 5156 5209 +1.0% 0.99x
StringBuilder 2711 2720 +0.3% 1.00x (?)
StringBuilderLong 1099 1099 +0.0% 1.00x
StringEdits 737571 746223 +1.2% 0.99x
StringEqualPointerComparison 10023 10008 -0.1% 1.00x
StringHasPrefix 1722 1728 +0.3% 1.00x (?)
StringHasPrefixUnicode 16408 16203 -1.2% 1.01x
StringHasSuffix 1918 1937 +1.0% 0.99x
StringHasSuffixUnicode 63642 63615 -0.0% 1.00x (?)
StringInterpolation 11949 11920 -0.2% 1.00x (?)
StringMatch 30357 30527 +0.6% 0.99x (?)
StringUTF16Builder 3583 3555 -0.8% 1.01x (?)
StringWalk 21868 21359 -2.3% 1.02x
StringWithCString 126458 126294 -0.1% 1.00x (?)
SuffixAnyCollection 6403 6462 +0.9% 0.99x
SuffixAnyCollectionLazy 45770 45339 -0.9% 1.01x (?)
SuffixAnySeqCRangeIter 41647 41943 +0.7% 0.99x (?)
SuffixAnySeqCRangeIterLazy 41970 41833 -0.3% 1.00x (?)
SuffixAnySeqCntRange 6377 6423 +0.7% 0.99x (?)
SuffixAnySeqCntRangeLazy 6475 6363 -1.7% 1.02x (?)
SuffixAnySequence 27037 26880 -0.6% 1.01x
SuffixAnySequenceLazy 26839 26796 -0.2% 1.00x (?)
SuffixArray 2103 2152 +2.3% 0.98x
SuffixArrayLazy 15123 15086 -0.2% 1.00x (?)
SuffixCountableRange 119 119 +0.0% 1.00x
SuffixCountableRangeLazy 12968 13187 +1.7% 0.98x (?)
SuffixSequence 26409 26483 +0.3% 1.00x
SuffixSequenceLazy 26504 26411 -0.4% 1.00x
SuperChars 334183 334686 +0.2% 1.00x (?)
TwoSum 4373 4314 -1.3% 1.01x (?)
TypeFlood 164 164 +0.0% 1.00x
UTF8Decode 36922 36912 -0.0% 1.00x (?)
Walsh 11972 11926 -0.4% 1.00x (?)
XorLoop 23707 23706 -0.0% 1.00x (?)
**Hardware Overview** Model Name: Mac mini Model Identifier: Macmini7,1 Processor Name: Intel Core i5 Processor Speed: 2.8 GHz Number of Processors: 1 Total Number of Cores: 2 L2 Cache (per Core): 256 KB L3 Cache: 3 MB Memory: 16 GB

@slavapestov
Copy link
Contributor

@swift-ci Please smoke test

@palimondo
Copy link
Contributor Author

@slavapestov Please merge?

@slavapestov slavapestov merged commit 02dbc0f into swiftlang:master May 11, 2017
@palimondo
Copy link
Contributor Author

Thank you @slavapestov !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants