ReBenchDB for SOMns

Comparing 546c1f with ef8d51


Run time of comp: 38.73823 secs

Summary Over All Benchmarks


Run time of summary-suites: 0.8562152 secs

Number of Benchmarks
165
Geometric Mean
1.008 (min. 0.93, max. 1.09)

Benchmark Performance

Baseline
546c1f
Change
ef8d51
Significant Change

fj-startup

Executor: SOMns-graal
#M mean in ms median in ms change in %
CilkSort 3 187.8720.7 186.44167.93209.25 1
Integrate 3 462.4651.84 465.93408.98512.48 -1
Jacobi 3 388.8529.68 395.89356.28414.37 -7
LUDecomposition 3 766.7473.78 782.62686.31831.28 5

fj-steady

Executor: SOMns-graal
#M mean in ms median in ms change in %
CilkSort 101 27.98.02 26.4920.4861.16 1-137
Integrate 101 21.2410.08 19.0614.4372.78 13-220
Jacobi 101 25.369.27 23.8614.4563.21 6-514
LUDecomposition 101 11.013.56 9.317.5823.02 -12-17-4

macro-startup

Executor: SOMns-graal
#M mean in ms median in ms change in %
CD 3 197.333.1 215.12159.11217.67 24
DeltaBlue 3 230.5246.27 222.7188.65280.19 3
DeltaBlueNS 3 310.1559.81 285.88266.29378.29 -3
GraphSearch 3 305.9838.59 285.42282.03350.5 -11
Havlak 3 280.4543.9 260.89249.72330.72 1
Json 3 339.8612.75 346.12325.19348.28 1
Lee 3 693.9836.42 708.82652.48720.64 6
LeeSTM 3 859.6321.83 867.36834.98876.54 3
Mandelbrot 3 92.997.91 92.0185.62101.35 -26
NBody 3 388.623.17 392.68363.66409.46 -6
PageRank 3 199.5650.32 221.46142.01235.23 44
Richards 3 472.6130.94 489.22436.92491.7 2
RichardsNS 3 138.426.24 141131.31142.97 -1
Splay 3 2358.82229.89 2369.012124.012583.46 -5
Vacation 3 290.5336.26 278.2262.03331.35 2
VacationSTM 3 329.522.14 326.57308.96352.96 18

macro-steady

Executor: SOMns-graal
#M mean in ms median in ms change in %
CD 101 76.6523.42 64.6559.62141.39 3-16
DeltaBlue 101 8.313.92 6.585.3229.62 5023
DeltaBlueNS 101 33.147.19 34.4726.0479.84 -3-10-2
GraphSearch 151 68.313.4 65.0148.58104.76 181325
Havlak 101 62.6322.48 53.3148.17157.47 538
Json 101 66.3337.14 50.8940.14217.25 -11-2918
Lee 121 74.7233.97 57.9654.51194.84 -11-14-6
LeeSTM 121 56.6829.41 44.9736.52168.29 -10-13-9
Mandelbrot 101 48.711.57 43.3143.1686.8 000
NBody 101 45.2614.08 36.5536.4789.8 000
PageRank 101 203.91 19.3818.0451.84 -8-8-8
Richards 101 128.0310.5 125.96125.81203.54 222
RichardsNS 101 14.585.95 13.0611.9663.94 -4-5-3
Splay 121 74.131.09 60.8546.3194.32 -1-713
Vacation 121 16.449.99 14.88.42108.94 -11-18-10
VacationSTM 121 18.6126.35 14.8910.07298.67 -4-194

micro-startup

Executor: SOMns-graal
#M mean in ms median in ms change in %
ClosureDefFibonacci 3 553.6355.39 584.77489.68586.45 12
ClosureFibonacci 3 320.0484.26 276.43266.52417.16 0
Dispatch 3 310.4758.83 338.18242.89350.33 15
Fibonacci 3 408.4728.1 413.94378.04433.43 -12
FieldLoop 3 216.3238.86 209.59181.26258.1 1
IntegerLoop 3 600.2224.73 602.16574.57623.92 35
Loop 3 156.9210.15 159.81145.63165.31 -3
Recurse 3 240.7523.06 242.11217.04263.1 4
Sum 3 258.9245.52 277.87206.99291.91 27
WhileLoop 3 266.3335.71 258.4235.25305.34 2

micro-steady

Executor: SOMns-graal
#M mean in ms median in ms change in %
ClosureDefFibonacci 51 28.5115.03 22.118.66104.73 10127
ClosureFibonacci 51 47.2811.32 41.6538.9689.54 -4-107
Dispatch 51 38.158.41 33.6333.4271.71 0010
Fibonacci 51 10541.49 88.8268.82223.65 7-1336
FieldLoop 51 33.19.25 28.0827.5263.33 -8-104
IntegerLoop 51 27.675.7 25.2125.1149.66 -12-13-11
Loop 51 1.130.25 1.010.961.75 -10-11-7
Recurse 51 118.2534.49 95.9792.44210.03 -3-65
Sum 51 60.7310.54 56.3656.31110.67 000
WhileLoop 51 33.076.24 30.4130.2666.18 001

savina-jit

Executor: SOMns-graal
#M mean in ms median in ms change in %
AStarSearch 101 72.2939.34 50.0536.1198.47 -24-2911
BankTransaction 101 137.924.4 133.2109.62243.57 11914
BigContention 101 255.7526.78 252.89219.57354.05 131015
Chameneos 101 72.3318.94 68.6851.15123.82 422948
CigaretteSmokers 101 19.5127.25 15.4712.74284.81 -1-62
ConcurrentDictionary 101 13.921.25 10.826.94220.1 10-214
ConcurrentSortedLinkedList 101 137.2322.18 128.94122.51260.27 -1-2-1
Counting 101 19.9210.84 17.1311.476.7 -11-190
ForkJoinActorCreation 101 26.6210.51 23.1318.0887.8 -22-34-5
ForkJoinThroughput 101 60.4515.61 59.9742.93133.65 4-16
LogisticsMapSeries 101 170.0244.76 156.02122.88294.21 12422
NQueens 101 76.5854.45 53.2243.23299.65 1-1310
Philosophers 101 67.3636.98 56.3346.56344.54 -15-23-5
PingPong 101 21.057.88 20.7714.6558.2 6-238
ProducerConsumerBoundedBuffer 101 119.6319.98 109.45108.86218.39 001
RadixSort 101 92.4124.63 77.6870.62191.79 1-534
SleepingBarber 101 256.0844.09 236.35216.72407.37 314
ThreadRing 101 28.9929.86 24.0517.58312.84 1-76
TrapezoidalApproximation 101 443.0239.32 420.13419.49579.37 000
UnbalancedCobwebbedTree 101 228.2545.15 217.7178.78346.23 -4-80

som-startup

Executor: SOMns-graal
#M mean in ms median in ms change in %
Bounce 3 280.2436.83 264.56253.86322.32 4
Fannkuch 3 125.47.77 126.47117.15132.57 13
List 3 384.8327.34 388.17355.98410.34 10
Permute 3 194.2536.52 174.39171.96236.4 11
Queens 3 170.0825.33 162.01149.77198.46 14
Sieve 3 327.5333.01 309.92307.05365.61 -2
Storage 3 221.4228.03 216.95195.9251.43 -4
Towers 3 435.755.37 441.38377.71488.01 11

som-steady

Executor: SOMns-graal
#M mean in ms median in ms change in %
Bounce 51 29.073.79 2824.241.45 214
Fannkuch 51 46.2618.67 35.1634.79115.85 0-122
List 51 82.119.87 66.9366.13127.9 1025
Permute 51 57.915.71 46.9146.7398.46 -3-32
Queens 51 42.3211.2 38.8731.6894.3 1-32
Sieve 51 16.264.27 14.7411.5531.86 -3-62
Storage 51 111.544.59 92.7580.56261.51 -9-15-7
Towers 51 72.6722.73 61.8255.87161.8 -9-1813

sort-startup

Executor: SOMns-graal
#M mean in ms median in ms change in %
BubbleSort 3 128.5419.9 120.29114.1151.25 0
QuickSort 3 148.5714.45 147.98134.42163.31 -26
TreeSort 3 178.2622.08 186.64153.22194.93 12

sort-steady

Executor: SOMns-graal
#M mean in ms median in ms change in %
BubbleSort 51 51.8415.04 41.7239.7685.67 4025
QuickSort 51 46.314.6 38.7636.7101.27 -13-15-11
TreeSort 51 82.9456.61 56.0446.26277.49 -9-206

savina-csp

Executor: SOMns-graal-tn
#M mean in ms median in ms change in %
ForkJoinThroughput 96 35.974.68 34.6727.7152.84 -4-6-2
Philosophers 96 201.26167.83 166.0335.181422.55 6-926
PingPong 96 37.0611.08 34.8911.9564.44 262242

macro-startup

Executor: SOMns-interp
#M mean in ms median in ms change in %
CD 3 188.2847.92 161.45159.78243.6 8
DeltaBlue 3 183.6312.39 183.92171.09195.87 18
DeltaBlueNS 3 257.917.18 252.82243.83277.05 20
GraphSearch 3 240.2620.5 232.14225.06263.57 -13
Havlak 3 175.4110.56 176.57164.32185.34 8
Json 3 262.1831.64 259.07232.21295.25 13
Lee 3 527.6860.9 521.03470.37591.63 -4
LeeSTM 3 560.3828.3 574.34527.81578.98 6
Mandelbrot 3 109.5615.57 106.5795.7126.4 1
NBody 3 359.7359.4 327.49323.43428.28 4
PageRank 3 113.6316 107.92101.27131.7 -13
Richards 3 374.9446.37 377.08327.53420.2 -7
RichardsNS 3 126.5925.11 140.197.62142.06 41
Splay 3 1798.2933.48 1785.391773.181836.3 -3
Vacation 3 223.4723.33 222.79200.49247.14 3
VacationSTM 3 258.0230.62 259.78226.55287.72 -2

micro-startup

Executor: SOMns-interp
#M mean in ms median in ms change in %
ClosureDefFibonacci 3 434.9949.98 452.51378.6473.85 18
ClosureFibonacci 3 256.8827.17 253.26231.7285.68 -3
Dispatch 3 293.0718.62 302.18271.65305.39 2
Fibonacci 3 460.2843.14 447.98424.62508.23 9
FieldLoop 3 196.2934.3 178.19174.83235.84 -9
IntegerLoop 3 733.5631.66 727.89705.12767.67 5
Loop 3 163.8725.75 151.06147.04193.51 0
Recurse 3 206.1230.57 195.4182.36240.61 -19
Sum 3 212.2413.78 218.89196.4221.44 3
WhileLoop 3 237.4920.98 226.25224.53261.7 13

savina-interp

Executor: SOMns-interp
#M mean in ms median in ms change in %
AStarSearch 150 82.7833.1 74.6258.11258.46 -5-167
BankTransaction 150 101.8636.38 90.7874.04305.97 0-108
BigContention 150 197.4145.6 194.61152.57433.02 1-45
Chameneos 150 108.7438.02 96.7280.62359.56 -2-66
CigaretteSmokers 150 219.8549.86 198.05173.91393 2-413
ConcurrentDictionary 150 74.9124.46 66.6554.83201.21 -6-179
ConcurrentSortedLinkedList 150 177.6342.49 165.46135.51391.31 -4-60
Counting 150 188.1658.27 176.66131.7358.95 9-715
ForkJoinActorCreation 150 146.557.46 134.87102.06465.95 -3-163
ForkJoinThroughput 150 288.1765.68 265.27227.29597.21 5013
LogisticsMapSeries 150 295.1468.18 290.4223.92594.91 11114
NQueens 150 76.1721.23 69.6964.23197.4 -2-4-1
Philosophers 150 179.2744.1 172.42139.18377.79 1-86
PingPong 150 97.6329.93 89.1468.73227.8 4-412
ProducerConsumerBoundedBuffer 150 157.7140.73 145.95118.43269.88 3-89
RadixSort 150 189.8448.19 182.06140.11441.05 2-74
SleepingBarber 150 173.9751.33 169.84126.57413.29 7-99
ThreadRing 150 47.8318.32 45.9733.58144.05 6-29
TrapezoidalApproximation 150 175.9246.85 161.63128.55328.88 0-814
UnbalancedCobwebbedTree 150 105.736.25 92.4679.37293.44 -5-123

som-startup

Executor: SOMns-interp
#M mean in ms median in ms change in %
Bounce 3 207.3819.17 208.84187.52225.78 4
Fannkuch 3 87.3912.47 92.2973.2196.67 -1
List 3 336.7244.93 354.74285.58369.85 30
Permute 3 151.620.2 161.59128.35164.86 -1
Queens 3 118.5115.08 117.64103.88134 -6
Sieve 3 257.2626.42 266.77227.4277.62 -6
Storage 3 182.638.2 184.46173.68189.76 8
Towers 3 356.886.12 308.07306.09456.24 3

sort-startup

Executor: SOMns-interp
#M mean in ms median in ms change in %
BubbleSort 3 133.0927.98 122.15112.24164.89 -9
QuickSort 3 143.2929.79 139.75115.43174.7 -6
TreeSort 3 144.057.91 143.49136.45152.23 0

savina-csp-interp

Executor: SOMns-interp-tn
#M mean in ms median in ms change in %
ForkJoinThroughput 21 39.614 38.6335.3751.87 0
Philosophers 21 64.7413.93 63.6338.5391.13 12
PingPong 21 40.611.63 37.2116.2865.51 2


Run time of suites: 41.14314 secs

Warmup Behavior

This section excludes all interpreter-only and startup benchmarks.
CilkSortfj-steadySOMns-graal
Integratefj-steadySOMns-graal
Jacobifj-steadySOMns-graal
LUDecompositionfj-steadySOMns-graal
CDmacro-steadySOMns-graal
DeltaBluemacro-steadySOMns-graal
DeltaBlueNSmacro-steadySOMns-graal
GraphSearchmacro-steadySOMns-graal
Havlakmacro-steadySOMns-graal
Jsonmacro-steadySOMns-graal
Leemacro-steadySOMns-graal
LeeSTMmacro-steadySOMns-graal
Mandelbrotmacro-steadySOMns-graal
NBodymacro-steadySOMns-graal
PageRankmacro-steadySOMns-graal
Richardsmacro-steadySOMns-graal
RichardsNSmacro-steadySOMns-graal
Splaymacro-steadySOMns-graal
Vacationmacro-steadySOMns-graal
VacationSTMmacro-steadySOMns-graal
ClosureDefFibonaccimicro-steadySOMns-graal
ClosureFibonaccimicro-steadySOMns-graal
Dispatchmicro-steadySOMns-graal
Fibonaccimicro-steadySOMns-graal
FieldLoopmicro-steadySOMns-graal
IntegerLoopmicro-steadySOMns-graal
Loopmicro-steadySOMns-graal
Recursemicro-steadySOMns-graal
Summicro-steadySOMns-graal
WhileLoopmicro-steadySOMns-graal
AStarSearchsavina-jitSOMns-graal
BankTransactionsavina-jitSOMns-graal
BigContentionsavina-jitSOMns-graal
Chameneossavina-jitSOMns-graal
CigaretteSmokerssavina-jitSOMns-graal
ConcurrentDictionarysavina-jitSOMns-graal
ConcurrentSortedLinkedListsavina-jitSOMns-graal
Countingsavina-jitSOMns-graal
ForkJoinActorCreationsavina-jitSOMns-graal
ForkJoinThroughputsavina-jitSOMns-graal
LogisticsMapSeriessavina-jitSOMns-graal
NQueenssavina-jitSOMns-graal
Philosopherssavina-jitSOMns-graal
PingPongsavina-jitSOMns-graal
ProducerConsumerBoundedBuffersavina-jitSOMns-graal
RadixSortsavina-jitSOMns-graal
SleepingBarbersavina-jitSOMns-graal
ThreadRingsavina-jitSOMns-graal
TrapezoidalApproximationsavina-jitSOMns-graal
UnbalancedCobwebbedTreesavina-jitSOMns-graal
Bouncesom-steadySOMns-graal
Fannkuchsom-steadySOMns-graal
Listsom-steadySOMns-graal
Permutesom-steadySOMns-graal
Queenssom-steadySOMns-graal
Sievesom-steadySOMns-graal
Storagesom-steadySOMns-graal
Towerssom-steadySOMns-graal
BubbleSortsort-steadySOMns-graal
QuickSortsort-steadySOMns-graal
TreeSortsort-steadySOMns-graal
ForkJoinThroughputsavina-cspSOMns-graal-tn
Philosopherssavina-cspSOMns-graal-tn
PingPongsavina-cspSOMns-graal-tn


Run time of warmup-plots: 18.30028 secs