Result Overview

Number of Run Configurations
83
Change of Allocated
median 0% (min. 0%, max. 0%)
Change of GC count
median 0% (min. 0%, max. 0%)
Change of GC time
median 0% (min. 0%, max. 0%)
Change of Run time
median -54% (min. -82%, max. 562182%)

Changes in Benchmark Set

Commit Executor Suite Benchmark Variable Values Cores Input Size Extra Arguments
bde96b som-rs-bc macro DeltaBlue 1 50
show more

Performance Changes between Versions

interpreter

Executor: som-rs-ast
#M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
ArgRead 5 16.19 -51 2MB 0 0 0 0 0
ArrayReadConst 5 35.03 -63 2MB 0 0 0 0 0
ArrayWriteConstConst 5 40.18 -57 2MB 0 0 0 0 0
BlockSend0ConstReturn 5 76.17 -34 35MB 0 0 0 0 0
Const 5 18.84 -42 2MB 0 0 0 0 0
FieldConstWrite 5 23.88 -53 2MB 0 0 0 0 0
FieldRead 5 16.03 -59 2MB 0 0 0 0 0
FieldReadIncWrite 5 48.36 -58 2MB 0 0 0 0 0
FieldReadWrite 5 23.53 -62 2MB 0 0 0 0 0
GlobalRead 5 28.57 -58 2MB 0 0 0 0 0
LocalConstWrite 5 22.79 -47 2MB 0 0 0 0 0
LocalRead 5 16.84 -54 2MB 0 0 0 0 0
LocalReadIncWrite 5 36.95 -59 2MB 0 0 0 0 0
LocalReadWrite 5 21.08 -56 2MB 0 0 0 0 0
SelfSend0 5 45.55 -39 2MB 0 0 0 0 0
SelfSend0BlockConstNonLocalReturn 5 127.52 -37 54MB 0 0 0 0 0

macro

Executor: som-rs-ast
#M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
DeltaBlue 5 12.25 -51 2MB 0 0 0 0 0
GraphSearch 5 53.61 -33 9MB 0 0 0 0 0
JsonSmall 5 14.71 -41 2MB 0 0 0 0 0
NBody 5 31.39 -57 660kb 0 0 0 0 0
PageRank 5 63.82 -54 5MB 0 0 0 0 0
Richards 5 258.44 -53 26MB 0 0 0 0 0

micro

Executor: som-rs-ast
#M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
Bounce 5 84.57 -49 17MB 0 0 0 0 0
BubbleSort 5 92.34 -59 13MB 0 0 0 0 0
Dispatch 5 30.45 -63 8MB 0 0 0 0 0
Fannkuch 5 33.57 -68 4MB 0 0 0 0 0
Fibonacci 5 165.88 -26 40MB 0 0 0 0 0
FieldLoop 5 48.26 -57 2MB 0 0 0 0 0
IntegerLoop 5 1562.72 -66 20MB 0 6 0 9060 0
List 5 13.57 -52 692kb 0 0 0 0 0
Loop 5 118.80 -75 988kb 0 0 0 0 0
Permute 5 80.02 -56 15MB 0 0 0 0 0
Queens 5 93.52 -54 17MB 0 0 0 0 0
QuickSort 5 60.39 -61 8MB 0 0 0 0 0
Recurse 5 162.46 -42 31MB 0 0 0 0 0
Sieve 5 107.69 -60 16MB 0 0 0 0 0
Storage 5 52.35 -55 10MB 0 0 0 0 0
Sum 5 42.86 -78 0b 0 0 0 0 0
Towers 5 29.12 -52 4MB 0 0 0 0 0
TreeSort 5 41.91 -52 8MB 0 0 0 0 0
WhileLoop 5 46.08 -66 32kb 0 0 0 0 0

micro-som-rs

Executor: som-rs-ast
#M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
Mandelbrot 5 77.92 -50 6MB 0 0 0 0 0

interpreter

Executor: som-rs-bc
#M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
ArgRead 5 18.17 -45 9MB 0 0 0 0 0
ArrayReadConst 5 31.45 -58 9MB 0 0 0 0 0
ArrayWriteConstConst 5 39.51 -51 9MB 0 0 0 0 0
BlockSend0ConstReturn 5 117.51 -4 108MB 0 0 0 0 0
Const 5 22.16 -43 9MB 0 0 0 0 0
FieldConstWrite 5 18.82 -56 9MB 0 0 0 0 0
FieldRead 5 18.85 -53 9MB 0 0 0 0 0
FieldReadIncWrite 5 23.65 -60 9MB 0 0 0 0 0
FieldReadWrite 5 20.46 -63 9MB 0 0 0 0 0
GlobalRead 5 31.62 -44 9MB 0 0 0 0 0
LocalConstWrite 5 19.06 -48 9MB 0 0 0 0 0
LocalRead 5 18.42 -48 9MB 0 0 0 0 0
LocalReadIncWrite 5 21.64 -50 9MB 0 0 0 0 0
LocalReadWrite 5 19.58 -54 9MB 0 0 0 0 0
SelfSend0 5 63.33 -41 56MB 0 0 0 0 0
SelfSend0BlockConstNonLocalReturn 5 150.43 -28 122MB 0 0 0 0 0

macro

Executor: som-rs-bc
#M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
DeltaBlue No matching configuration for
bde96ba315406117f87c3246310f6e990df557d4: Allocated, Compile time, GC count, GC time, total
GraphSearch 5 53.40 -33 17MB 0 0 0 0 0
JsonSmall 5 14.05 -38 4MB 0 0 0 0 0
NBody 5 42.89 -61 25MB 0 0 0 0 0
PageRank 5 57.36 -52 9MB 0 0 0 0 0
Richards 5 276.33 -56 44MB 0 1 0 2867 0

micro

Executor: som-rs-bc
#M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
Bounce 5 85.03 -48 53MB 0 0 0 0 0
BubbleSort 5 83.02 -58 47MB 0 0 0 0 0
Dispatch 5 27.73 -67 17MB 0 0 0 0 0
Fannkuch 5 29.41 -74 9MB 0 0 0 0 0
Fibonacci 5 123.64 -11 93MB 0 0 0 0 0
FieldLoop 5 23.40 -61 9MB 0 0 0 0 0
IntegerLoop 5 5184.24 562182 71MB 0 29 0 28762 0
List 5 19.75 -51 14MB 0 0 0 0 0
Loop 5 68.03 -82 3MB 0 0 0 0 0
Permute 5 104.15 -39 69MB 0 0 0 0 0
Queens 5 95.94 -54 52MB 0 0 0 0 0
QuickSort 5 56.55 -57 23MB 0 0 0 0 0
Recurse 5 148.54 -44 107MB 0 0 0 0 0
Sieve 5 87.56 -63 40MB 0 0 0 0 0
Storage 5 46.86 -53 29MB 0 0 0 0 0
Sum 5 44.64 -78 32kb 0 0 0 0 0
Towers 5 31.31 -55 22MB 0 0 0 0 0
TreeSort 5 48.57 -47 31MB 0 0 0 0 0
WhileLoop 5 33.97 -58 68kb 0 0 0 0 0

micro-som-rs

Executor: som-rs-bc
#M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
Mandelbrot 5 59.97 -58 22MB 0 0 0 0 0

Executor Comparisons

interpreter

Baseline: som-rs-ast

Exe #M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
ArgRead ast
bc 		10
10 		16.19
18.17 		0
12 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
ArrayReadConst ast
bc 		10
10 		35.03
31.45 		0
-10 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
ArrayWriteConstConst ast
bc 		10
10 		40.18
39.51 		0
-2 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
BlockSend0ConstReturn ast
bc 		10
10 		76.17
117.51 		0
54 		35MB
108MB 		0
205 		0
0 		0
0 		0
0 		0
0
Const ast
bc 		10
10 		18.84
22.16 		0
18 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
FieldConstWrite ast
bc 		10
10 		23.88
18.82 		0
-21 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
FieldRead ast
bc 		10
10 		16.03
18.85 		0
18 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
FieldReadIncWrite ast
bc 		10
10 		48.36
23.65 		0
-51 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
FieldReadWrite ast
bc 		10
10 		23.53
20.46 		0
-13 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
GlobalRead ast
bc 		10
10 		28.57
31.62 		0
11 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
LocalConstWrite ast
bc 		10
10 		22.79
19.06 		0
-16 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
LocalRead ast
bc 		10
10 		16.84
18.42 		0
9 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
LocalReadIncWrite ast
bc 		10
10 		36.95
21.64 		0
-41 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
LocalReadWrite ast
bc 		10
10 		21.08
19.58 		0
-7 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
SelfSend0 ast
bc 		10
10 		45.55
63.33 		0
39 		2MB
56MB 		0
2283 		0
0 		0
0 		0
0 		0
0
SelfSend0BlockConstNonLocalReturn ast
bc 		10
10 		127.52
150.43 		0
18 		54MB
122MB 		0
125 		0
0 		0
0 		0
0 		0
0

macro

Baseline: som-rs-ast

Exe #M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
DeltaBlue ast
bc 		10
1 		12.25
0.00 		0
-100 		2MB
0b 		0
-100 		0
0 		0
0 		0
0 		0
0
GraphSearch ast
bc 		10
10 		53.61
53.40 		0
0 		9MB
17MB 		0
91 		0
0 		0
0 		0
0 		0
0
JsonSmall ast
bc 		10
10 		14.71
14.05 		0
-4 		2MB
4MB 		0
143 		0
0 		0
0 		0
0 		0
0
NBody ast
bc 		10
10 		31.39
42.89 		0
37 		660kb
25MB 		0
3725 		0
0 		0
0 		0
0 		0
0
PageRank ast
bc 		10
10 		63.82
57.36 		0
-10 		5MB
9MB 		0
67 		0
0 		0
0 		0
0 		0
0
Richards ast
bc 		10
10 		258.44
276.33 		0
7 		26MB
44MB 		0
70 		0
1 		0
0 		0
2867 		0
0

micro

Baseline: som-rs-ast

Exe #M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
Bounce ast
bc 		10
10 		84.57
85.03 		0
1 		17MB
53MB 		0
212 		0
0 		0
0 		0
0 		0
0
BubbleSort ast
bc 		10
10 		92.34
83.02 		0
-10 		13MB
47MB 		0
259 		0
0 		0
0 		0
0 		0
0
Dispatch ast
bc 		10
10 		30.45
27.73 		0
-9 		8MB
17MB 		0
121 		0
0 		0
0 		0
0 		0
0
Fannkuch ast
bc 		10
10 		33.57
29.41 		0
-12 		4MB
9MB 		0
148 		0
0 		0
0 		0
0 		0
0
Fibonacci ast
bc 		10
10 		165.88
123.64 		0
-25 		40MB
93MB 		0
135 		0
0 		0
0 		0
0 		0
0
FieldLoop ast
bc 		10
10 		48.26
23.40 		0
-52 		2MB
9MB 		0
276 		0
0 		0
0 		0
0 		0
0
IntegerLoop ast
bc 		10
10 		1562.72
5184.24 		0
232 		20MB
71MB 		0
264 		6
29 		0
383 		9060
28762 		0
217
List ast
bc 		10
10 		13.57
19.75 		0
46 		692kb
14MB 		0
1941 		0
0 		0
0 		0
0 		0
0
Loop ast
bc 		10
10 		118.80
68.03 		0
-43 		988kb
3MB 		0
181 		0
0 		0
0 		0
0 		0
0
Permute ast
bc 		10
10 		80.02
104.15 		0
30 		15MB
69MB 		0
354 		0
0 		0
0 		0
0 		0
0
Queens ast
bc 		10
10 		93.52
95.94 		0
3 		17MB
52MB 		0
199 		0
0 		0
0 		0
0 		0
0
QuickSort ast
bc 		10
10 		60.39
56.55 		0
-6 		8MB
23MB 		0
178 		0
0 		0
0 		0
0 		0
0
Recurse ast
bc 		10
10 		162.46
148.54 		0
-9 		31MB
107MB 		0
245 		0
0 		0
0 		0
0 		0
0
Sieve ast
bc 		10
10 		107.69
87.56 		0
-19 		16MB
40MB 		0
142 		0
0 		0
0 		0
0 		0
0
Storage ast
bc 		10
10 		52.35
46.86 		0
-10 		10MB
29MB 		0
181 		0
0 		0
0 		0
0 		0
0
Sum ast
bc 		10
10 		42.86
44.64 		0
4 		0b
32kb 		0
0 		0
0 		0
0 		0
0 		0
0
Towers ast
bc 		10
10 		29.12
31.31 		0
8 		4MB
22MB 		0
425 		0
0 		0
0 		0
0 		0
0
TreeSort ast
bc 		10
10 		41.91
48.57 		0
16 		8MB
31MB 		0
289 		0
0 		0
0 		0
0 		0
0
WhileLoop ast
bc 		10
10 		46.08
33.97 		0
-26 		32kb
68kb 		0
113 		0
0 		0
0 		0
0 		0
0

micro-som-rs

Baseline: som-rs-ast

Exe #M median time
in ms		 time diff % median allocated
in bytes		 allocated diff % median GC count
in n		 GC count diff % median GC
in ms		 GC diff %
Mandelbrot ast
bc 		10
10 		77.92
59.97 		0
-23 		6MB
22MB 		0
240 		0
0 		0
0 		0
0 		0
0