« Return to Thread: [rvm-research] Looking for Sources of Performance Variation
Re: [rvm-research] Looking for Sources of Performance Variation
by Rhodes Brown
::
Rate this Message:
I have been informed that the slides I posted earlier do not display
properly in some versions of Adobe's PDF reader. I seem to have found
a fix and have reposted a new version at the same address:
http://webhome.cs.uvic.ca/~rhodesb/research/JikesRVM_Performance.pdf
For those interested in the statistical data, I collected the
following while regenerating the graphs. The results are over
repetitions 2-11, 12-21, and 22-31 of each execution (the first
repetition is ignored). The number of values sampled is in brackets
[n]. The 'a' value is the arithmetic mean. The 'm' value the median.
The 's' value the standard deviation. I found lusearch prone to
crashing, so more results were gathered for it. Note, as Christian
observed, the variance for fop (and others) is >10% depending on how
you measure.
antlr:
2-11: [100] a=3251.6, m=3184.5, s=336.136927
12-21: [100] a=2989.7, m=2919.5, s=306.256151
22-31: [100] a=2920.7, m=2904.5, s=274.450190
best: [10] a=2606.6, m=2605.5, s=30.434629
bloat:
2-11: [100] a=8776.9, m=8705.5, s=482.546524
12-21: [100] a=8396.5, m=8427.0, s=257.124797
22-31: [100] a=8358.3, m=8382.5, s=257.532937
best: [10] a=8147.8, m=8143.0, s=213.404571
chart:
2-11: [100] a=8935.3, m=8905.0, s=132.823365
12-21: [100] a=8851.0, m=8847.0, s=62.234483
22-31: [100] a=8859.2, m=8831.5, s=157.648035
best: [10] a=8773.3, m=8764.5, s=37.016663
eclipse:
2-11: [100] a=44795.4, m=44741.0, s=1590.573083
12-21: [100] a=43536.6, m=43648.0, s=1156.725204
22-31: [100] a=43182.5, m=43319.5, s=1363.051853
best: [10] a=40892.5, m=40705.0, s=539.081575
fop:
2-11: [100] a=1988.8, m=1926.0, s=222.580491
12-21: [100] a=1829.0, m=1770.5, s=174.642636
22-31: [100] a=1867.5, m=1761.5, s=419.558799
best: [10] a=1713.6, m=1716.0, s=16.714598
hsqldb:
2-11: [100] a=2827.3, m=2664.0, s=566.212160
12-21: [100] a=2457.0, m=2427.5, s=200.933126
22-31: [100] a=2395.0, m=2338.5, s=330.049919
best: [10] a=2228.8, m=2224.5, s=37.389244
jython:
2-11: [100] a=7245.7, m=7108.0, s=596.781056
12-21: [100] a=6482.6, m=6459.5, s=189.876568
22-31: [100] a=6328.3, m=6296.5, s=217.743325
best: [10] a=6218.3, m=6235.5, s=90.553913
luindex:
2-11: [100] a=11123.1, m=11052.0, s=468.323222
12-21: [100] a=10768.1, m=10705.5, s=344.060171
22-31: [100] a=10793.2, m=10783.5, s=327.755937
best: [10] a=10402.5, m=10399.5, s=88.545343
lusearch:
2-11: [120] a=4796.4, m=4626.5, s=433.733814
12-21: [120] a=4563.7, m=4505.0, s=172.024492
22-31: [120] a=4497.0, m=4476.0, s=167.335591
best: [12] a=4385.9, m=4409.5, s=92.450929
pmd:
2-11: [100] a=5268.2, m=5267.0, s=216.365668
12-21: [100] a=4979.9, m=4972.5, s=109.359262
22-31: [100] a=4942.5, m=4931.5, s=121.922934
best: [10] a=4808.6, m=4801.0, s=68.839911
xalan:
2-11: [100] a=6555.6, m=6417.5, s=382.274297
12-21: [100] a=6105.0, m=6099.0, s=208.984870
22-31: [100] a=5879.5, m=5867.5, s=139.621307
best: [10] a=5731.3, m=5735.5, s=72.657568
compress:
2-11: [100] a=4492.4, m=4453.5, s=116.976746
12-21: [100] a=4506.5, m=4475.5, s=123.351381
22-31: [100] a=4521.9, m=4501.0, s=123.614577
best: [10] a=4408.5, m=4390.5, s=59.716460
jess:
2-11: [100] a=1360.3, m=1349.0, s=48.228056
12-21: [100] a=1314.4, m=1307.0, s=49.882216
22-31: [100] a=1306.6, m=1309.0, s=26.932634
best: [10] a=1284.8, m=1285.0, s=16.949598
db:
2-11: [100] a=7855.5, m=7850.0, s=31.798753
12-21: [100] a=7871.3, m=7865.0, s=43.456202
22-31: [100] a=7868.2, m=7861.5, s=44.100235
best: [10] a=7805.8, m=7801.5, s=17.510632
javac:
2-11: [100] a=3755.7, m=3701.0, s=252.211086
12-21: [100] a=3422.6, m=3427.5, s=65.167588
22-31: [100] a=3334.0, m=3324.0, s=83.624452
best: [10] a=3268.0, m=3266.0, s=33.986926
mpegaudio:
2-11: [100] a=2927.5, m=2933.0, s=45.364823
12-21: [100] a=2918.1, m=2926.0, s=27.107856
22-31: [100] a=2940.8, m=2950.0, s=32.512405
best: [10] a=2857.7, m=2865.0, s=37.425630
mtrt:
2-11: [100] a=1122.4, m=1110.0, s=70.875478
12-21: [100] a=1052.6, m=1050.0, s=38.076503
22-31: [100] a=1054.0, m=1052.0, s=41.170495
best: [10] a=989.0, m=996.5, s=21.192242
jack:
2-11: [100] a=2923.7, m=2912.0, s=62.005226
12-21: [100] a=2847.2, m=2824.0, s=77.455152
22-31: [100] a=2812.3, m=2808.5, s=42.403597
best: [10] a=2780.6, m=2776.5, s=25.915246
Rhodes Brown
Instructor & Ph.D. Candidate in Computer Science
University of Victoria - Victoria, BC, Canada
http://www.cs.uvic.ca
------------------------------------------------------------------------------
The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your
production scanning environment may not be a perfect world - but thanks to
Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700
Series Scanner you'll get full speed at 300 dpi even with all image
processing features enabled. http://p.sf.net/sfu/kodak-com
_______________________________________________
Jikesrvm-researchers mailing list
Jikesrvm-researchers@...
https://lists.sourceforge.net/lists/listinfo/jikesrvm-researchers
properly in some versions of Adobe's PDF reader. I seem to have found
a fix and have reposted a new version at the same address:
http://webhome.cs.uvic.ca/~rhodesb/research/JikesRVM_Performance.pdf
For those interested in the statistical data, I collected the
following while regenerating the graphs. The results are over
repetitions 2-11, 12-21, and 22-31 of each execution (the first
repetition is ignored). The number of values sampled is in brackets
[n]. The 'a' value is the arithmetic mean. The 'm' value the median.
The 's' value the standard deviation. I found lusearch prone to
crashing, so more results were gathered for it. Note, as Christian
observed, the variance for fop (and others) is >10% depending on how
you measure.
antlr:
2-11: [100] a=3251.6, m=3184.5, s=336.136927
12-21: [100] a=2989.7, m=2919.5, s=306.256151
22-31: [100] a=2920.7, m=2904.5, s=274.450190
best: [10] a=2606.6, m=2605.5, s=30.434629
bloat:
2-11: [100] a=8776.9, m=8705.5, s=482.546524
12-21: [100] a=8396.5, m=8427.0, s=257.124797
22-31: [100] a=8358.3, m=8382.5, s=257.532937
best: [10] a=8147.8, m=8143.0, s=213.404571
chart:
2-11: [100] a=8935.3, m=8905.0, s=132.823365
12-21: [100] a=8851.0, m=8847.0, s=62.234483
22-31: [100] a=8859.2, m=8831.5, s=157.648035
best: [10] a=8773.3, m=8764.5, s=37.016663
eclipse:
2-11: [100] a=44795.4, m=44741.0, s=1590.573083
12-21: [100] a=43536.6, m=43648.0, s=1156.725204
22-31: [100] a=43182.5, m=43319.5, s=1363.051853
best: [10] a=40892.5, m=40705.0, s=539.081575
fop:
2-11: [100] a=1988.8, m=1926.0, s=222.580491
12-21: [100] a=1829.0, m=1770.5, s=174.642636
22-31: [100] a=1867.5, m=1761.5, s=419.558799
best: [10] a=1713.6, m=1716.0, s=16.714598
hsqldb:
2-11: [100] a=2827.3, m=2664.0, s=566.212160
12-21: [100] a=2457.0, m=2427.5, s=200.933126
22-31: [100] a=2395.0, m=2338.5, s=330.049919
best: [10] a=2228.8, m=2224.5, s=37.389244
jython:
2-11: [100] a=7245.7, m=7108.0, s=596.781056
12-21: [100] a=6482.6, m=6459.5, s=189.876568
22-31: [100] a=6328.3, m=6296.5, s=217.743325
best: [10] a=6218.3, m=6235.5, s=90.553913
luindex:
2-11: [100] a=11123.1, m=11052.0, s=468.323222
12-21: [100] a=10768.1, m=10705.5, s=344.060171
22-31: [100] a=10793.2, m=10783.5, s=327.755937
best: [10] a=10402.5, m=10399.5, s=88.545343
lusearch:
2-11: [120] a=4796.4, m=4626.5, s=433.733814
12-21: [120] a=4563.7, m=4505.0, s=172.024492
22-31: [120] a=4497.0, m=4476.0, s=167.335591
best: [12] a=4385.9, m=4409.5, s=92.450929
pmd:
2-11: [100] a=5268.2, m=5267.0, s=216.365668
12-21: [100] a=4979.9, m=4972.5, s=109.359262
22-31: [100] a=4942.5, m=4931.5, s=121.922934
best: [10] a=4808.6, m=4801.0, s=68.839911
xalan:
2-11: [100] a=6555.6, m=6417.5, s=382.274297
12-21: [100] a=6105.0, m=6099.0, s=208.984870
22-31: [100] a=5879.5, m=5867.5, s=139.621307
best: [10] a=5731.3, m=5735.5, s=72.657568
compress:
2-11: [100] a=4492.4, m=4453.5, s=116.976746
12-21: [100] a=4506.5, m=4475.5, s=123.351381
22-31: [100] a=4521.9, m=4501.0, s=123.614577
best: [10] a=4408.5, m=4390.5, s=59.716460
jess:
2-11: [100] a=1360.3, m=1349.0, s=48.228056
12-21: [100] a=1314.4, m=1307.0, s=49.882216
22-31: [100] a=1306.6, m=1309.0, s=26.932634
best: [10] a=1284.8, m=1285.0, s=16.949598
db:
2-11: [100] a=7855.5, m=7850.0, s=31.798753
12-21: [100] a=7871.3, m=7865.0, s=43.456202
22-31: [100] a=7868.2, m=7861.5, s=44.100235
best: [10] a=7805.8, m=7801.5, s=17.510632
javac:
2-11: [100] a=3755.7, m=3701.0, s=252.211086
12-21: [100] a=3422.6, m=3427.5, s=65.167588
22-31: [100] a=3334.0, m=3324.0, s=83.624452
best: [10] a=3268.0, m=3266.0, s=33.986926
mpegaudio:
2-11: [100] a=2927.5, m=2933.0, s=45.364823
12-21: [100] a=2918.1, m=2926.0, s=27.107856
22-31: [100] a=2940.8, m=2950.0, s=32.512405
best: [10] a=2857.7, m=2865.0, s=37.425630
mtrt:
2-11: [100] a=1122.4, m=1110.0, s=70.875478
12-21: [100] a=1052.6, m=1050.0, s=38.076503
22-31: [100] a=1054.0, m=1052.0, s=41.170495
best: [10] a=989.0, m=996.5, s=21.192242
jack:
2-11: [100] a=2923.7, m=2912.0, s=62.005226
12-21: [100] a=2847.2, m=2824.0, s=77.455152
22-31: [100] a=2812.3, m=2808.5, s=42.403597
best: [10] a=2780.6, m=2776.5, s=25.915246
Rhodes Brown
Instructor & Ph.D. Candidate in Computer Science
University of Victoria - Victoria, BC, Canada
http://www.cs.uvic.ca
------------------------------------------------------------------------------
The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your
production scanning environment may not be a perfect world - but thanks to
Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700
Series Scanner you'll get full speed at 300 dpi even with all image
processing features enabled. http://p.sf.net/sfu/kodak-com
_______________________________________________
Jikesrvm-researchers mailing list
Jikesrvm-researchers@...
https://lists.sourceforge.net/lists/listinfo/jikesrvm-researchers
« Return to Thread: [rvm-research] Looking for Sources of Performance Variation
| Free embeddable forum powered by Nabble | Forum Help |
