[kaffe] Benchmarking kaffe using Ashes
Sat, 28 Dec 2002 10:15:57 -0800 (PST)
Content-Type: text/plain; charset=us-ascii
attached you'll find my attempt at writing a FAQ entry
for using the Ashes benchmark suite to test the
performance of kaffe. I hope this helps people without
access to (or need for) SPEC JVM 98 evaluate kaffe's
performance better, and helps us get more reproducible
numbers for decisions regarding performance. Of
course, if someone could put up a nightly performance
test server that fires off a mail to me with the
results, I'd be very happy ;)
Do you Yahoo!?
Yahoo! Mail Plus - Powerful. Affordable. Sign up now.
Content-Type: text/plain; name="FAQ.ashes"
Content-Disposition: inline; filename="FAQ.ashes"
Benchmarking Kaffe using Ashes
Author: Dalibor Topic <email@example.com>
Q: What is Ashes ?
A: Ashes is a freely redistributable collection of Java benchmarks and
Q: Where can I get it ?
A: Ashes is available for download at:
You'll need to download ashesBase-21Mar2000.tar.gz and
ashesSuiteCollection.tar.gz and unpack them in a directory.
Then you need to set a few environment variables. How you set
environment variables depends on your shell. It's export VAR=value in
bash. Use absolute paths because some Ashes scripts will fail when you
use relative paths.
Read the file index.html in the ashesBase directory for more
information on installing and using Ashes.
Before you start, you need to make sure that the java command actually
invokes kaffe on your system. If it doesn't, set
You need to copy a benchmark from the Ashes suite collection to the
current directory first. I'll use achesEasyTestSuite in this
example. Look into ashesSuiteCollection/suites for more test suites.
You should have an ashesEasyTestSuite directory in your current
applyCmdOnSuite executeBenchmark ashesEasyTestSuite
runs each benchmark exactly once. You can check if your checkout works
that way. You should not get any
*** Warning: Benchmark ran incorrectly! ***
messages. If you do, please make sure that java invokes kaffe. java
-fullversion will give you information on kaffe.
Now that you've got the benchmark set up, you can do some real
benchmarking. timeBenchmark runs a benchmark ten times and prints the
applyCmdOnSuite timeBenchmark ashesEasyTestSuite > results.txt