« Return to Thread: Re: [rvm-core] [rvm-regress] [perf.7688] 12 FAILURES

Re: [rvm-core] [rvm-regress] [perf.7688] 12 FAILURES

by Filip Pizlo-2 :: Rate this Message:

Reply to Author | View in Thread

This is the problem with spurious failures. ;-)

It turns out upon further investigation that the same failures are in the original (pre-r15405) native threads code as well.  They happen in 1/5 runs, roughly, based on about 20 runs on each revision.

So we haven't regressed due to my optimization.

-F



On Feb 8, 2009, at 4:40 PM, Filip Pizlo wrote:

As best as I can tell, I'm at fault for the failures.  They don't seem to be due to the original native threads commit but due to the subsequence optimization (r15405).  I'm investigating this now.

This may be tricky to fix, and the optimizations are definitely worth ultimately being in there.  Please advise if I should back out now and then fix, or if I should let it sit there awaiting a fix.

-F



On Feb 8, 2009, at 4:08 PM, [habanero] wrote:

Regression summary for perf (r15406) on habanero.anu.edu.au, Sat Feb 07 23:05:20 UTC 2009

See the Full Report Statistics Report Performance Report

Revisions covered by this test run: 15406

Test Runs covered by this report: perf.7649 (r15379), perf.7652 (r15379), perf.7658 (r15381), perf.7659 (r15387), perf.7666 (r15391), perf.7669 (r15391), perf.7675 (r15397), perf.7677 (r15402), perf.7685 (r15406), perf.7688 (r15406)

Failed 12/436 (2%)

8 new failures this run

production default perf-dacapo eclipse-1 FAILURE Details
production default perf-dacapo eclipse-1 FAILURE Details
production default perf-dacapo lusearch-10 FAILURE Details
production default perf-dacapo lusearch-10 FAILURE Details
production default perf-dacapo lusearch-3 FAILURE Details
production default perf-dacapo lusearch-3GC OVERTIME Details
production default perf-dacapo xalan-3GC FAILURE Details
production default perf-jvm98 javac-10 FAILURE Details

0 missing tests this run

0 new successes this run

23 intermittent failures over this week

0 consistent failures over this week

Performance Statistics

05/02
17:05
05/02
23:05
06/02
05:05
06/02
11:05
06/02
17:05
06/02
23:05
07/02
05:05
07/02
11:05
07/02
17:05
07/02
23:05
Success Rate 431/436 435/436 434/436 431/436 434/436 434/436 431/436 435/436 428/436 424/436

Build Configuration By Test Run

05/02
17:05
05/02
23:05
06/02
05:05
06/02
11:05
06/02
17:05
06/02
23:05
07/02
05:05
07/02
11:05
07/02
17:05
07/02
23:05
production 99% 100% 100% 99% 100% 100% 99% 100% 98% 97%

Test Case By Test Run

05/02
17:05
05/02
23:05
06/02
05:05
06/02
11:05
06/02
17:05
06/02
23:05
07/02
05:05
07/02
11:05
07/02
17:05
07/02
23:05
javac-10 50% 100% 100% 100% 100% 83% 67% 100% 83% 83%
eclipse-1 83% 100% 100% 100% 100% 100% 100% 100% 50% 50%
lusearch-10 100% 100% 83% 100% 100% 100% 83% 100% 83% 50%
javac-3GC 100% 100% 100% 67% 100% 100% 100% 83% 83% 83%
lusearch-3 83% 100% 100% 100% 100% 100% 100% 100% 67% 67%
javac-3 100% 83% 83% 67% 100% 100% 100% 100% 100% 100%
lusearch-3GC 100% 100% 100% 100% 100% 83% 100% 100% 100% 83%
xalan-3GC 100% 100% 100% 100% 100% 100% 83% 100% 100% 83%
javac-1 100% 100% 100% 100% 67% 100% 100% 100% 100% 100%
pmd-1 100% 100% 100% 100% 100% 100% 83% 100% 100% 100%
xalan-1 100% 100% 100% 83% 100% 100% 100% 100% 100% 100%
------------------------------------------------------------------------------
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com_______________________________________________
Jikesrvm-regression mailing list
Jikesrvm-regression@...
https://lists.sourceforge.net/lists/listinfo/jikesrvm-regression

------------------------------------------------------------------------------
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com_______________________________________________
Jikesrvm-core mailing list
Jikesrvm-core@...
https://lists.sourceforge.net/lists/listinfo/jikesrvm-core


------------------------------------------------------------------------------
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com
_______________________________________________
Jikesrvm-core mailing list
Jikesrvm-core@...
https://lists.sourceforge.net/lists/listinfo/jikesrvm-core

 « Return to Thread: Re: [rvm-core] [rvm-regress] [perf.7688] 12 FAILURES