Re: [rvm-core] [rvm-regress] [perf.7712] 33 FAILURES

View: New views
6 Messages — Rating Filter:   Alert me  

Parent Message unknown Re: [rvm-core] [rvm-regress] [perf.7712] 33 FAILURES

by Filip Pizlo-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

This is weird.  I've been running luindex in a loop and cannot reproduce these failures.  Habanero is a 4-proc, right?  Would it be safe for me to run some tests on there directly?  My attempts to repro the failure on similar machines have not been successful.

-F



On Feb 9, 2009, at 22:07 , [habanero] wrote:

Regression summary for perf (r15409) on habanero.anu.edu.au, Mon Feb 09 05:05:13 UTC 2009

See the Full Report Statistics Report Performance Report

Revisions covered by this test run: 15409

Test Runs covered by this report: perf.7669 (r15391), perf.7675 (r15397), perf.7677 (r15402), perf.7685 (r15406), perf.7688 (r15406), perf.7692 (r15406), perf.7694 (r15406), perf.7702 (r15409), perf.7707 (r15409), perf.7712 (r15409)

Failed 33/436 (7%)

0 new failures this run

0 missing tests this run

0 new successes this run

58 intermittent failures over this week

0 consistent failures over this week

Performance Statistics

06/02 07/02
05:05
07/02
11:05
07/02
17:05
07/02
23:05
08/02
05:05
08/02
11:05
08/02
17:05
08/02
23:05
09/02
Success Rate 434/436 431/436 435/436 428/436 424/436 426/436 433/436 404/436 404/436 403/436

Build Configuration By Test Run

06/02 07/02
05:05
07/02
11:05
07/02
17:05
07/02
23:05
08/02
05:05
08/02
11:05
08/02
17:05
08/02
23:05
09/02
production 100% 99% 100% 98% 97% 98% 99% 93% 93% 92%

Test Case By Test Run

06/02 07/02
05:05
07/02
11:05
07/02
17:05
07/02
23:05
08/02
05:05
08/02
11:05
08/02
17:05
08/02
23:05
09/02
luindex-1 100% 100% 100% 100% 100% 100% 100% 0% 0% 0%
luindex-10 100% 100% 100% 100% 100% 100% 100% 0% 0% 0%
luindex-3 100% 100% 100% 100% 100% 100% 100% 0% 0% 0%
luindex-3GC 100% 100% 100% 100% 100% 100% 100% 0% 0% 0%
lusearch-10 100% 83% 100% 83% 50% 83% 67% 33% 50% 83%
eclipse-1 100% 100% 100% 50% 50% 0% 83% 100% 100% 83%
lusearch-3 100% 100% 100% 67% 67% 83% 100% 67% 67% 33%
javac-10 83% 67% 100% 83% 83% 100% 100% 83% 100% 83%
javac-3GC 100% 100% 83% 83% 83% 83% 100% 100% 100% 100%
javac-3 100% 100% 100% 100% 100% 83% 100% 100% 67% 83%
xalan-3GC 100% 83% 100% 100% 83% 100% 100% 83% 100% 100%
javac-1 100% 100% 100% 100% 100% 100% 100% 100% 83% 83%
lusearch-3GC 83% 100% 100% 100% 83% 100% 100% 100% 100% 100%
pmd-1 100% 83% 100% 100% 100% 100% 100% 100% 100% 100%
------------------------------------------------------------------------------
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com_______________________________________________
Jikesrvm-regression mailing list
Jikesrvm-regression@...
https://lists.sourceforge.net/lists/listinfo/jikesrvm-regression


------------------------------------------------------------------------------
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com
_______________________________________________
Jikesrvm-core mailing list
Jikesrvm-core@...
https://lists.sourceforge.net/lists/listinfo/jikesrvm-core

Re: [rvm-core] [rvm-regress] [perf.7712] 33 FAILURES

by Steve Blackburn :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Fil,

Habanero should be "identical" to lynx and coyote at ANU (which you have access to).   If you can't repeat the problem on those machines, then you can run on habanero, but it will disturb our performance runs, which is not a calamity, but generally not a good thing.

Cheers,

--Steve  

On 09/02/2009, at 10:11 PM, Filip Pizlo wrote:

This is weird.  I've been running luindex in a loop and cannot reproduce these failures.  Habanero is a 4-proc, right?  Would it be safe for me to run some tests on there directly?  My attempts to repro the failure on similar machines have not been successful.

-F



On Feb 9, 2009, at 22:07 , [habanero] wrote:

Regression summary for perf (r15409) on habanero.anu.edu.au, Mon Feb 09 05:05:13 UTC 2009

See the Full Report Statistics Report Performance Report

Revisions covered by this test run: 15409

Test Runs covered by this report: perf.7669 (r15391), perf.7675 (r15397), perf.7677 (r15402), perf.7685 (r15406), perf.7688 (r15406), perf.7692 (r15406), perf.7694 (r15406), perf.7702 (r15409), perf.7707 (r15409), perf.7712 (r15409)

Failed 33/436 (7%)

0 new failures this run

0 missing tests this run

0 new successes this run

58 intermittent failures over this week

0 consistent failures over this week

Performance Statistics

06/02 07/02
05:05
07/02
11:05
07/02
17:05
07/02
23:05
08/02
05:05
08/02
11:05
08/02
17:05
08/02
23:05
09/02
Success Rate 434/436 431/436 435/436 428/436 424/436 426/436 433/436 404/436 404/436 403/436

Build Configuration By Test Run

06/02 07/02
05:05
07/02
11:05
07/02
17:05
07/02
23:05
08/02
05:05
08/02
11:05
08/02
17:05
08/02
23:05
09/02
production 100% 99% 100% 98% 97% 98% 99% 93% 93% 92%

Test Case By Test Run

06/02 07/02
05:05
07/02
11:05
07/02
17:05
07/02
23:05
08/02
05:05
08/02
11:05
08/02
17:05
08/02
23:05
09/02
luindex-1 100% 100% 100% 100% 100% 100% 100% 0% 0% 0%
luindex-10 100% 100% 100% 100% 100% 100% 100% 0% 0% 0%
luindex-3 100% 100% 100% 100% 100% 100% 100% 0% 0% 0%
luindex-3GC 100% 100% 100% 100% 100% 100% 100% 0% 0% 0%
lusearch-10 100% 83% 100% 83% 50% 83% 67% 33% 50% 83%
eclipse-1 100% 100% 100% 50% 50% 0% 83% 100% 100% 83%
lusearch-3 100% 100% 100% 67% 67% 83% 100% 67% 67% 33%
javac-10 83% 67% 100% 83% 83% 100% 100% 83% 100% 83%
javac-3GC 100% 100% 83% 83% 83% 83% 100% 100% 100% 100%
javac-3 100% 100% 100% 100% 100% 83% 100% 100% 67% 83%
xalan-3GC 100% 83% 100% 100% 83% 100% 100% 83% 100% 100%
javac-1 100% 100% 100% 100% 100% 100% 100% 100% 83% 83%
lusearch-3GC 83% 100% 100% 100% 83% 100% 100% 100% 100% 100%
pmd-1 100% 83% 100% 100% 100% 100% 100% 100% 100% 100%
------------------------------------------------------------------------------
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com_______________________________________________
Jikesrvm-regression mailing list
Jikesrvm-regression@...
https://lists.sourceforge.net/lists/listinfo/jikesrvm-regression

------------------------------------------------------------------------------
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com_______________________________________________
Jikesrvm-core mailing list
Jikesrvm-core@...
https://lists.sourceforge.net/lists/listinfo/jikesrvm-core


------------------------------------------------------------------------------
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com
_______________________________________________
Jikesrvm-core mailing list
Jikesrvm-core@...
https://lists.sourceforge.net/lists/listinfo/jikesrvm-core

Re: [rvm-core] [rvm-regress] [perf.7712] 33 FAILURES

by Filip Pizlo-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Yeah, I cannot repro on coyote.  I'll tool around with it some more before I go to habanero.

I'll give a heads-up if/when I run on habanero so that we know that perf runs will be disturbed.

-F



On Feb 9, 2009, at 22:14 , Steve Blackburn wrote:

Fil,

Habanero should be "identical" to lynx and coyote at ANU (which you have access to).   If you can't repeat the problem on those machines, then you can run on habanero, but it will disturb our performance runs, which is not a calamity, but generally not a good thing.

Cheers,

--Steve  

On 09/02/2009, at 10:11 PM, Filip Pizlo wrote:

This is weird.  I've been running luindex in a loop and cannot reproduce these failures.  Habanero is a 4-proc, right?  Would it be safe for me to run some tests on there directly?  My attempts to repro the failure on similar machines have not been successful.

-F



On Feb 9, 2009, at 22:07 , [habanero] wrote:

Regression summary for perf (r15409) on habanero.anu.edu.au, Mon Feb 09 05:05:13 UTC 2009

See the Full Report Statistics Report Performance Report

Revisions covered by this test run: 15409

Test Runs covered by this report: perf.7669 (r15391), perf.7675 (r15397), perf.7677 (r15402), perf.7685 (r15406), perf.7688 (r15406), perf.7692 (r15406), perf.7694 (r15406), perf.7702 (r15409), perf.7707 (r15409), perf.7712 (r15409)

Failed 33/436 (7%)

0 new failures this run

0 missing tests this run

0 new successes this run

58 intermittent failures over this week

0 consistent failures over this week

Performance Statistics

06/02 07/02
05:05
07/02
11:05
07/02
17:05
07/02
23:05
08/02
05:05
08/02
11:05
08/02
17:05
08/02
23:05
09/02
Success Rate 434/436 431/436 435/436 428/436 424/436 426/436 433/436 404/436 404/436 403/436

Build Configuration By Test Run

06/02 07/02
05:05
07/02
11:05
07/02
17:05
07/02
23:05
08/02
05:05
08/02
11:05
08/02
17:05
08/02
23:05
09/02
production 100% 99% 100% 98% 97% 98% 99% 93% 93% 92%

Test Case By Test Run

06/02 07/02
05:05
07/02
11:05
07/02
17:05
07/02
23:05
08/02
05:05
08/02
11:05
08/02
17:05
08/02
23:05
09/02
luindex-1 100% 100% 100% 100% 100% 100% 100% 0% 0% 0%
luindex-10 100% 100% 100% 100% 100% 100% 100% 0% 0% 0%
luindex-3 100% 100% 100% 100% 100% 100% 100% 0% 0% 0%
luindex-3GC 100% 100% 100% 100% 100% 100% 100% 0% 0% 0%
lusearch-10 100% 83% 100% 83% 50% 83% 67% 33% 50% 83%
eclipse-1 100% 100% 100% 50% 50% 0% 83% 100% 100% 83%
lusearch-3 100% 100% 100% 67% 67% 83% 100% 67% 67% 33%
javac-10 83% 67% 100% 83% 83% 100% 100% 83% 100% 83%
javac-3GC 100% 100% 83% 83% 83% 83% 100% 100% 100% 100%
javac-3 100% 100% 100% 100% 100% 83% 100% 100% 67% 83%
xalan-3GC 100% 83% 100% 100% 83% 100% 100% 83% 100% 100%
javac-1 100% 100% 100% 100% 100% 100% 100% 100% 83% 83%
lusearch-3GC 83% 100% 100% 100% 83% 100% 100% 100% 100% 100%
pmd-1 100% 83% 100% 100% 100% 100% 100% 100% 100% 100%
------------------------------------------------------------------------------
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com_______________________________________________
Jikesrvm-regression mailing list
Jikesrvm-regression@...
https://lists.sourceforge.net/lists/listinfo/jikesrvm-regression

------------------------------------------------------------------------------
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com_______________________________________________
Jikesrvm-core mailing list
Jikesrvm-core@...
https://lists.sourceforge.net/lists/listinfo/jikesrvm-core

------------------------------------------------------------------------------
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com_______________________________________________
Jikesrvm-core mailing list
Jikesrvm-core@...
https://lists.sourceforge.net/lists/listinfo/jikesrvm-core


------------------------------------------------------------------------------
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com
_______________________________________________
Jikesrvm-core mailing list
Jikesrvm-core@...
https://lists.sourceforge.net/lists/listinfo/jikesrvm-core

Parent Message unknown Re: [rvm-core] [rvm-regress] [perf.7712] 33 FAILURES

by Filip Pizlo-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

I cannot confirm the luindex failure on similar machines, but what I do see is a two-fold performance regression on luindex when I go from 15408 to 15409.

Also, 15409 won't build on some of ANU's machines because of some bizarre Classpath error.  Daniel and I will look into it more tomorrow, but for now, I'd say 15409 isn't really the safest revision on the block.

-F



On Feb 9, 2009, at 22:07 , [habanero] wrote:

Regression summary for perf (r15409) on habanero.anu.edu.au, Mon Feb 09 05:05:13 UTC 2009

See the Full Report Statistics Report Performance Report

Revisions covered by this test run: 15409

Test Runs covered by this report: perf.7669 (r15391), perf.7675 (r15397), perf.7677 (r15402), perf.7685 (r15406), perf.7688 (r15406), perf.7692 (r15406), perf.7694 (r15406), perf.7702 (r15409), perf.7707 (r15409), perf.7712 (r15409)

Failed 33/436 (7%)

0 new failures this run

0 missing tests this run

0 new successes this run

58 intermittent failures over this week

0 consistent failures over this week

Performance Statistics

06/02 07/02
05:05
07/02
11:05
07/02
17:05
07/02
23:05
08/02
05:05
08/02
11:05
08/02
17:05
08/02
23:05
09/02
Success Rate 434/436 431/436 435/436 428/436 424/436 426/436 433/436 404/436 404/436 403/436

Build Configuration By Test Run

06/02 07/02
05:05
07/02
11:05
07/02
17:05
07/02
23:05
08/02
05:05
08/02
11:05
08/02
17:05
08/02
23:05
09/02
production 100% 99% 100% 98% 97% 98% 99% 93% 93% 92%

Test Case By Test Run

06/02 07/02
05:05
07/02
11:05
07/02
17:05
07/02
23:05
08/02
05:05
08/02
11:05
08/02
17:05
08/02
23:05
09/02
luindex-1 100% 100% 100% 100% 100% 100% 100% 0% 0% 0%
luindex-10 100% 100% 100% 100% 100% 100% 100% 0% 0% 0%
luindex-3 100% 100% 100% 100% 100% 100% 100% 0% 0% 0%
luindex-3GC 100% 100% 100% 100% 100% 100% 100% 0% 0% 0%
lusearch-10 100% 83% 100% 83% 50% 83% 67% 33% 50% 83%
eclipse-1 100% 100% 100% 50% 50% 0% 83% 100% 100% 83%
lusearch-3 100% 100% 100% 67% 67% 83% 100% 67% 67% 33%
javac-10 83% 67% 100% 83% 83% 100% 100% 83% 100% 83%
javac-3GC 100% 100% 83% 83% 83% 83% 100% 100% 100% 100%
javac-3 100% 100% 100% 100% 100% 83% 100% 100% 67% 83%
xalan-3GC 100% 83% 100% 100% 83% 100% 100% 83% 100% 100%
javac-1 100% 100% 100% 100% 100% 100% 100% 100% 83% 83%
lusearch-3GC 83% 100% 100% 100% 83% 100% 100% 100% 100% 100%
pmd-1 100% 83% 100% 100% 100% 100% 100% 100% 100% 100%
------------------------------------------------------------------------------
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com_______________________________________________
Jikesrvm-regression mailing list
Jikesrvm-regression@...
https://lists.sourceforge.net/lists/listinfo/jikesrvm-regression


------------------------------------------------------------------------------
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com
_______________________________________________
Jikesrvm-core mailing list
Jikesrvm-core@...
https://lists.sourceforge.net/lists/listinfo/jikesrvm-core

Re: [rvm-core] [rvm-regress] [perf.7712] 33 FAILURES

by David P Grove :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Filip Pizlo <pizlo@...> wrote on 02/09/2009 06:11:06 AM:
> This is weird.  I've been running luindex in a loop and cannot
> reproduce these failures.  Habanero is a 4-proc, right?  Would it be
> safe for me to run some tests on there directly?  My attempts to
> repro the failure on similar machines have not been successful.

>
> -F


Hi Fil,

You probably are controlling for this already, but just in case....I think the performance runs on Habanero are using a two-stage build where data files from a profiling run are using to build the final production image that runs the test.  If you are just using a straight production image when attempting to reproduce, that might be why it isn't reproducing.

--dave

------------------------------------------------------------------------------
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com
_______________________________________________
Jikesrvm-core mailing list
Jikesrvm-core@...
https://lists.sourceforge.net/lists/listinfo/jikesrvm-core


Re: [rvm-core] [rvm-regress] [perf.7712] 33 FAILURES

by Filip Pizlo-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Ah, no, I wasn't controlling for that.  Good call.  I'll try that.

-F



On Feb 10, 2009, at 0:43 , David P Grove wrote:

Filip Pizlo <pizlo@...> wrote on 02/09/2009 06:11:06 AM:
> This is weird.  I've been running luindex in a loop and cannot
> reproduce these failures.  Habanero is a 4-proc, right?  Would it be
> safe for me to run some tests on there directly?  My attempts to
> repro the failure on similar machines have not been successful.

>
> -F


Hi Fil,

You probably are controlling for this already, but just in case....I think the performance runs on Habanero are using a two-stage build where data files from a profiling run are using to build the final production image that runs the test.  If you are just using a straight production image when attempting to reproduce, that might be why it isn't reproducing.

--dave

------------------------------------------------------------------------------
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com_______________________________________________
Jikesrvm-core mailing list
Jikesrvm-core@...
https://lists.sourceforge.net/lists/listinfo/jikesrvm-core


------------------------------------------------------------------------------
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com
_______________________________________________
Jikesrvm-core mailing list
Jikesrvm-core@...
https://lists.sourceforge.net/lists/listinfo/jikesrvm-core