|

»

Mozilla - Performance

Condensed error logs from the leak+unit testing tinderboxes -> analysis needed

View: New views

7 Messages — Rating Filter: Alert me

	Condensed error logs from the leak+unit testing tinderboxes -> analysis needed by Chris Cooper-2 :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message We've had tinderboxes setup for a while now (~3 months) that create debug builds and then run the full suite of unit tests on them with leak and bloat logging enabled. We currently have a CentOS and MacOSX box running in this config, with 2 Windows machines waiting on increasing logging capacity. These machines (qm-leak-centos5-01 and qm-leak-macosx-01) are currently reporting to the MozillaTest tinderbox tree: http://tinderbox.mozilla.org/showbuilds.cgi?tree=MozillaTest There was a great clamor in the Fall of 2007 to get these machines setup, but no one seems to have looked at them since, or at least I haven't received any feedback about them. I figure either: a) no one has had time to look, b) the data they are providing is no good, or c) the need has gone away. On the off-chance that it's option a), I went through a day's worth of tinderbox logs from each platform about a week ago and parsed out the relevant error message to make it more manageable for someone to glance at. This more compact analysis is here: http://wiki.mozilla.org/User:ChrisCooper:UnittestingLeakAnalysis If someone with more knowledge about the unit tests can have a quick look at the failures, it would be appreciated. I'd love to knock out any spurious failures and have the data be more meaningful, and maybe even have people start looking at the leak/bloat data from these boxes too. cheers, -- coop _______________________________________________ dev-performance mailing list dev-performance@... https://lists.mozilla.org/listinfo/dev-performance
	Re: Condensed error logs from the leak+unit testing tinderboxes -> analysis needed by Boris Zbarsky :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message Chris Cooper wrote: > http://wiki.mozilla.org/User:ChrisCooper:UnittestingLeakAnalysis > > If someone with more knowledge about the unit tests can have a quick > look at the failures, it would be appreciated. Please get a bug filed on that fastload file thing? That should get fixed.. -Boris _______________________________________________ dev-performance mailing list dev-performance@... https://lists.mozilla.org/listinfo/dev-performance
	Re: Condensed error logs from the leak+unit testing tinderboxes -> analysis needed by L. David Baron :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message On Monday 2008-03-03 14:35 -0500, Chris Cooper wrote: > a) no one has had time to look, I did look once, but they weren't actually on tinderbox when I looked, and I didn't have time to figure out who I should bug about that. (I think once they were actually explicitly hidden by the tinderbox admin UI, and I unhid them.) I think one of the issues with them is that we're trying to add multiple new conditions for orange/red all at the same time, and it might be more practical to add them in steps, as we can get things green. That said, it may well not be that much work to get them green. It might also be helpful to have separate test tinderbox trees for different things rather than using MozillaTest for everything so we can load a page showing just these boxes. -David -- L. David Baron http://dbaron.org/ Mozilla Corporation http://www.mozilla.com/ _______________________________________________ dev-performance mailing list dev-performance@... https://lists.mozilla.org/listinfo/dev-performance
	Re: Condensed error logs from the leak+unit testing tinderboxes -> analysis needed by L. David Baron :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message On Monday 2008-03-03 13:01 -0800, L. David Baron wrote: > I think one of the issues with them is that we're trying to add > multiple new conditions for orange/red all at the same time, and it > might be more practical to add them in steps, as we can get things > green. That said, it may well not be that much work to get them > green. For example, if most of the failures are because assertions are fatal (I don't know whether this is the case), perhaps we could have code that counts the number of assertions in the log and shows it in the tinderbox display (and maybe turns things orange if it's greater than a fixed number in the config that we could lower as we fix them) instead of actually making them turn the tinderbox red for any assertions. -David -- L. David Baron http://dbaron.org/ Mozilla Corporation http://www.mozilla.com/ _______________________________________________ dev-performance mailing list dev-performance@... https://lists.mozilla.org/listinfo/dev-performance
	Re: Condensed error logs from the leak+unit testing tinderboxes -> analysis needed by Chris Cooper-2 :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message Boris Zbarsky wrote: > Chris Cooper wrote: >> http://wiki.mozilla.org/User:ChrisCooper:UnittestingLeakAnalysis >> > Please get a bug filed on that fastload file thing? That should get fixed.. Filed: https://bugzilla.mozilla.org/show_bug.cgi?id=420776 cheers, -- coop _______________________________________________ dev-performance mailing list dev-performance@... https://lists.mozilla.org/listinfo/dev-performance
	Re: Condensed error logs from the leak+unit testing tinderboxes -> analysis needed by L. David Baron :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message On Monday 2008-03-03 14:35 -0500, Chris Cooper wrote: > We've had tinderboxes setup for a while now (~3 months) that create > debug builds and then run the full suite of unit tests on them with leak > and bloat logging enabled. We currently have a CentOS and MacOSX box > running in this config, with 2 Windows machines waiting on increasing > logging capacity. These machines (qm-leak-centos5-01 and > qm-leak-macosx-01) are currently reporting to the MozillaTest tinderbox > tree: > > http://tinderbox.mozilla.org/showbuilds.cgi?tree=MozillaTest They seem to have disappeared. Did they move to another tree, or just stop running for some reason? -David -- L. David Baron http://dbaron.org/ Mozilla Corporation http://www.mozilla.com/ _______________________________________________ dev-performance mailing list dev-performance@... https://lists.mozilla.org/listinfo/dev-performance
	Re: Condensed error logs from the leak+unit testing tinderboxes -> analysis needed by Chris Cooper-2 :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message L. David Baron wrote: > On Monday 2008-03-03 14:35 -0500, Chris Cooper wrote: >> http://tinderbox.mozilla.org/showbuilds.cgi?tree=MozillaTest > > They seem to have disappeared. Did they move to another tree, or > just stop running for some reason? Centos was hung at a login manager prompt during mochitest, and the Mac slave had simply failed to shutdown the browser after the mochitests. I've restarted both slaves. cheers, -- coop _______________________________________________ dev-performance mailing list dev-performance@... https://lists.mozilla.org/listinfo/dev-performance