Performance [was: Re: Profiling results for Continuum]

[Emmanuel Venisse-2]

I think I'm on the good way, I found some methods that are very aggressive
with the DB and load lot of build results (all build results for each build
and the project group page) in memory to find some values. This part use lot
of cpu and memory.

I need to refactor them to get minimal datas from the DB so the result would
be better. I hope to do it for the end of the week.

Emmanuel

On Fri, Jun 26, 2009 at 2:20 PM, Marc Lustig <ml@...> wrote:

>
>
>
> Emmanuel Venisse-2 wrote:
> >
> > I'll continue to review the code and when I'll think it is ok, I'll ping
> > you.
> > Will you be able to test a Continuum snapshot on your big DB?
> >
>
> yes, no problem. Let me know where to download the snapshot and I will test
> it.
> --
> View this message in context:
> http://www.nabble.com/Profiling-results-for-Continuum-tp24142787p24219393.html
> Sent from the Continuum - Dev mailing list archive at Nabble.com.
>
>

[Wendy Smoak-3]

Thanks, Emmanuel!  I think I saw one commit already last week... is it
related to this work?

I'd like to gather this up under a JIRA issue, so I'll open a generic
performance improvements issue if there isn't one already.

--
Wendy

On Mon, Jun 29, 2009 at 4:37 AM, Emmanuel
Venisse<emmanuel.venisse@...> wrote:

> I think I'm on the good way, I found some methods that are very aggressive
> with the DB and load lot of build results (all build results for each build
> and the project group page) in memory to find some values. This part use lot
> of cpu and memory.
>
> I need to refactor them to get minimal datas from the DB so the result would
> be better. I hope to do it for the end of the week.
>
> Emmanuel
>
> On Fri, Jun 26, 2009 at 2:20 PM, Marc Lustig <ml@...> wrote:
>
>>
>>
>>
>> Emmanuel Venisse-2 wrote:
>> >
>> > I'll continue to review the code and when I'll think it is ok, I'll ping
>> > you.
>> > Will you be able to test a Continuum snapshot on your big DB?
>> >
>>
>> yes, no problem. Let me know where to download the snapshot and I will test
>> it.
>> --
>> View this message in context:
>> http://www.nabble.com/Profiling-results-for-Continuum-tp24142787p24219393.html
>> Sent from the Continuum - Dev mailing list archive at Nabble.com.
>>
>>
>

[Wendy Smoak-3]

Opened http://jira.codehaus.org/browse/CONTINUUM-2284

--
Wendy

On Mon, Jun 29, 2009 at 1:10 PM, Wendy Smoak<wsmoak@...> wrote:
> Thanks, Emmanuel!  I think I saw one commit already last week... is it
> related to this work?
>
> I'd like to gather this up under a JIRA issue, so I'll open a generic
> performance improvements issue if there isn't one already.

[Emmanuel Venisse-2]

Thanks. I'll link my next commit on it.

All is done but I need to do more tests on my instance.

Emmanuel

On Wed, Jul 1, 2009 at 4:18 PM, Wendy Smoak <wsmoak@...> wrote:

> Opened http://jira.codehaus.org/browse/CONTINUUM-2284
>
> --
> Wendy
>
> On Mon, Jun 29, 2009 at 1:10 PM, Wendy Smoak<wsmoak@...> wrote:
> > Thanks, Emmanuel!  I think I saw one commit already last week... is it
> > related to this work?
> >
> > I'd like to gather this up under a JIRA issue, so I'll open a generic
> > performance improvements issue if there isn't one already.
>

[Emmanuel Venisse-2]

Commit is done, I'll merge it in trunk later.

This commit should improve performance on vmbuild because I refactored lot
of very big request on BuildResult to small request. With this patch, big
Continuum instances should use less cpu, less memory and I hope it will stop
Continuum restart on vmbuild.

Brett, can you upgrade it on vmbuild?

Emmanuel

On Wed, Jul 1, 2009 at 5:00 PM, Emmanuel Venisse <emmanuel.venisse@...
> wrote:

> Thanks. I'll link my next commit on it.
>
> All is done but I need to do more tests on my instance.
>
> Emmanuel
>
>
> On Wed, Jul 1, 2009 at 4:18 PM, Wendy Smoak <wsmoak@...> wrote:
>
>> Opened http://jira.codehaus.org/browse/CONTINUUM-2284
>>
>> --
>> Wendy
>>
>> On Mon, Jun 29, 2009 at 1:10 PM, Wendy Smoak<wsmoak@...> wrote:
>> > Thanks, Emmanuel!  I think I saw one commit already last week... is it
>> > related to this work?
>> >
>> > I'd like to gather this up under a JIRA issue, so I'll open a generic
>> > performance improvements issue if there isn't one already.
>>
>
>

[brettporter]

On 02/07/2009, at 7:30 AM, Emmanuel Venisse wrote:

> Brett, can you upgrade it on vmbuild?
>

Wendy has been doing these recently so I'll trust her to continue :)

- Brett

[Wendy Smoak-3]

On Wed, Jul 1, 2009 at 2:30 PM, Emmanuel Venisse wrote: > ... can you
upgrade it on vmbuild? Upgraded to 1.3.4-SNAPSHOT r790398 on July 1 (or 2,
depending on where you are. :) ) Thanks for working on this, Emmanuel. --
Wendy
[]

[Emmanuel Venisse-2]

Thanks Wendy.

I found a NPE in mail notifier so it is necessary to deploy an other
snapshot because this NPE is blocker.
Can you do it or explain to me steps to do it?

Emmanuel

On Thu, Jul 2, 2009 at 7:29 AM, Wendy Smoak <wsmoak@...> wrote:

> On Wed, Jul 1, 2009 at 2:30 PM, Emmanuel Venisse wrote: > ... can you
> upgrade it on vmbuild? Upgraded to 1.3.4-SNAPSHOT r790398 on July 1 (or 2,
> depending on where you are. :) ) Thanks for working on this, Emmanuel. --
> Wendy
> []
>

[Marc Lustig]

We would appreciate very much if this issue could be included in release 1.3.4.
Could somebody set the Fix-Version.

thanks...

Wendy Smoak-3 wrote:

Opened http://jira.codehaus.org/browse/CONTINUUM-2284

--
Wendy

On Mon, Jun 29, 2009 at 1:10 PM, Wendy Smoak<[e-mail]> wrote:
> Thanks, Emmanuel!  I think I saw one commit already last week... is it
> related to this work?
>
> I'd like to gather this up under a JIRA issue, so I'll open a generic
> performance improvements issue if there isn't one already.

[Emmanuel Venisse-2]

Done.

Emmanuel

On Thu, Jul 2, 2009 at 11:45 AM, Marc Lustig <ml@...> wrote:

>
>
> We would appreciate very much if this issue could be included in release
> 1.3.4.
> Could somebody set the Fix-Version.
>
> thanks...
>
>
>
> Wendy Smoak-3 wrote:
> >
> > Opened http://jira.codehaus.org/browse/CONTINUUM-2284
> >
> > --
> > Wendy
> >
> > On Mon, Jun 29, 2009 at 1:10 PM, Wendy Smoak<wsmoak@...> wrote:
> >> Thanks, Emmanuel!  I think I saw one commit already last week... is it
> >> related to this work?
> >>
> >> I'd like to gather this up under a JIRA issue, so I'll open a generic
> >> performance improvements issue if there isn't one already.
> >
> >
>
> --
> View this message in context:
> http://www.nabble.com/Performance--was%3A-Re%3A-Profiling-results-for-Continuum--tp24252580p24303992.html
> Sent from the Continuum - Dev mailing list archive at Nabble.com.
>
>

[Emmanuel Venisse-2]

I redeployed a new version (790494) but I don't have privileges to edit
http://cwiki.apache.org/confluence/display/vmbuild/Upgrade+History )

Emmanuel

On Thu, Jul 2, 2009 at 10:28 AM, Emmanuel Venisse <
emmanuel.venisse@...> wrote:

> Thanks Wendy.
>
> I found a NPE in mail notifier so it is necessary to deploy an other
> snapshot because this NPE is blocker.
> Can you do it or explain to me steps to do it?
>
> Emmanuel
>
>
> On Thu, Jul 2, 2009 at 7:29 AM, Wendy Smoak <wsmoak@...> wrote:
>
>> On Wed, Jul 1, 2009 at 2:30 PM, Emmanuel Venisse wrote: > ... can you
>> upgrade it on vmbuild? Upgraded to 1.3.4-SNAPSHOT r790398 on July 1 (or 2,
>> depending on where you are. :) ) Thanks for working on this, Emmanuel. --
>> Wendy
>> []
>>
>
>

[Wendy Smoak-3]

I updated the page.  Brett, can you give Emmanuel access to the
vmbuild wiki?  Thanks, -Wendy

On Thu, Jul 2, 2009 at 4:24 AM, Emmanuel
Venisse<emmanuel.venisse@...> wrote:
> I redeployed a new version (790494) but I don't have privileges to edit
> http://cwiki.apache.org/confluence/display/vmbuild/Upgrade+History )
>
> Emmanuel

[brettporter]

On 03/07/2009, at 1:07 AM, Wendy Smoak wrote:

> I updated the page.  Brett, can you give Emmanuel access to the
> vmbuild wiki?  Thanks, -Wendy

Done (I gave you a bunch of groups you should be in).

>
> On Thu, Jul 2, 2009 at 4:24 AM, Emmanuel
> Venisse<emmanuel.venisse@...> wrote:
>> I redeployed a new version (790494) but I don't have privileges to  
>> edit
>> http://cwiki.apache.org/confluence/display/vmbuild/Upgrade+History )
>>
>> Emmanuel