More on ASSP memory and OpenVZ

View: New views
5 Messages — Rating Filter:   Alert me  

More on ASSP memory and OpenVZ

by a9k3d :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

My advice to others - beware of running the ASSP beast in a OVZ  
container.

I suspect the unreliability (due to exceeding memory) while running  
ASSP in an OpenVZ virtual is due to the way OVZ treats memory requests.

If, under OVZ, Java asks for all of memory and then some, it will  
survive under Linux but not OVZ. OVZ treats the requested poolsize as  
in use immediately. OVZ doesn't have swap in the virtuals because it  
uses the swap as extra memory for the virtuals.

Running 2.0.1-5.15:
The biggest memory hit I see is rebuilding the SpamDB, about 80 Megs  
(using BerkelyDB). The spamDB is rebuilt within 2 minutes yet the  
allocation lingers on longer.

I've turned off all automatic rebuilding now, to watch for other  
memory pool leakage.

Long run, I'm going to have to migrate to another server or different  
anti-spam strategy.

I really hate spammers. When I think of all antispam work I've had to  
do because of them over the last ten years.

Alan McNeil -- tired sysadmin working too many timezones

------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
_______________________________________________
Assp-test mailing list
Assp-test@...
https://lists.sourceforge.net/lists/listinfo/assp-test

Re: More on ASSP memory and OpenVZ

by Paul Dickson-4 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Why not use a chroot environment?


Paul K. Dickson
Systems Administrator
Frederick County Government, IIT
pdickson@...
301-600-2399/x12399




> From: Alan McNeil <a9k3d@...>
> Reply-To: ASSP development mailing list <assp-test@...>
> Date: Mon, 09 Nov 2009 14:12:31 -0700
> To: ASSP development mailing list <assp-test@...>
> Subject: [Assp-test] More on ASSP memory and OpenVZ
>
> My advice to others - beware of running the ASSP beast in a OVZ
> container.
>
> I suspect the unreliability (due to exceeding memory) while running
> ASSP in an OpenVZ virtual is due to the way OVZ treats memory requests.
>
> If, under OVZ, Java asks for all of memory and then some, it will
> survive under Linux but not OVZ. OVZ treats the requested poolsize as
> in use immediately. OVZ doesn't have swap in the virtuals because it
> uses the swap as extra memory for the virtuals.
>
> Running 2.0.1-5.15:
> The biggest memory hit I see is rebuilding the SpamDB, about 80 Megs
> (using BerkelyDB). The spamDB is rebuilt within 2 minutes yet the
> allocation lingers on longer.
>
> I've turned off all automatic rebuilding now, to watch for other
> memory pool leakage.
>
> Long run, I'm going to have to migrate to another server or different
> anti-spam strategy.
>
> I really hate spammers. When I think of all antispam work I've had to
> do because of them over the last ten years.
>
> Alan McNeil -- tired sysadmin working too many timezones
>
> ------------------------------------------------------------------------------
> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
> trial. Simplify your report design, integration and deployment - and focus on
> what you do best, core application coding. Discover what's new with
> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
> _______________________________________________
> Assp-test mailing list
> Assp-test@...
> https://lists.sourceforge.net/lists/listinfo/assp-test


------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
_______________________________________________
Assp-test mailing list
Assp-test@...
https://lists.sourceforge.net/lists/listinfo/assp-test

Re: More on ASSP memory and OpenVZ

by Маллиндайн Стивен (Steve Mallindine) :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Alan,

If your looking at virtualization, ASSP on Ubuntu server 9.04 guest OS under
VMWare ESXi 4.0 runs fine....


Steve


On 11/10/09 12:12 AM, "Alan McNeil" <a9k3d@...> wrote:

> My advice to others - beware of running the ASSP beast in a OVZ
> container.
>
> I suspect the unreliability (due to exceeding memory) while running
> ASSP in an OpenVZ virtual is due to the way OVZ treats memory requests.
>
> If, under OVZ, Java asks for all of memory and then some, it will
> survive under Linux but not OVZ. OVZ treats the requested poolsize as
> in use immediately. OVZ doesn't have swap in the virtuals because it
> uses the swap as extra memory for the virtuals.
>
> Running 2.0.1-5.15:
> The biggest memory hit I see is rebuilding the SpamDB, about 80 Megs
> (using BerkelyDB). The spamDB is rebuilt within 2 minutes yet the
> allocation lingers on longer.
>
> I've turned off all automatic rebuilding now, to watch for other
> memory pool leakage.
>
> Long run, I'm going to have to migrate to another server or different
> anti-spam strategy.
>
> I really hate spammers. When I think of all antispam work I've had to
> do because of them over the last ten years.
>
> Alan McNeil -- tired sysadmin working too many timezones
>
> ------------------------------------------------------------------------------
> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
> trial. Simplify your report design, integration and deployment - and focus on
> what you do best, core application coding. Discover what's new with
> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
> _______________________________________________
> Assp-test mailing list
> Assp-test@...
> https://lists.sourceforge.net/lists/listinfo/assp-test


------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
_______________________________________________
Assp-test mailing list
Assp-test@...
https://lists.sourceforge.net/lists/listinfo/assp-test

Re: More on ASSP memory and OpenVZ

by a9k3d :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Thanks Paul and Steve and Thomas (who fixed some memory things  
recently).

I like chroot that's why I used OpenVZ -- it is a super chroot with  
weird memory management. In this case normal chroot would have been  
better!

If I was starting over Xen and VMware are possibilities.

Unfortunately, there's already a ton going on on that server. Luckily,  
I have a twin server in the same cabinet sitting in hot standby doing  
nothing else. I'm going to move ASSP when all my tasks marked Urgent,  
Immediate and "Right Now" are finished -- they keep adding them though.

Alan

On Nov 10, 2009, at 1:00 AM, Маллиндайн Стивен (Steve  
Mallindine) wrote:

> Alan,
>
> If your looking at virtualization, ASSP on Ubuntu server 9.04 guest  
> OS under
> VMWare ESXi 4.0 runs fine....
>
>
> Steve
>

------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
_______________________________________________
Assp-test mailing list
Assp-test@...
https://lists.sourceforge.net/lists/listinfo/assp-test

Re: More on ASSP memory and OpenVZ

by Маллиндайн Стивен (Steve Mallindine) :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

So, you mean 'never' :-D


On 11/11/09 7:41 AM, "Alan McNeil" <a9k3d@...> wrote:

> I'm going to move ASSP when all my tasks marked Urgent,  
Immediate and "Right
> Now" are finished -- they keep adding them though.


------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
_______________________________________________
Assp-test mailing list
Assp-test@...
https://lists.sourceforge.net/lists/listinfo/assp-test