Freeing space on window.gnome.org

[Owen Taylor]

So, planet.gnome.org has been broken today because we were out of disk
space on gnome.org.

Looking at disk usage, out 64G or so of total space on the / partition,
big users are:

 22G /usr/local/www/gnomeweb/
 17G /usr/local/www/library-web
 11G /var/log

Biggest culprits for log usage are:

  2.0G /var/log/httpd/art.gnome.org/access_log
  3.6G /var/log/httpd/art.gnome.org/error_log

The error log is full of errors and warnings that hopefully can be
cleaned up?

But I concentrated on /usr/local/www/gnomeweb/ -

Two obvious places where space could be freed up:

1) The old devel-docs setup (build scripts that build a lot of the
   GNOME stack from CVS to create tarballs of the devel docs)

   In /usr/local/www/gnomeweb/devel-docs

   I removed: cvs-2.0/ pserver-cvs-2.0/ install-2.0/
   freeing up 3G, I left the gtk262/ tarballs-2.0/ directories.

2) The working directories for automated checkouts from svn

   /usr/local/www/gnomeweb/svn-wd
 
   Removed entirely. freeing up 3.4G

That gets us out of immediate critical mode and we now have about 10%
of space (6.4GB) free. Would appreciate help:

 - Fixing the art.gnome.org logs

 - Identifying more stuff under /usr/local/www/gnomeweb that can be
   removed.

 - Is there anything obvious to do to reduce disk space for
   library.gnome.org? (If there's 17G of stuff there there is 17G of
   stuff there and that's not that much disk space these days, but if
   there's just waste, would be nice to clean it up.)

- Owen


_______________________________________________
gnome-infrastructure mailing list
gnome-infrastructure@...
http://mail.gnome.org/mailman/listinfo/gnome-infrastructure

[Sriram Ramkrishna-4]

I would just bzip2 them that should at least clear up some of the space at least temporarily.

sri

On Fri, Oct 30, 2009 at 3:23 PM, Owen Taylor <otaylor@...> wrote:

So, planet.gnome.org has been broken today because we were out of disk
space on gnome.org.

Looking at disk usage, out 64G or so of total space on the / partition,
big users are:

 22G /usr/local/www/gnomeweb/
 17G /usr/local/www/library-web
 11G /var/log

Biggest culprits for log usage are:

 2.0G /var/log/httpd/art.gnome.org/access_log
 3.6G /var/log/httpd/art.gnome.org/error_log

The error log is full of errors and warnings that hopefully can be
cleaned up?

But I concentrated on /usr/local/www/gnomeweb/ -

Two obvious places where space could be freed up:

1) The old devel-docs setup (build scripts that build a lot of the
  GNOME stack from CVS to create tarballs of the devel docs)

  In /usr/local/www/gnomeweb/devel-docs

  I removed: cvs-2.0/ pserver-cvs-2.0/ install-2.0/
  freeing up 3G, I left the gtk262/ tarballs-2.0/ directories.

2) The working directories for automated checkouts from svn

  /usr/local/www/gnomeweb/svn-wd

  Removed entirely. freeing up 3.4G

That gets us out of immediate critical mode and we now have about 10%
of space (6.4GB) free. Would appreciate help:

 - Fixing the art.gnome.org logs

 - Identifying more stuff under /usr/local/www/gnomeweb that can be
  removed.

 - Is there anything obvious to do to reduce disk space for
  library.gnome.org? (If there's 17G of stuff there there is 17G of
  stuff there and that's not that much disk space these days, but if
  there's just waste, would be nice to clean it up.)

- Owen


_______________________________________________
gnome-infrastructure mailing list
gnome-infrastructure@...
http://mail.gnome.org/mailman/listinfo/gnome-infrastructure

_______________________________________________
gnome-infrastructure mailing list
gnome-infrastructure@...
http://mail.gnome.org/mailman/listinfo/gnome-infrastructure

[Thomas Wood-2]

On Fri, 2009-10-30 at 22:23 +0000, Owen Taylor wrote:
>   2.0G /var/log/httpd/art.gnome.org/access_log
>   3.6G /var/log/httpd/art.gnome.org/error_log
>
> The error log is full of errors and warnings that hopefully can be
> cleaned up?

Oopsy daisy.

I've fixed up most of the PHP warnings. The errors that are left are
mostly noise from "missing" favicon.ico and feed readers with old URLs.

Not sure why the access_log is so large, but I guess art.gnome.org
serves up a lot of files (thumbnails etc..).

Regards,

Thomas

_______________________________________________
gnome-infrastructure mailing list
gnome-infrastructure@...
http://mail.gnome.org/mailman/listinfo/gnome-infrastructure

[Frederic Peters-5]

Owen Taylor wrote:

>  - Is there anything obvious to do to reduce disk space for
>    library.gnome.org? (If there's 17G of stuff there there is 17G of
>    stuff there and that's not that much disk space these days, but if
>    there's just waste, would be nice to clean it up.)

I just removed documentation of old development releases, I got users/
down from 13G to 8.9G.  Also I could change HTML tarballs to be
compressed with bz2 (or anything better than gzip).

I'll get another look later.


        Frederic
_______________________________________________
gnome-infrastructure mailing list
gnome-infrastructure@...
http://mail.gnome.org/mailman/listinfo/gnome-infrastructure

[Owen Taylor]

On Tue, 2009-11-03 at 14:06 +0100, Frederic Peters wrote:

> Owen Taylor wrote:
>
> >  - Is there anything obvious to do to reduce disk space for
> >    library.gnome.org? (If there's 17G of stuff there there is 17G of
> >    stuff there and that's not that much disk space these days, but if
> >    there's just waste, would be nice to clean it up.)
>
> I just removed documentation of old development releases, I got users/
> down from 13G to 8.9G.  Also I could change HTML tarballs to be
> compressed with bz2 (or anything better than gzip).
>
> I'll get another look later.

Thanks a lot Frederic - I think we're pretty good now
(16/64GB free).

- owen


_______________________________________________
gnome-infrastructure mailing list
gnome-infrastructure@...
http://mail.gnome.org/mailman/listinfo/gnome-infrastructure