administering many DSpace/manakin instances

View: New views
5 Messages — Rating Filter:   Alert me  

administering many DSpace/manakin instances

by Keith Gilbertson :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Some parts of this message have been removed. Learn more about Nabble's security policy.

Does anyone have any experience and/or advice on administering multiple installations of DSpace/Manakin applications?  Our plan is to have about a dozen installations of the DSpace and Manakin web applications by early Spring, and then build up to approximately 100 installations as they are needed.  Each installation will belong to a separate institution or organization, typically an academic library.

 

We will be performing customizations to the software.  Some customizations will apply only to an individual instance; others will be global.  We will also need a way to search/browse for items globally across all instances.  It’s likely that we’ll collect OAI/PMH records into an external tool to implement the global search.

 

I’m interested in collecting information about memory/disk cache requirements, any tools that have been developed for applying updates and customizations to multiple instances of the web applications, and any changes to tools, handle servers, etc. that are necessary/helpful for this type of setup.

 

I recently saw an example of a multiple institution repository that is running under a single instance of the application here:

http://dspace.nitle.org/ (NITLE DSpace Service ).

 

Managing multiple institutions under a single instance of the DSpace application is an interesting approach.  It looks like it would simplify administration for the developers and engineers, make global search work automatically, and possibly reduce system requirements.  I’m not sure that it would work in our situation here, though, for several reasons:

 

  1. Customizations.  We’re unsure specifically which customizations each institution will need, and we may not be able to implement a customization for one institution without affecting another if they’re running in the same application space.

 

  1. Control.  Our goal is to give each institution as much control over their space as possible, and we’re not sure that we’d be able to do this if they all shared the same application space.  One example is that we’ve had problems giving institution heads control to add subcommunities/collections to a community in Manakin, without giving them full administrative access to the system.  If each institution “owned” their own instance, we’d avoid this problem, and possibly other unknown issues.

 

  1. Scalability.  How much load can a single set of DSpace/Manakin web applications handle?  If necessary, does the DSpace application cluster well?  If clustered, would the clustered applications still talk to a single database, or should the database also be replicated?

 

 

Any advice, statistics, anecdotes from anyone about experiences managing DSpace for multiple parties with differing needs?

 

 

Thanks,
Keith Gilbertson

Systems Developer

OhioLINK


-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2005.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
DSpace-tech mailing list
DSpace-tech@...
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: administering many DSpace/manakin instances

by cachiusa :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Dear all,
I am looking for solution for 24 Dspace for 24 communities run on 1 server. Which solution I should choose:

1) 24 instances of Tomcat, one for each Dspace instance, or
2) One Tomcat for 24 Dspace instances.

I choose second solution by following the link
http://www.nabble.com/Changing-DB-Name-%C2%BFhow--td19053520.html 
and already finished installation. But my server is broken if I  try to access 24 DSpace at the same time (it is ok to open 12 Dspace).

Some sites show error:
java.lang.OutOfMemoryError: PermGen space

The others return errors:
 java.io.FileNotFoundException: /usr/local/gmseenet/partners/gmseenet/dspace/webapps/jspui/WEB-INF/web.xml (Too many open files)
 
or:
org.apache.jasper.JasperException: Unable to compile class for JSP

I already set heap memory for Tomcat to 2048 by
JAVA_OPTS="-Xmx2048M -Xms64M -Dfile.encoding=UTF-8", but I still face the same problem.

I have to run 24 DSpace in 1 machine, so what is solution for me?
Please help me. Thanks in advance.
Best,
Cachiusa

Re: administering many DSpace/manakin instances

by rramos :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message


 Just one ideia,

  Why don't you install let's say, 8 Tomcat instances all with the same
configurations
  using same context's and then use apache with mod_jk for load balancing.
 
  Cheers, Rui

cachiusa wrote:

> Dear all,
> I am looking for solution for 24 Dspace for 24 communities run on 1 server.
> Which solution I should choose:
>
> 1) 24 instances of Tomcat, one for each Dspace instance, or
> 2) One Tomcat for 24 Dspace instances.
>
> I choose second solution by following the link
> http://www.nabble.com/Changing-DB-Name-%C2%BFhow--td19053520.html 
> and already finished installation. But my server is broken if I  try to
> access 24 DSpace at the same time (it is ok to open 12 Dspace).
>
> Some sites show error:
> java.lang.OutOfMemoryError: PermGen space
>
> The others return errors:
>  java.io.FileNotFoundException:
> /usr/local/gmseenet/partners/gmseenet/dspace/webapps/jspui/WEB-INF/web.xml
> (Too many open files)
>  
> or:
> org.apache.jasper.JasperException: Unable to compile class for JSP
>
> I already set heap memory for Tomcat to 2048 by
> JAVA_OPTS="-Xmx2048M -Xms64M -Dfile.encoding=UTF-8", but I still face the
> same problem.
>
> I have to run 24 DSpace in 1 machine, so what is solution for me?
> Please help me. Thanks in advance.
> Best,
> Cachiusa
>  




-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
DSpace-tech mailing list
DSpace-tech@...
https://lists.sourceforge.net/lists/listinfo/dspace-tech
Rui Ramos
==============================================
Universidade do Porto - IRICUP
Praça Gomes Teixeira, 4099-002 Porto, Portugal
email: rramos[at]reit.up.pt
phone: +351 22 040 8164
==============================================

Re: administering many DSpace/manakin instances

by cachiusa :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi Rui,
Thanks for your advice. But more than 1 instance of Tomcat will take more resources and be
more expensive in CPU, rite? I just have 1 server for all (DNS, mail, web
hosting, ...). I just create
Best,
Cachiusa
rramos wrote:
 Just one ideia,

  Why don't you install let's say, 8 Tomcat instances all with the same
configurations
  using same context's and then use apache with mod_jk for load balancing.
 
  Cheers, Rui

cachiusa wrote:
> Dear all,
> I am looking for solution for 24 Dspace for 24 communities run on 1 server.
> Which solution I should choose:
>
> 1) 24 instances of Tomcat, one for each Dspace instance, or
> 2) One Tomcat for 24 Dspace instances.
>
> I choose second solution by following the link
> http://www.nabble.com/Changing-DB-Name-%C2%BFhow--td19053520.html 
> and already finished installation. But my server is broken if I  try to
> access 24 DSpace at the same time (it is ok to open 12 Dspace).
>
> Some sites show error:
> java.lang.OutOfMemoryError: PermGen space
>
> The others return errors:
>  java.io.FileNotFoundException:
> /usr/local/gmseenet/partners/gmseenet/dspace/webapps/jspui/WEB-INF/web.xml
> (Too many open files)
>  
> or:
> org.apache.jasper.JasperException: Unable to compile class for JSP
>
> I already set heap memory for Tomcat to 2048 by
> JAVA_OPTS="-Xmx2048M -Xms64M -Dfile.encoding=UTF-8", but I still face the
> same problem.
>
> I have to run 24 DSpace in 1 machine, so what is solution for me?
> Please help me. Thanks in advance.
> Best,
> Cachiusa
>  




-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech


-----
Rui Ramos
==============================================
Universidade do Porto - IRICUP
Praça Gomes Teixeira, 4099-002 Porto, Portugal
email: rramos[at]reit.up.pt
phone: +351 22 040 8164
==============================================

Re: administering many DSpace/manakin instances

by Simon Brown-7 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

What's the spec of the hardware you plan on running all this on?

On 13 Nov 2008, at 06:18, cachiusa wrote:

>
> Hi Rui,
> Thanks for your advice. But more than 1 instance of Tomcat will take  
> more
> resources and be
> more expensive in CPU, rite? I just have 1 server for all (DNS,  
> mail, web
> hosting, ...). I just create
> Best,
> Cachiusa


--
Simon Brown <stb28@...> - Cambridge University Computing Service
+44 1223 3 34714 - New Museums Site, Pembroke Street, Cambridge CB2 3QH



-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
DSpace-tech mailing list
DSpace-tech@...
https://lists.sourceforge.net/lists/listinfo/dspace-tech