GeoServer db Based configuration, looking for scalability

View: New views
7 Messages — Rating Filter:   Alert me  

GeoServer db Based configuration, looking for scalability

by Simone Giannecchini :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi list,
we have been working lately on enhancing the db based based
configuration (actually hibernate based) for GeoServer that we
developed a while ago for the Nd coverage branch which would allow us
on a side to NOT load and keep all the data configuration in memory
(more scalability), on the other side to get access to some nice
features like the possibility to use distribute caching for
replicating the same configuration to different GeoServers. The person
in charge for this work is Emanuele Tajariol, who is a long time
contributor the GeoNetwork project (he is cc'ed)

The work is still in progress, however I would like to hear your advice on :

1> where we should document it  to allow other developers to provide
feedback (GeoServer R&D wiki pages?)
2> create a community module for it (should we do it now that the work
is not ready yet or wait a bit more?)

Ciao,
Simone.
-------------------------------------------------------
Ing. Simone Giannecchini
GeoSolutions S.A.S.
Owner - Software Engineer
Via Carignoni 51
55041  Camaiore (LU)
Italy

phone: +39 0584983027
fax:      +39 0584983027
mob:    +39 333 8128928


http://www.geo-solutions.it
http://simboss.blogspot.com/
http://www.linkedin.com/in/simonegiannecchini

-------------------------------------------------------

------------------------------------------------------------------------------
_______________________________________________
Geoserver-devel mailing list
Geoserver-devel@...
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

Re: GeoServer db Based configuration, looking for scalability

by Justin Deoliveira-6 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Ciao Simone, and welcome to Emanuele :)

Simone Giannecchini wrote:

> Hi list,
> we have been working lately on enhancing the db based based
> configuration (actually hibernate based) for GeoServer that we
> developed a while ago for the Nd coverage branch which would allow us
> on a side to NOT load and keep all the data configuration in memory
> (more scalability), on the other side to get access to some nice
> features like the possibility to use distribute caching for
> replicating the same configuration to different GeoServers. The person
> in charge for this work is Emanuele Tajariol, who is a long time
> contributor the GeoNetwork project (he is cc'ed)
Nice! This work will be very welcome.
>
> The work is still in progress, however I would like to hear your advice on :
>
> 1> where we should document it  to allow other developers to provide
> feedback (GeoServer R&D wiki pages?)
Yeah, if it something of a work in progress I think some R&D pages would
be an appropriate place.

> 2> create a community module for it (should we do it now that the work
> is not ready yet or wait a bit more?)
I think adding a community module now would be better than waiting until
later. The sooner people can review the work and the earlier people are
able to provide feedback will make it easier to integrate into a core
module.

Looking forward to this.

-Justin

>
> Ciao,
> Simone.
> -------------------------------------------------------
> Ing. Simone Giannecchini
> GeoSolutions S.A.S.
> Owner - Software Engineer
> Via Carignoni 51
> 55041  Camaiore (LU)
> Italy
>
> phone: +39 0584983027
> fax:      +39 0584983027
> mob:    +39 333 8128928
>
>
> http://www.geo-solutions.it
> http://simboss.blogspot.com/
> http://www.linkedin.com/in/simonegiannecchini
>
> -------------------------------------------------------
>
> ------------------------------------------------------------------------------
> _______________________________________________
> Geoserver-devel mailing list
> Geoserver-devel@...
> https://lists.sourceforge.net/lists/listinfo/geoserver-devel


--
Justin Deoliveira
OpenGeo - http://opengeo.org
Enterprise support for open source geospatial.

------------------------------------------------------------------------------
_______________________________________________
Geoserver-devel mailing list
Geoserver-devel@...
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

Re: GeoServer db Based configuration, looking for scalability

by Jody Garnett-3 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

I echo what Justin says; but also add - place a roadmap item (long
term if you like) down for this work - and list yourself as the
contact person. This both shows the community what ideas are in the
works; and offers Geo-Solutions (via your email address)  as a contact
if someone has funding to see this work done sooner.

Jody

On Sat, Jul 4, 2009 at 2:26 PM, Justin Deoliveira<jdeolive@...> wrote:

> Ciao Simone, and welcome to Emanuele :)
>
> Simone Giannecchini wrote:
>> Hi list,
>> we have been working lately on enhancing the db based based
>> configuration (actually hibernate based) for GeoServer that we
>> developed a while ago for the Nd coverage branch which would allow us
>> on a side to NOT load and keep all the data configuration in memory
>> (more scalability), on the other side to get access to some nice
>> features like the possibility to use distribute caching for
>> replicating the same configuration to different GeoServers. The person
>> in charge for this work is Emanuele Tajariol, who is a long time
>> contributor the GeoNetwork project (he is cc'ed)
> Nice! This work will be very welcome.
>>
>> The work is still in progress, however I would like to hear your advice on :
>>
>> 1> where we should document it  to allow other developers to provide
>> feedback (GeoServer R&D wiki pages?)
> Yeah, if it something of a work in progress I think some R&D pages would
> be an appropriate place.
>
>> 2> create a community module for it (should we do it now that the work
>> is not ready yet or wait a bit more?)
> I think adding a community module now would be better than waiting until
> later. The sooner people can review the work and the earlier people are
> able to provide feedback will make it easier to integrate into a core
> module.
>
> Looking forward to this.
>
> -Justin
>>
>> Ciao,
>> Simone.
>> -------------------------------------------------------
>> Ing. Simone Giannecchini
>> GeoSolutions S.A.S.
>> Owner - Software Engineer
>> Via Carignoni 51
>> 55041  Camaiore (LU)
>> Italy
>>
>> phone: +39 0584983027
>> fax:      +39 0584983027
>> mob:    +39 333 8128928
>>
>>
>> http://www.geo-solutions.it
>> http://simboss.blogspot.com/
>> http://www.linkedin.com/in/simonegiannecchini
>>
>> -------------------------------------------------------
>>
>> ------------------------------------------------------------------------------
>> _______________________________________________
>> Geoserver-devel mailing list
>> Geoserver-devel@...
>> https://lists.sourceforge.net/lists/listinfo/geoserver-devel
>
>
> --
> Justin Deoliveira
> OpenGeo - http://opengeo.org
> Enterprise support for open source geospatial.
>
> ------------------------------------------------------------------------------
> _______________________________________________
> Geoserver-devel mailing list
> Geoserver-devel@...
> https://lists.sourceforge.net/lists/listinfo/geoserver-devel
>

------------------------------------------------------------------------------
_______________________________________________
Geoserver-devel mailing list
Geoserver-devel@...
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

Re: GeoServer db Based configuration, looking for scalability

by Emanuele Tajariol-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Ciao Justin,

ok, so I guess I need some info on how to go on for both points (R&D docs and
community module).
I already sent an application for joining GS on xircles.codehaus.
Please consider that the module I'm working on is, at the moment, based on the
1.7.x branch.

About the docs part: I noticed I cannot signup in confluence (it looks like a
licence problem). Is there any other way to sign in there? Should I be
directly registered by an admin?
TIA

   Cheers,
   Emanuele


Alle 06:26:58 di sabato 4 luglio 2009, Justin Deoliveira ha scritto:

> Ciao Simone, and welcome to Emanuele :)
>
> Simone Giannecchini wrote:
> > Hi list,
> > we have been working lately on enhancing the db based based
> > configuration (actually hibernate based) for GeoServer that we
> > developed a while ago for the Nd coverage branch which would allow us
> > on a side to NOT load and keep all the data configuration in memory
> > (more scalability), on the other side to get access to some nice
> > features like the possibility to use distribute caching for
> > replicating the same configuration to different GeoServers. The person
> > in charge for this work is Emanuele Tajariol, who is a long time
> > contributor the GeoNetwork project (he is cc'ed)
>
> Nice! This work will be very welcome.
>
> > The work is still in progress, however I would like to hear your advice
> > on :
> >
> > 1> where we should document it  to allow other developers to provide
> > feedback (GeoServer R&D wiki pages?)
>
> Yeah, if it something of a work in progress I think some R&D pages would
> be an appropriate place.
>
> > 2> create a community module for it (should we do it now that the work
> > is not ready yet or wait a bit more?)
>
> I think adding a community module now would be better than waiting until
> later. The sooner people can review the work and the earlier people are
> able to provide feedback will make it easier to integrate into a core
> module.
>
> Looking forward to this.
>
> -Justin
>
> > Ciao,
> > Simone.
> > -------------------------------------------------------
> > Ing. Simone Giannecchini
> > GeoSolutions S.A.S.
> > Owner - Software Engineer
> > Via Carignoni 51
> > 55041  Camaiore (LU)
> > Italy
> >
> > phone: +39 0584983027
> > fax:      +39 0584983027
> > mob:    +39 333 8128928
> >
> >
> > http://www.geo-solutions.it
> > http://simboss.blogspot.com/
> > http://www.linkedin.com/in/simonegiannecchini
> >
> > -------------------------------------------------------
> >
> > -------------------------------------------------------------------------
> >----- _______________________________________________
> > Geoserver-devel mailing list
> > Geoserver-devel@...
> > https://lists.sourceforge.net/lists/listinfo/geoserver-devel



------------------------------------------------------------------------------
Enter the BlackBerry Developer Challenge  
This is your chance to win up to $100,000 in prizes! For a limited time,
vendors submitting new applications to BlackBerry App World(TM) will have
the opportunity to enter the BlackBerry Developer Challenge. See full prize  
details at: http://p.sf.net/sfu/Challenge
_______________________________________________
Geoserver-devel mailing list
Geoserver-devel@...
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

Re: GeoServer db Based configuration, looking for scalability

by Emanuele Tajariol-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Ciao Justin,

ok, so I guess I need some info on how to go on for both points (R&D docs and
community module).
I already sent an application for joining GS on xircles.codehaus.
Please consider that the module I'm working on is, at the moment, based on the
1.7.x branch.

About the docs part: I noticed I cannot signup in confluence (it looks like a
licence problem). Is there any other way to sign in there? Should I be
directly registered by an admin?
TIA

   Cheers,
   Emanuele


Alle 06:26:58 di sabato 4 luglio 2009, Justin Deoliveira ha scritto:

> Ciao Simone, and welcome to Emanuele :)
>
> Simone Giannecchini wrote:
> > Hi list,
> > we have been working lately on enhancing the db based based
> > configuration (actually hibernate based) for GeoServer that we
> > developed a while ago for the Nd coverage branch which would allow us
> > on a side to NOT load and keep all the data configuration in memory
> > (more scalability), on the other side to get access to some nice
> > features like the possibility to use distribute caching for
> > replicating the same configuration to different GeoServers. The person
> > in charge for this work is Emanuele Tajariol, who is a long time
> > contributor the GeoNetwork project (he is cc'ed)
>
> Nice! This work will be very welcome.
>
> > The work is still in progress, however I would like to hear your advice
> > on :
> >
> > 1> where we should document it  to allow other developers to provide
> > feedback (GeoServer R&D wiki pages?)
>
> Yeah, if it something of a work in progress I think some R&D pages would
> be an appropriate place.
>
> > 2> create a community module for it (should we do it now that the work
> > is not ready yet or wait a bit more?)
>
> I think adding a community module now would be better than waiting until
> later. The sooner people can review the work and the earlier people are
> able to provide feedback will make it easier to integrate into a core
> module.
>
> Looking forward to this.
>
> -Justin
>
> > Ciao,
> > Simone.
> > -------------------------------------------------------
> > Ing. Simone Giannecchini
> > GeoSolutions S.A.S.
> > Owner - Software Engineer
> > Via Carignoni 51
> > 55041  Camaiore (LU)
> > Italy
> >
> > phone: +39 0584983027
> > fax:      +39 0584983027
> > mob:    +39 333 8128928
> >
> >
> > http://www.geo-solutions.it
> > http://simboss.blogspot.com/
> > http://www.linkedin.com/in/simonegiannecchini
> >
> > -------------------------------------------------------
> >
> > -------------------------------------------------------------------------
> >----- _______________________________________________
> > Geoserver-devel mailing list
> > Geoserver-devel@...
> > https://lists.sourceforge.net/lists/listinfo/geoserver-devel



------------------------------------------------------------------------------
Enter the BlackBerry Developer Challenge  
This is your chance to win up to $100,000 in prizes! For a limited time,
vendors submitting new applications to BlackBerry App World(TM) will have
the opportunity to enter the BlackBerry Developer Challenge. See full prize  
details at: http://p.sf.net/sfu/Challenge
_______________________________________________
Geoserver-devel mailing list
Geoserver-devel@...
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

Re: GeoServer db Based configuration, looking for scalability

by Justin Deoliveira-6 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi Emanuele,

Your application is accepted in xircles, welcome!! Remember this gives
you access to the community space. Changes to the core will still
require review. Actually I just finished writing up some of our
"unofficial" commit guidelines:

http://docs.geoserver.org/1.7.x/developer/policies/comitting.html
http://docs.geoserver.org/1.7.x/developer/policies/code-review.html

About confluence, we seem to have reached our user limit, mostly due to
bogus logins and spam. I have gone and deleted a few users so hopefully
you can create an account now.

Arne: Can we enable something like captcha to protect us from this?

-Justin

Emanuele Tajariol wrote:

> Ciao Justin,
>
> ok, so I guess I need some info on how to go on for both points (R&D docs and
> community module).
> I already sent an application for joining GS on xircles.codehaus.
> Please consider that the module I'm working on is, at the moment, based on the
> 1.7.x branch.
>
> About the docs part: I noticed I cannot signup in confluence (it looks like a
> licence problem). Is there any other way to sign in there? Should I be
> directly registered by an admin?
> TIA
>
>    Cheers,
>    Emanuele
>
>
> Alle 06:26:58 di sabato 4 luglio 2009, Justin Deoliveira ha scritto:
>> Ciao Simone, and welcome to Emanuele :)
>>
>> Simone Giannecchini wrote:
>>> Hi list,
>>> we have been working lately on enhancing the db based based
>>> configuration (actually hibernate based) for GeoServer that we
>>> developed a while ago for the Nd coverage branch which would allow us
>>> on a side to NOT load and keep all the data configuration in memory
>>> (more scalability), on the other side to get access to some nice
>>> features like the possibility to use distribute caching for
>>> replicating the same configuration to different GeoServers. The person
>>> in charge for this work is Emanuele Tajariol, who is a long time
>>> contributor the GeoNetwork project (he is cc'ed)
>> Nice! This work will be very welcome.
>>
>>> The work is still in progress, however I would like to hear your advice
>>> on :
>>>
>>> 1> where we should document it  to allow other developers to provide
>>> feedback (GeoServer R&D wiki pages?)
>> Yeah, if it something of a work in progress I think some R&D pages would
>> be an appropriate place.
>>
>>> 2> create a community module for it (should we do it now that the work
>>> is not ready yet or wait a bit more?)
>> I think adding a community module now would be better than waiting until
>> later. The sooner people can review the work and the earlier people are
>> able to provide feedback will make it easier to integrate into a core
>> module.
>>
>> Looking forward to this.
>>
>> -Justin
>>
>>> Ciao,
>>> Simone.
>>> -------------------------------------------------------
>>> Ing. Simone Giannecchini
>>> GeoSolutions S.A.S.
>>> Owner - Software Engineer
>>> Via Carignoni 51
>>> 55041  Camaiore (LU)
>>> Italy
>>>
>>> phone: +39 0584983027
>>> fax:      +39 0584983027
>>> mob:    +39 333 8128928
>>>
>>>
>>> http://www.geo-solutions.it
>>> http://simboss.blogspot.com/
>>> http://www.linkedin.com/in/simonegiannecchini
>>>
>>> -------------------------------------------------------
>>>
>>> -------------------------------------------------------------------------
>>> ----- _______________________________________________
>>> Geoserver-devel mailing list
>>> Geoserver-devel@...
>>> https://lists.sourceforge.net/lists/listinfo/geoserver-devel
>
>
>
> ------------------------------------------------------------------------------
> Enter the BlackBerry Developer Challenge  
> This is your chance to win up to $100,000 in prizes! For a limited time,
> vendors submitting new applications to BlackBerry App World(TM) will have
> the opportunity to enter the BlackBerry Developer Challenge. See full prize  
> details at: http://p.sf.net/sfu/Challenge
> _______________________________________________
> Geoserver-devel mailing list
> Geoserver-devel@...
> https://lists.sourceforge.net/lists/listinfo/geoserver-devel


--
Justin Deoliveira
OpenGeo - http://opengeo.org
Enterprise support for open source geospatial.

------------------------------------------------------------------------------
Enter the BlackBerry Developer Challenge  
This is your chance to win up to $100,000 in prizes! For a limited time,
vendors submitting new applications to BlackBerry App World(TM) will have
the opportunity to enter the BlackBerry Developer Challenge. See full prize  
details at: http://p.sf.net/sfu/Challenge
_______________________________________________
Geoserver-devel mailing list
Geoserver-devel@...
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

Re: GeoServer db Based configuration, looking for scalability

by Justin Deoliveira-6 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message


Emanuele Tajariol wrote:
> Ciao Justin,
>
> ok, so I guess I need some info on how to go on for both points (R&D docs and
> community module).

You can craete R&D pages just by going to
http://geoserver.org/display/GEOS/RnD and adding a child page when you
have wiki access.

As for community modules the process is written up here:

http://docs.geoserver.org/1.7.x/developer/policies/community-modules.html

-Justin

> I already sent an application for joining GS on xircles.codehaus.
> Please consider that the module I'm working on is, at the moment, based on the
> 1.7.x branch.
>
> About the docs part: I noticed I cannot signup in confluence (it looks like a
> licence problem). Is there any other way to sign in there? Should I be
> directly registered by an admin?
> TIA
>
>    Cheers,
>    Emanuele
>
>
> Alle 06:26:58 di sabato 4 luglio 2009, Justin Deoliveira ha scritto:
>> Ciao Simone, and welcome to Emanuele :)
>>
>> Simone Giannecchini wrote:
>>> Hi list,
>>> we have been working lately on enhancing the db based based
>>> configuration (actually hibernate based) for GeoServer that we
>>> developed a while ago for the Nd coverage branch which would allow us
>>> on a side to NOT load and keep all the data configuration in memory
>>> (more scalability), on the other side to get access to some nice
>>> features like the possibility to use distribute caching for
>>> replicating the same configuration to different GeoServers. The person
>>> in charge for this work is Emanuele Tajariol, who is a long time
>>> contributor the GeoNetwork project (he is cc'ed)
>> Nice! This work will be very welcome.
>>
>>> The work is still in progress, however I would like to hear your advice
>>> on :
>>>
>>> 1> where we should document it  to allow other developers to provide
>>> feedback (GeoServer R&D wiki pages?)
>> Yeah, if it something of a work in progress I think some R&D pages would
>> be an appropriate place.
>>
>>> 2> create a community module for it (should we do it now that the work
>>> is not ready yet or wait a bit more?)
>> I think adding a community module now would be better than waiting until
>> later. The sooner people can review the work and the earlier people are
>> able to provide feedback will make it easier to integrate into a core
>> module.
>>
>> Looking forward to this.
>>
>> -Justin
>>
>>> Ciao,
>>> Simone.
>>> -------------------------------------------------------
>>> Ing. Simone Giannecchini
>>> GeoSolutions S.A.S.
>>> Owner - Software Engineer
>>> Via Carignoni 51
>>> 55041  Camaiore (LU)
>>> Italy
>>>
>>> phone: +39 0584983027
>>> fax:      +39 0584983027
>>> mob:    +39 333 8128928
>>>
>>>
>>> http://www.geo-solutions.it
>>> http://simboss.blogspot.com/
>>> http://www.linkedin.com/in/simonegiannecchini
>>>
>>> -------------------------------------------------------
>>>
>>> -------------------------------------------------------------------------
>>> ----- _______________________________________________
>>> Geoserver-devel mailing list
>>> Geoserver-devel@...
>>> https://lists.sourceforge.net/lists/listinfo/geoserver-devel
>
>
>
> ------------------------------------------------------------------------------
> Enter the BlackBerry Developer Challenge  
> This is your chance to win up to $100,000 in prizes! For a limited time,
> vendors submitting new applications to BlackBerry App World(TM) will have
> the opportunity to enter the BlackBerry Developer Challenge. See full prize  
> details at: http://p.sf.net/sfu/Challenge
> _______________________________________________
> Geoserver-devel mailing list
> Geoserver-devel@...
> https://lists.sourceforge.net/lists/listinfo/geoserver-devel


--
Justin Deoliveira
OpenGeo - http://opengeo.org
Enterprise support for open source geospatial.

------------------------------------------------------------------------------
Enter the BlackBerry Developer Challenge  
This is your chance to win up to $100,000 in prizes! For a limited time,
vendors submitting new applications to BlackBerry App World(TM) will have
the opportunity to enter the BlackBerry Developer Challenge. See full prize  
details at: http://p.sf.net/sfu/Challenge
_______________________________________________
Geoserver-devel mailing list
Geoserver-devel@...
https://lists.sourceforge.net/lists/listinfo/geoserver-devel