Active/Passive w/two active servers

View: New views
5 Messages — Rating Filter:   Alert me  

Active/Passive w/two active servers

by Robert Hanson-4 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

So... I think I have everything set up right, but I hope I am missing something.

The cluster has 2 servers (active/passive) and two clients
(tomcat6/spring-security tims).  The servers are located a couple
thousand miles from each other, and the clients are co-located on the
same boxes as the servers.

This morning I checked out the TC Dev Console and both servers were
active and only one client was appearing.

How can I avoid this situation?  And I missing something in the
config?  I wouldn't be so worried, but it has happened twice in 2
days... and this is a new install, so 2-days basically means every
day.  And that worries me a bit.

Any/all help would be appreciated.  Thanks.


<tc:tc-config xmlns:tc="http://www.terracotta.org/config"
        xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
        xsi:schemaLocation="http://www.terracotta.org/schema/terracotta-4.xsd">

        <tc-properties>
                <property name="l2.l1reconnect.enabled" value="true" />
                <property name="l2.l1reconnect.timeout.millis" value="10000" />
                <property
name="l2.objectmanager.fault.logging.enabled" value="true" />
                <property name="l2.nha.tcgroupcomm.reconnect.enabled"
value="true" />
                <property name="l2.nha.tcgroupcomm.reconnect.timeout"
value="10000" />
        </tc-properties>

        <servers>
                <server host="1.1.1.1" name="galileo">
                        <data>/usr/local/terracotta/data/galileo</data>
                        <logs>/usr/local/terracotta/logs/galileo</logs>
                        <l2-group-port>9530</l2-group-port>
                        <dso-port>9510</dso-port>
                        <dso>
                                <persistence>
                                        <mode>permanent-store</mode>
                                </persistence>
                        </dso>
                </server>

                <server host="2.2.2.2" name="pasteur">
                        <data>/usr/local/terracotta/data/pasteur</data>
                        <logs>/usr/local/terracotta/logs/pasteur</logs>
                        <l2-group-port>9530</l2-group-port>
                        <dso-port>9510</dso-port>
                        <dso>
                                <persistence>
                                        <mode>permanent-store</mode>
                                </persistence>
                        </dso>
                </server>

                <ha>
                        <mode>networked-active-passive</mode>
                        <networked-active-passive>
                                <election-time>5</election-time>
                        </networked-active-passive>
                </ha>

                <update-check>
                        <enabled>true</enabled>
                </update-check>
        </servers>

        <clients>
                <logs>/usr/local/terracotta/logs/client-logs</logs>

<statistics>/usr/local/terracotta/data/%(tc.node-name)/client-statistics</statistics>
                <modules>
                        <module name="tim-tomcat-6.0" version="1.0.1" />
                        <module name="tim-spring-security-2.0"
version="1.1.1" />
                </modules>
        </clients>

        <application>
                <dso>
                        <instrumented-classes>
                                <include>

<class-expression>com.company.sensor.remoting.model.*</class-expression>
                                </include>
                                <include>

<class-expression>com.company.calendar.model.*</class-expression>
                                </include>
                                <include>

<class-expression>com.company..shared..*</class-expression>
                                </include>
                        </instrumented-classes>

                        <web-applications>
                                <web-application>ROOT</web-application>
                        </web-applications>
                </dso>
        </application>

</tc:tc-config>
_______________________________________________
tc-users mailing list
tc-users@...
http://lists.terracotta.org/mailman/listinfo/tc-users

Re: Active/Passive w/two active servers

by sharrissf :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi,

We could take a look if you attach the logs from all the clients and servers.


On May 22, 2009, at 8:39 AM, Robert Hanson wrote:

So... I think I have everything set up right, but I hope I am missing something.

The cluster has 2 servers (active/passive) and two clients
(tomcat6/spring-security tims).  The servers are located a couple
thousand miles from each other, and the clients are co-located on the
same boxes as the servers.

This morning I checked out the TC Dev Console and both servers were
active and only one client was appearing.

How can I avoid this situation?  And I missing something in the
config?  I wouldn't be so worried, but it has happened twice in 2
days... and this is a new install, so 2-days basically means every
day.  And that worries me a bit.

Any/all help would be appreciated.  Thanks.


<tc:tc-config xmlns:tc="http://www.terracotta.org/config"
       xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
       xsi:schemaLocation="http://www.terracotta.org/schema/terracotta-4.xsd">

       <tc-properties>
               <property name="l2.l1reconnect.enabled" value="true" />
               <property name="l2.l1reconnect.timeout.millis" value="10000" />
               <property
name="l2.objectmanager.fault.logging.enabled" value="true" />
               <property name="l2.nha.tcgroupcomm.reconnect.enabled"
value="true" />
               <property name="l2.nha.tcgroupcomm.reconnect.timeout"
value="10000" />
       </tc-properties>

       <servers>
               <server host="1.1.1.1" name="galileo">
                       <data>/usr/local/terracotta/data/galileo</data>
                       <logs>/usr/local/terracotta/logs/galileo</logs>
                       <l2-group-port>9530</l2-group-port>
                       <dso-port>9510</dso-port>
                       <dso>
                               <persistence>
                                       <mode>permanent-store</mode>
                               </persistence>
                       </dso>
               </server>

               <server host="2.2.2.2" name="pasteur">
                       <data>/usr/local/terracotta/data/pasteur</data>
                       <logs>/usr/local/terracotta/logs/pasteur</logs>
                       <l2-group-port>9530</l2-group-port>
                       <dso-port>9510</dso-port>
                       <dso>
                               <persistence>
                                       <mode>permanent-store</mode>
                               </persistence>
                       </dso>
               </server>

               <ha>
                       <mode>networked-active-passive</mode>
                       <networked-active-passive>
                               <election-time>5</election-time>
                       </networked-active-passive>
               </ha>

               <update-check>
                       <enabled>true</enabled>
               </update-check>
       </servers>

       <clients>
               <logs>/usr/local/terracotta/logs/client-logs</logs>

<statistics>/usr/local/terracotta/data/%(tc.node-name)/client-statistics</statistics>
               <modules>
                       <module name="tim-tomcat-6.0" version="1.0.1" />
                       <module name="tim-spring-security-2.0"
version="1.1.1" />
               </modules>
       </clients>

       <application>
               <dso>
                       <instrumented-classes>
                               <include>

<class-expression>com.company.sensor.remoting.model.*</class-expression>
                               </include>
                               <include>

<class-expression>com.company.calendar.model.*</class-expression>
                               </include>
                               <include>

<class-expression>com.company..shared..*</class-expression>
                               </include>
                       </instrumented-classes>

                       <web-applications>
                               <web-application>ROOT</web-application>
                       </web-applications>
               </dso>
       </application>

</tc:tc-config>
_______________________________________________
tc-users mailing list
tc-users@...
http://lists.terracotta.org/mailman/listinfo/tc-users


_______________________________________________
tc-users mailing list
tc-users@...
http://lists.terracotta.org/mailman/listinfo/tc-users

Re: Active/Passive w/two active servers

by Robert Hanson-4 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Thanks, logs are attached.

This isn't in production yet, so you will see a lot of restarts around
6pm-6:30 while I tweaked the configuration.  I believe the error
occurred around 9pm.  And like I said, this isn't in production, so
there was likely no activity on the clients.

P.S. - I already talked to a TC sales rep, it is beginning to look
like a support contract will be a good thing to have :)

Thanks again.

Rob


On Fri, May 22, 2009 at 11:43 AM, Steven Harris
<steve@...> wrote:

> Hi,
> We could take a look if you attach the logs from all the clients and
> servers.
> Cheers,
> Steve Harris
> "Terracotta.  It's ten pounds of awesome in a five pound sack."
>
>
>
> On May 22, 2009, at 8:39 AM, Robert Hanson wrote:
>
> So... I think I have everything set up right, but I hope I am missing
> something.
>
> The cluster has 2 servers (active/passive) and two clients
> (tomcat6/spring-security tims).  The servers are located a couple
> thousand miles from each other, and the clients are co-located on the
> same boxes as the servers.
>
> This morning I checked out the TC Dev Console and both servers were
> active and only one client was appearing.
>
> How can I avoid this situation?  And I missing something in the
> config?  I wouldn't be so worried, but it has happened twice in 2
> days... and this is a new install, so 2-days basically means every
> day.  And that worries me a bit.
>
> Any/all help would be appreciated.  Thanks.
>
>
> <tc:tc-config xmlns:tc="http://www.terracotta.org/config"
>        xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
>        xsi:schemaLocation="http://www.terracotta.org/schema/terracotta-4.xsd">
>
>        <tc-properties>
>                <property name="l2.l1reconnect.enabled" value="true" />
>                <property name="l2.l1reconnect.timeout.millis" value="10000"
> />
>                <property
> name="l2.objectmanager.fault.logging.enabled" value="true" />
>                <property name="l2.nha.tcgroupcomm.reconnect.enabled"
> value="true" />
>                <property name="l2.nha.tcgroupcomm.reconnect.timeout"
> value="10000" />
>        </tc-properties>
>
>        <servers>
>                <server host="1.1.1.1" name="galileo">
>                        <data>/usr/local/terracotta/data/galileo</data>
>                        <logs>/usr/local/terracotta/logs/galileo</logs>
>                        <l2-group-port>9530</l2-group-port>
>                        <dso-port>9510</dso-port>
>                        <dso>
>                                <persistence>
>                                        <mode>permanent-store</mode>
>                                </persistence>
>                        </dso>
>                </server>
>
>                <server host="2.2.2.2" name="pasteur">
>                        <data>/usr/local/terracotta/data/pasteur</data>
>                        <logs>/usr/local/terracotta/logs/pasteur</logs>
>                        <l2-group-port>9530</l2-group-port>
>                        <dso-port>9510</dso-port>
>                        <dso>
>                                <persistence>
>                                        <mode>permanent-store</mode>
>                                </persistence>
>                        </dso>
>                </server>
>
>                <ha>
>                        <mode>networked-active-passive</mode>
>                        <networked-active-passive>
>                                <election-time>5</election-time>
>                        </networked-active-passive>
>                </ha>
>
>                <update-check>
>                        <enabled>true</enabled>
>                </update-check>
>        </servers>
>
>        <clients>
>                <logs>/usr/local/terracotta/logs/client-logs</logs>
>
> <statistics>/usr/local/terracotta/data/%(tc.node-name)/client-statistics</statistics>
>                <modules>
>                        <module name="tim-tomcat-6.0" version="1.0.1" />
>                        <module name="tim-spring-security-2.0"
> version="1.1.1" />
>                </modules>
>        </clients>
>
>        <application>
>                <dso>
>                        <instrumented-classes>
>                                <include>
>
> <class-expression>com.company.sensor.remoting.model.*</class-expression>
>                                </include>
>                                <include>
>
> <class-expression>com.company.calendar.model.*</class-expression>
>                                </include>
>                                <include>
>
> <class-expression>com.company..shared..*</class-expression>
>                                </include>
>                        </instrumented-classes>
>
>                        <web-applications>
>                                <web-application>ROOT</web-application>
>                        </web-applications>
>                </dso>
>        </application>
>
> </tc:tc-config>
> _______________________________________________
> tc-users mailing list
> tc-users@...
> http://lists.terracotta.org/mailman/listinfo/tc-users
>
>
> _______________________________________________
> tc-users mailing list
> tc-users@...
> http://lists.terracotta.org/mailman/listinfo/tc-users
>
>


_______________________________________________
tc-users mailing list
tc-users@...
http://lists.terracotta.org/mailman/listinfo/tc-users

logs.zip (95K) Download Attachment

Re: Active/Passive w/two active servers

by Manoj Govindassamy :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi Rob,

Do the servers galileo and pasteur have same system time  
synchronization. The server logs are 2 minutes apart. If they are in  
time sync, please send us the older version (.1) of server logs too.

thanks,
Manoj


On May 22, 2009, at 10:02 PM, Robert Hanson wrote:

> Thanks, logs are attached.
>
> This isn't in production yet, so you will see a lot of restarts around
> 6pm-6:30 while I tweaked the configuration.  I believe the error
> occurred around 9pm.  And like I said, this isn't in production, so
> there was likely no activity on the clients.
>
> P.S. - I already talked to a TC sales rep, it is beginning to look
> like a support contract will be a good thing to have :)
>
> Thanks again.
>
> Rob
>
>
> On Fri, May 22, 2009 at 11:43 AM, Steven Harris
> <steve@...> wrote:
>> Hi,
>> We could take a look if you attach the logs from all the clients and
>> servers.
>> Cheers,
>> Steve Harris
>> "Terracotta.  It's ten pounds of awesome in a five pound sack."
>>
>>
>>
>> On May 22, 2009, at 8:39 AM, Robert Hanson wrote:
>>
>> So... I think I have everything set up right, but I hope I am missing
>> something.
>>
>> The cluster has 2 servers (active/passive) and two clients
>> (tomcat6/spring-security tims).  The servers are located a couple
>> thousand miles from each other, and the clients are co-located on the
>> same boxes as the servers.
>>
>> This morning I checked out the TC Dev Console and both servers were
>> active and only one client was appearing.
>>
>> How can I avoid this situation?  And I missing something in the
>> config?  I wouldn't be so worried, but it has happened twice in 2
>> days... and this is a new install, so 2-days basically means every
>> day.  And that worries me a bit.
>>
>> Any/all help would be appreciated.  Thanks.
>>
>>
>> <tc:tc-config xmlns:tc="http://www.terracotta.org/config"
>>        xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
>>        xsi:schemaLocation="http://www.terracotta.org/schema/ 
>> terracotta-4.xsd">
>>
>>        <tc-properties>
>>                <property name="l2.l1reconnect.enabled"  
>> value="true" />
>>                <property name="l2.l1reconnect.timeout.millis"  
>> value="10000"
>> />
>>                <property
>> name="l2.objectmanager.fault.logging.enabled" value="true" />
>>                <property name="l2.nha.tcgroupcomm.reconnect.enabled"
>> value="true" />
>>                <property name="l2.nha.tcgroupcomm.reconnect.timeout"
>> value="10000" />
>>        </tc-properties>
>>
>>        <servers>
>>                <server host="1.1.1.1" name="galileo">
>>                        <data>/usr/local/terracotta/data/galileo</
>> data>
>>                        <logs>/usr/local/terracotta/logs/galileo</
>> logs>
>>                        <l2-group-port>9530</l2-group-port>
>>                        <dso-port>9510</dso-port>
>>                        <dso>
>>                                <persistence>
>>                                        <mode>permanent-store</mode>
>>                                </persistence>
>>                        </dso>
>>                </server>
>>
>>                <server host="2.2.2.2" name="pasteur">
>>                        <data>/usr/local/terracotta/data/pasteur</
>> data>
>>                        <logs>/usr/local/terracotta/logs/pasteur</
>> logs>
>>                        <l2-group-port>9530</l2-group-port>
>>                        <dso-port>9510</dso-port>
>>                        <dso>
>>                                <persistence>
>>                                        <mode>permanent-store</mode>
>>                                </persistence>
>>                        </dso>
>>                </server>
>>
>>                <ha>
>>                        <mode>networked-active-passive</mode>
>>                        <networked-active-passive>
>>                                <election-time>5</election-time>
>>                        </networked-active-passive>
>>                </ha>
>>
>>                <update-check>
>>                        <enabled>true</enabled>
>>                </update-check>
>>        </servers>
>>
>>        <clients>
>>                <logs>/usr/local/terracotta/logs/client-logs</logs>
>>
>> <statistics>/usr/local/terracotta/data/%(tc.node-name)/client-
>> statistics</statistics>
>>                <modules>
>>                        <module name="tim-tomcat-6.0"  
>> version="1.0.1" />
>>                        <module name="tim-spring-security-2.0"
>> version="1.1.1" />
>>                </modules>
>>        </clients>
>>
>>        <application>
>>                <dso>
>>                        <instrumented-classes>
>>                                <include>
>>
>> <class-expression>com.company.sensor.remoting.model.*</class-
>> expression>
>>                                </include>
>>                                <include>
>>
>> <class-expression>com.company.calendar.model.*</class-expression>
>>                                </include>
>>                                <include>
>>
>> <class-expression>com.company..shared..*</class-expression>
>>                                </include>
>>                        </instrumented-classes>
>>
>>                        <web-applications>
>>                                <web-application>ROOT</web-
>> application>
>>                        </web-applications>
>>                </dso>
>>        </application>
>>
>> </tc:tc-config>
>> _______________________________________________
>> tc-users mailing list
>> tc-users@...
>> http://lists.terracotta.org/mailman/listinfo/tc-users
>>
>>
>> _______________________________________________
>> tc-users mailing list
>> tc-users@...
>> http://lists.terracotta.org/mailman/listinfo/tc-users
>>
>>
>> <logs.zip>
> _______________________________________________
> tc-users mailing list
> tc-users@...
> http://lists.terracotta.org/mailman/listinfo/tc-users

_______________________________________________
tc-users mailing list
tc-users@...
http://lists.terracotta.org/mailman/listinfo/tc-users

Re: Active/Passive w/two active servers

by Robert Hanson-4 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Yes, the servers are currently in sync, I just check to verify this.
One of the boxes is new, and was out of sync last week, but I believe
that was resolved prior to Monday.  I will check with the team that
handles that to make sure they didn't do anything yesterday.

RE the logs, I was too clever for my own good.  What I sent weren't
the latest logs.  I restarted one of the servers and clients this
morning when I saw the problem, so I think I sent Galileo's ".3" log
file, and Pasteur's ".1" because those were the ones for that time.

So this time I am resending all of the logs back to 5/20, with the
original file names.

Rob



On Fri, May 22, 2009 at 1:55 PM, Manoj Govindassamy
<mgovinda@...> wrote:

> Hi Rob,
>
> Do the servers galileo and pasteur have same system time
> synchronization. The server logs are 2 minutes apart. If they are in
> time sync, please send us the older version (.1) of server logs too.
>
> thanks,
> Manoj
>
>
> On May 22, 2009, at 10:02 PM, Robert Hanson wrote:
>
>> Thanks, logs are attached.
>>
>> This isn't in production yet, so you will see a lot of restarts around
>> 6pm-6:30 while I tweaked the configuration.  I believe the error
>> occurred around 9pm.  And like I said, this isn't in production, so
>> there was likely no activity on the clients.
>>
>> P.S. - I already talked to a TC sales rep, it is beginning to look
>> like a support contract will be a good thing to have :)
>>
>> Thanks again.
>>
>> Rob
>>
>>
>> On Fri, May 22, 2009 at 11:43 AM, Steven Harris
>> <steve@...> wrote:
>>> Hi,
>>> We could take a look if you attach the logs from all the clients and
>>> servers.
>>> Cheers,
>>> Steve Harris
>>> "Terracotta.  It's ten pounds of awesome in a five pound sack."
>>>
>>>
>>>
>>> On May 22, 2009, at 8:39 AM, Robert Hanson wrote:
>>>
>>> So... I think I have everything set up right, but I hope I am missing
>>> something.
>>>
>>> The cluster has 2 servers (active/passive) and two clients
>>> (tomcat6/spring-security tims).  The servers are located a couple
>>> thousand miles from each other, and the clients are co-located on the
>>> same boxes as the servers.
>>>
>>> This morning I checked out the TC Dev Console and both servers were
>>> active and only one client was appearing.
>>>
>>> How can I avoid this situation?  And I missing something in the
>>> config?  I wouldn't be so worried, but it has happened twice in 2
>>> days... and this is a new install, so 2-days basically means every
>>> day.  And that worries me a bit.
>>>
>>> Any/all help would be appreciated.  Thanks.
>>>
>>>
>>> <tc:tc-config xmlns:tc="http://www.terracotta.org/config"
>>>        xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
>>>        xsi:schemaLocation="http://www.terracotta.org/schema/
>>> terracotta-4.xsd">
>>>
>>>        <tc-properties>
>>>                <property name="l2.l1reconnect.enabled"
>>> value="true" />
>>>                <property name="l2.l1reconnect.timeout.millis"
>>> value="10000"
>>> />
>>>                <property
>>> name="l2.objectmanager.fault.logging.enabled" value="true" />
>>>                <property name="l2.nha.tcgroupcomm.reconnect.enabled"
>>> value="true" />
>>>                <property name="l2.nha.tcgroupcomm.reconnect.timeout"
>>> value="10000" />
>>>        </tc-properties>
>>>
>>>        <servers>
>>>                <server host="1.1.1.1" name="galileo">
>>>                        <data>/usr/local/terracotta/data/galileo</
>>> data>
>>>                        <logs>/usr/local/terracotta/logs/galileo</
>>> logs>
>>>                        <l2-group-port>9530</l2-group-port>
>>>                        <dso-port>9510</dso-port>
>>>                        <dso>
>>>                                <persistence>
>>>                                        <mode>permanent-store</mode>
>>>                                </persistence>
>>>                        </dso>
>>>                </server>
>>>
>>>                <server host="2.2.2.2" name="pasteur">
>>>                        <data>/usr/local/terracotta/data/pasteur</
>>> data>
>>>                        <logs>/usr/local/terracotta/logs/pasteur</
>>> logs>
>>>                        <l2-group-port>9530</l2-group-port>
>>>                        <dso-port>9510</dso-port>
>>>                        <dso>
>>>                                <persistence>
>>>                                        <mode>permanent-store</mode>
>>>                                </persistence>
>>>                        </dso>
>>>                </server>
>>>
>>>                <ha>
>>>                        <mode>networked-active-passive</mode>
>>>                        <networked-active-passive>
>>>                                <election-time>5</election-time>
>>>                        </networked-active-passive>
>>>                </ha>
>>>
>>>                <update-check>
>>>                        <enabled>true</enabled>
>>>                </update-check>
>>>        </servers>
>>>
>>>        <clients>
>>>                <logs>/usr/local/terracotta/logs/client-logs</logs>
>>>
>>> <statistics>/usr/local/terracotta/data/%(tc.node-name)/client-
>>> statistics</statistics>
>>>                <modules>
>>>                        <module name="tim-tomcat-6.0"
>>> version="1.0.1" />
>>>                        <module name="tim-spring-security-2.0"
>>> version="1.1.1" />
>>>                </modules>
>>>        </clients>
>>>
>>>        <application>
>>>                <dso>
>>>                        <instrumented-classes>
>>>                                <include>
>>>
>>> <class-expression>com.company.sensor.remoting.model.*</class-
>>> expression>
>>>                                </include>
>>>                                <include>
>>>
>>> <class-expression>com.company.calendar.model.*</class-expression>
>>>                                </include>
>>>                                <include>
>>>
>>> <class-expression>com.company..shared..*</class-expression>
>>>                                </include>
>>>                        </instrumented-classes>
>>>
>>>                        <web-applications>
>>>                                <web-application>ROOT</web-
>>> application>
>>>                        </web-applications>
>>>                </dso>
>>>        </application>
>>>
>>> </tc:tc-config>
>>> _______________________________________________
>>> tc-users mailing list
>>> tc-users@...
>>> http://lists.terracotta.org/mailman/listinfo/tc-users
>>>
>>>
>>> _______________________________________________
>>> tc-users mailing list
>>> tc-users@...
>>> http://lists.terracotta.org/mailman/listinfo/tc-users
>>>
>>>
>>> <logs.zip>
>> _______________________________________________
>> tc-users mailing list
>> tc-users@...
>> http://lists.terracotta.org/mailman/listinfo/tc-users
>
> _______________________________________________
> tc-users mailing list
> tc-users@...
> http://lists.terracotta.org/mailman/listinfo/tc-users
>


_______________________________________________
tc-users mailing list
tc-users@...
http://lists.terracotta.org/mailman/listinfo/tc-users

tc-logs.zip (319K) Download Attachment