Fwd: How to use Xnee to perform the auto GUI test for gtk+ based phone applications?

[li zhou-2]

Some parts of this message have been removed. Learn more about Nabble's security policy.

Hello all:

We are making contributions to LiPS ( http://www.lipsforum.org ) and developing some software and applications to implement the LiPS Specifications. Some software have been done. To ensure the quality of those software and save resources, we want to use some open source tools to perform the auto GUI test for some gtk+ based phone applications like address book, voice call. Xnee is a good candidate. And yes, it is indeed. But after some investigation, we find that Xnee can't help to determine the correctness of the test result except the recording and replaying. So we have no choice but turn to your help whether we can find a solution to achieve this.  

 

To explain our requirements clearly, here is a example of  the "contact search" for address book  application . For example, in  the  search interface of Address book,  when typing 'j' through  phone keypad , the matched contacts starting with 'j' will be listed in alphabet order. we name the matched contacts as the expected results. 

 

Our current status is: test specification is ready and we can perform the recording and replaying correctly with Xnee. The scenario we image is like below:

(1). tester or developer perform the test manually according to the test specification to obtain the test script which just record the EVENT sequence, that is the 'recording' process.

(2). For the regression test, the test will be perform the test automatically without tester's intervention.

 

The current Xnee release can't meet the requirement of step (2). After reading the Xnee manual, maybe the 'synchronism mechanism in Xnee" is helpful. As the synchronism mechanism, it records more DATA than just the EVENT to be replayed. Based on this mechanism, we think that can we also introduce this mechanism to step (1) to record the test results as the DATA field in the script file. (for each test case in our test specifications, the results/outputs will be specified for the given inputs. this is the base of our idea.)   During the replaying process, just comparing the DATA field with those DATA from recording process Xnee will determine the correctness automatically. Because the DATA output will be same for each test case ideally.

 

You are the exact expert, would you be so kind to help us out on the feasibility and implementation. If necessary, we can make a conf-call with you. 

 

Many thanks and looking forward to your help.... 

 

Best Regards,

_______________________________________________
Info-xnee mailing list
Info-xnee@...
http://lists.gnu.org/mailman/listinfo/info-xnee

[Jeremiah Foster-8]

Some parts of this message have been removed. Learn more about Nabble's security policy.

Hi Li Zhou,

 

My name is Jeremiah Foster and I help Henrik (hesa) maintain the Xnee tool suite. Here in Sweden, where we both live, it is the Christmas season - a big holiday. I think Henrik will be hard to reach the next two weeks, he has had a busy year and is most likely going to take some time off. But he will definitely answer your email, just give him a little more time than normal.

 

    Best regards,

 

    Jeremiah

---

From: li zhou [mailto:jaguarzhou@...]
Sent: den 20 december 2007 04:35
To: Info-xnee@...
Subject: [Info-xnee] Fwd: How to use Xnee to perform the auto GUI test forgtk+ based phone applications?

Hello all:

We are making contributions to LiPS ( http://www.lipsforum.org ) and developing some software and applications to implement the LiPS Specifications. Some software have been done. To ensure the quality of those software and save resources, we want to use some open source tools to perform the auto GUI test for some gtk+ based phone applications like address book, voice call. Xnee is a good candidate. And yes, it is indeed. But after some investigation, we find that Xnee can't help to determine the correctness of the test result except the recording and replaying. So we have no choice but turn to your help whether we can find a solution to achieve this.  

 

To explain our requirements clearly, here is a example of  the "contact search" for address book  application . For example, in  the  search interface of Address book,  when typing 'j' through  phone keypad , the matched contacts starting with 'j' will be listed in alphabet order. we name the matched contacts as the expected results. 

 

Our current status is: test specification is ready and we can perform the recording and replaying correctly with Xnee. The scenario we image is like below:

(1). tester or developer perform the test manually according to the test specification to obtain the test script which just record the EVENT sequence, that is the 'recording' process.

(2). For the regression test, the test will be perform the test automatically without tester's intervention.

 

The current Xnee release can't meet the requirement of step (2). After reading the Xnee manual, maybe the 'synchronism mechanism in Xnee" is helpful. As the synchronism mechanism, it records more DATA than just the EVENT to be replayed. Based on this mechanism, we think that can we also introduce this mechanism to step (1) to record the test results as the DATA field in the script file. (for each test case in our test specifications, the results/outputs will be specified for the given inputs. this is the base of our idea.)   During the replaying process, just comparing the DATA field with those DATA from recording process Xnee will determine the correctness automatically. Because the DATA output will be same for each test case ideally.

 

You are the exact expert, would you be so kind to help us out on the feasibility and implementation. If necessary, we can make a conf-call with you. 

 

Many thanks and looking forward to your help.... 

 

Best Regards,

_______________________________________________
Info-xnee mailing list
Info-xnee@...
http://lists.gnu.org/mailman/listinfo/info-xnee

[Henrik Sandklef-2]

li zhou skrev:

> Hello all:
>
> We are making contributions to LiPS ( http://www.lipsforum.org ) and
> developing some software and applications to implement the LiPS
> Specifications. Some software have been done. To ensure the quality of those
> software and save resources, we want to use some open source tools to
> perform the auto GUI test for some gtk+ based phone applications like
> address book, voice call. Xnee is a good candidate. And yes, it is indeed.
> But after some investigation, we find that Xnee can't help to determine the
> correctness of the test result except the recording and replaying. So we
> have no choice but turn to your help whether we can find a solution to
> achieve this.
>
> To explain our requirements clearly, here is a example of  the "contact
> search" for address book  application . For example, in  the  search interface
> of Address book,  when typing 'j' through  phone keypad , the matched
> contacts starting with 'j' will be listed in alphabet order. we name the
> matched contacts as the expected results.
>
> Our current status is: test specification is ready and we can perform the
> recording and replaying correctly with Xnee. The scenario we image is like
> below:
> (1). tester or developer perform the test manually according to the test
> specification to obtain the test script which just record the EVENT
> sequence, that is the '*recording*' process.
> (2). For the regression test, the test will be perform the test
> automatically without tester's intervention.
>
> The current Xnee release can't meet the requirement of step (2). After
> reading the Xnee manual, maybe the 'synchronism mechanism in Xnee" is
> helpful. As the synchronism mechanism, it records more DATA than just the
> EVENT to be replayed. Based on this mechanism, we think that can we also
> introduce this mechanism to step (1) to record the test results as the DATA
> field in the script file. (for each test case in our test
> specifications, the results/outputs will be specified for the given inputs.
> this is the base of our idea.)   During the replaying process, just
> comparing the DATA field with those DATA from recording process Xnee will
> determine the correctness automatically. Because the DATA output
> will be same for each test case ideally.
>
> You are the exact expert,

guess not ;)

> would you be so kind to help us out on
> the feasibility and implementation. If necessary, we can make a conf-call
> with you.


Right now I see two ways to solve your problem:

1) Do small printouts in your tested program[1] that can be enabled in
compile time through C macros (#define) or run time through a command
line option. Compare the printouts when you recorded with the printout
from when replayed.


2) Use the -ep and -ek options. I just discovererd a newliy introduced
bug in them so hold on for a short while, will fix it asap. An example:
   -ek F5 -ep "do-snapshot.sh"

  2.1 Make a script (do-snapshot.sh) that takes a snapshot of your
display and stores it somewhere.

  2.2 Every time you press F5 during record, Xnee will
   * add a mark in the recorded file (see below) together with
"do-snapshot.sh"
   * launch do-snapshot.sh[2]

  2.3 Move the image somewhere else.

  2.4 When replaying Xnee will eventually read the special mark in the
recorded file. When reading this Xnee will launch do-snapshot.sh.

  2.5 Compare the image from the recorded session with the newly
replayed session.


... could any of the procedures above help you???



[1] one can argue and say that the program you're testing is not the
same as you 'deliver' to your customer. Make sure the printout does NOT
interfere with the programs normal work!!!

> Many thanks and looking forward to your help....
>
> Best Regards,
>
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> Info-xnee mailing list
> Info-xnee@...
> http://lists.gnu.org/mailman/listinfo/info-xnee

_______________________________________________
Info-xnee mailing list
Info-xnee@...
http://lists.gnu.org/mailman/listinfo/info-xnee

[Henrik Sandklef-2]

Henrik Sandklef skrev:
> ....
> I just discovererd a newliy introduced
> bug in them so hold on for a short while, will fix it asap.

Fixed in CVS head.



_______________________________________________
Info-xnee mailing list
Info-xnee@...
http://lists.gnu.org/mailman/listinfo/info-xnee

[li zhou-2]

Some parts of this message have been removed. Learn more about Nabble's security policy.

---------- Forwarded message ----------
From: li zhou <jaguarzhou@...>
Date: 2007-12-20 上午11:34
Subject: Fwd: How to use Xnee to perform the auto GUI test for gtk+ based phone applications?
To: Info-xnee@...

Hello all:

We are making contributions to LiPS ( http://www.lipsforum.org ) and developing some software and applications to implement the LiPS Specifications. Some software have been done. To ensure the quality of those software and save resources, we want to use some open source tools to perform the auto GUI test for some gtk+ based phone applications like address book, voice call. Xnee is a good candidate. And yes, it is indeed. But after some investigation, we find that Xnee can't help to determine the correctness of the test result except the recording and replaying. So we have no choice but turn to your help whether we can find a solution to achieve this.  

 

To explain our requirements clearly, here is a example of  the "contact search" for address book  application . For example, in  the  search interface of Address book,  when typing 'j' through  phone keypad , the matched contacts starting with 'j' will be listed in alphabet order. we name the matched contacts as the expected results. 

 

Our current status is: test specification is ready and we can perform the recording and replaying correctly with Xnee. The scenario we image is like below:

(1). tester or developer perform the test manually according to the test specification to obtain the test script which just record the EVENT sequence, that is the 'recording' process.

(2). For the regression test, the test will be perform the test automatically without tester's intervention.

 

The current Xnee release can't meet the requirement of step (2). After reading the Xnee manual, maybe the 'synchronism mechanism in Xnee" is helpful. As the synchronism mechanism, it records more DATA than just the EVENT to be replayed. Based on this mechanism, we think that can we also introduce this mechanism to step (1) to record the test results as the DATA field in the script file. (for each test case in our test specifications, the results/outputs will be specified for the given inputs. this is the base of our idea.)   During the replaying process, just comparing the DATA field with those DATA from recording process Xnee will determine the correctness automatically. Because the DATA output will be same for each test case ideally.

 

You are the exact expert, would you be so kind to help us out on the feasibility and implementation. If necessary, we can make a conf-call with you. 

 

Many thanks and looking forward to your help.... 

 

Best Regards,

_______________________________________________
Info-xnee mailing list
Info-xnee@...
http://lists.gnu.org/mailman/listinfo/info-xnee

[Henrik Sandklef-2]

Hi again,

did you not get my reply to these questions. They were sent:
  2008-01-01 19:27
you can find 'em here:
  http://lists.gnu.org/archive/html/info-xnee/2008-01/msg00000.html


li zhou skrev:

> ---------- Forwarded message ----------
> From: li zhou <jaguarzhou@...>
> Date: 2007-12-20 上午11:34
> Subject: Fwd: How to use Xnee to perform the auto GUI test for gtk+ based
> phone applications?
> To: Info-xnee@...
>
>
> Hello all:
>
> We are making contributions to LiPS ( http://www.lipsforum.org ) and
> developing some software and applications to implement the LiPS
> Specifications. Some software have been done. To ensure the quality of those
> software and save resources, we want to use some open source tools to
> perform the auto GUI test for some gtk+ based phone applications like
> address book, voice call. Xnee is a good candidate. And yes, it is indeed.
> But after some investigation, we find that Xnee can't help to determine the
> correctness of the test result except the recording and replaying. So we
> have no choice but turn to your help whether we can find a solution to
> achieve this.
>
> To explain our requirements clearly, here is a example of  the "contact
> search" for address book  application . For example, in  the  search interface
> of Address book,  when typing 'j' through  phone keypad , the matched
> contacts starting with 'j' will be listed in alphabet order. we name the
> matched contacts as the expected results.
>
> Our current status is: test specification is ready and we can perform the
> recording and replaying correctly with Xnee. The scenario we image is like
> below:
> (1). tester or developer perform the test manually according to the test
> specification to obtain the test script which just record the EVENT
> sequence, that is the '*recording*' process.
> (2). For the regression test, the test will be perform the test
> automatically without tester's intervention.
>
> The current Xnee release can't meet the requirement of step (2). After
> reading the Xnee manual, maybe the 'synchronism mechanism in Xnee" is
> helpful. As the synchronism mechanism, it records more DATA than just the
> EVENT to be replayed. Based on this mechanism, we think that can we also
> introduce this mechanism to step (1) to record the test results as the DATA
> field in the script file. (for each test case in our test
> specifications, the results/outputs will be specified for the given inputs.
> this is the base of our idea.)   During the replaying process, just
> comparing the DATA field with those DATA from recording process Xnee will
> determine the correctness automatically. Because the DATA output
> will be same for each test case ideally.
>
> You are the exact expert, would you be so kind to help us out on
> the feasibility and implementation. If necessary, we can make a conf-call
> with you.
>
> Many thanks and looking forward to your help....
>
> Best Regards,
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> Info-xnee mailing list
> Info-xnee@...
> http://lists.gnu.org/mailman/listinfo/info-xnee

_______________________________________________
Info-xnee mailing list
Info-xnee@...
http://lists.gnu.org/mailman/listinfo/info-xnee