Utterly fail to set up a TPTP URL Test

[Andre]

Hi there

I am busy with TPTP for 2 full work days meanwhile, trying desperately to invoke one simple TPTP URL Test. After failing me with dozens of setups I ended up having a very very simple project just kindly asking for one basic HTTP GET of www.eclipse.org (localhost:8080 ain't much cooperative either) and still it refuses a decent run giving me "fail rc=400". So reponse code is 400, bad news.

Some further details.
First I was trying to apply closely the steps discussed here...
Creating URL tests: http://www.eclipse.org/tptp/home/documents/tutorials/viewlets/v4.1/EW-URLTest/EW-URLTest/EW-URLTest_viewlet_swf.html
This tutorial gives good theoretical information to start with but completely fails in supplying a practical approach. Because the wizard called 'Test/Recordings/HTTP Recording' mentioned in the tutorial simply doesn't exist in the current TPTP platform (anymore).
But I don't regard this as severe since I guess it is quite possible to build up an TPTP URL Test manually.
I did this by creating...
 * Java project
 * folder testing
 * wizard 'Test/TPTP URL Test' named \testing\testing.testsuite
 * creating precisely one http GET request within that test
 * supplying www.eclipse.org as hostname (PORT 80) (among countless other tries, e.g. localhost:8080)
 * absoulte path: / (among countless other tries such as index.html on my local machine, which
    was successfully delivered by asking for http://localhost:8080/index.html using firefox, of course)
 * no HTTP GET Headers supplied
 * adding this http request in "Behaviour"
 * Auto-generated the firing class by "Generate" (context-menu) (in Test-Perspective )
 * and finally Run it (in Test-Perspective )

this yielded a log file named \testing.execution that keeps saying "fail". It cheekingly fails when
assertTrue(text, response.getCode() < 400 && response.getCode() > 0);
saying the server (localhost or any internet server such as www.eclipse.org) replied with rc=400, which means "bad request"

I "burned" money worth of 2 work days with this and my first feedback to my manager was: "TPTP is still in its infancy and will require a year or so to become a tool we could consider doing our profiling with." Okay guys. If this does give you some itches, please tell me where I am going wrong. My eternal gratitude to you would be garantueed.

Even further questions regarding my setup steps could be helpful. At some times this is all that is needed.

Cheers and have a good one
André

[Andre]

Hi there

So I have given up any hope of resolving this. We abandoned our goal of profiling our current project for our customer using TPTP. This brought about our decision:

https://bugs.eclipse.org/bugs/show_bug.cgi?id=139699
"The org.eclipse.hyades.test.http.runner.HttpResponse class does not expose the complete HTTP response.  For example, session ID.  Thus it is impossible to modify a recorded http session to replace the recorded sessionid with the sessionid returned by the login http request. This makes TPTP url testing impossible for our framework.  

URL Test was originally intended to do "URL blasting", and does not support a number of capabilities that make it suitable for more complex transactional scenarios that require data correlation (for example).  There will need to be some additional APIs added to fully support data correlation, and as such, a group of related defects are being targeted for the next release, 4.3.  The intent in those related improvements will be to make it possible via additional API and completed functionality for a user (or consuming tool) to program data correlation in by editing the generated test, but not to have the URL test gen provide automatic data correlation in its generated tests. "

Our problems with TPTP Url Test start at an even earlier stage. Meanwhile I was able to successfully request an HTTP GET to www.eclipse.org (path: /). But localhost:8080 still fails with Code 400. Even if we could solve this after hours (and a huge pile of money later) passed by, we would then run into the "session-trouble" outlined above.

Okay, so good luck with this platform. I sincerely hope you guys will do good for the future.
Cheers
André

[Paul Slauenwhite]

Hi Andre,
I regret that you are having issues with TPTP. I would like to discuss this a bit more to fully understand your issues before you move on from the project.

First, what version of TPTP are you using? Are you using the Agent Controller or Integrated Agent Controller? What OS, JRE (version/vendor), browser (version/vendor) are you using?

When you were recording on localhost:8080 and received the 400 return code (assuming the web server was running locally), were you recording with Internet Explorer V7? If so, did you see the following TPTP release note:

http://www.eclipse.org/tptp/home/downloads/4.5.0/documents/releasenotes/releasenotes4_5_0.html#4_CTI_8

As TPTP enhancement https://bugs.eclipse.org/bugs/show_bug.cgi?id=139699 indicates, the URL recorder and test type currently does not support complex transactional scenarios. However, these scenarios are currently supported one of our consuming products, IBM Rational Performance Tester. Unfortunately, we have not had sufficient project resources to deliver this enhancement in the open-source. However, one of the benefits of open-source software is community contributions. Would you or your company be interested in contributing a patch for this enhancement?

PS
__________________________

Paul Slauenwhite
IBM Toronto Lab, Canada

Internet: paules@...
Telephone: [phone]
Tie Line: 313-3861
__________________________

Please consider the environment before printing this email.

Andre <Andre.Kuhn@...>

Andre <Andre.Kuhn@...>
Sent by: tptp-testing-tools-dev-bounces@...

09/01/2009 09:48 AM

Please respond to
TPTP Testing Tools Project developer discussions <tptp-testing-tools-dev@...>

To	tptp-testing-tools-dev@...
cc
Subject	Re: [tptp-testing-tools-dev] Utterly fail to set up a TPTP URL Test

Hi there

So I have given up any hope of resolving this. We abandoned our goal of
profiling our current project for our customer using TPTP. This brought
about our decision:

https://bugs.eclipse.org/bugs/show_bug.cgi?id=139699
"The org.eclipse.hyades.test.http.runner.HttpResponse class does not expose
the complete HTTP response.  For example, session ID.  Thus it is impossible
to modify a recorded http session to replace the recorded sessionid with the
sessionid returned by the login http request. This makes TPTP url testing
impossible for our framework.  

URL Test was originally intended to do "URL blasting", and does not support
a number of capabilities that make it suitable for more complex
transactional scenarios that require data correlation (for example).  There
will need to be some additional APIs added to fully support data
correlation, and as such, a group of related defects are being targeted for
the next release, 4.3.  The intent in those related improvements will be to
make it possible via additional API and completed functionality for a user
(or consuming tool) to program data correlation in by editing the generated
test, but not to have the URL test gen provide automatic data correlation in
its generated tests. "

Our problems with TPTP Url Test start at an even earlier stage. Meanwhile I
was able to successfully request an HTTP GET to www.eclipse.org (path: /).
But localhost:8080 still fails with Code 400. Even if we could solve this
after hours (and a huge pile of money later) passed by, we would then run
into the "session-trouble" outlined above.

Okay, so good luck with this platform. I sincerely hope you guys will do
good for the future.
Cheers
André

--
View this message in context: http://www.nabble.com/Utterly-fail-to-set-up-a-TPTP-URL-Test-tp21357057p21372662.html
Sent from the Eclipse TPTP - Testing Tools - Dev mailing list archive at Nabble.com.

_______________________________________________
tptp-testing-tools-dev mailing list
tptp-testing-tools-dev@...
https://dev.eclipse.org/mailman/listinfo/tptp-testing-tools-dev





_______________________________________________
tptp-testing-tools-dev mailing list
tptp-testing-tools-dev@...
https://dev.eclipse.org/mailman/listinfo/tptp-testing-tools-dev

[Andre]

Paul, many thanks for your response and your hint to the TPTP release notes!
To answer some of your questions:
OS:
Windows XP Prof,
JRE (SUN):
java version "1.6.0_07" Java(TM) SE Runtime Environment (build 1.6.0_07-b06)            
Java HotSpot(TM) Client VM (build 10.0-b23, mixed mode, sharing)
TPTP: 4.5 (added to Eclipse Version: 3.4.0 via Software-Update: Ganymede branch)
Browser: Firefox 3.0.5

Unfortunately, we cannot free any resources to help making TPTP capable of handling complex transactional scenarios.

Cheers
André

[Paul Slauenwhite]

Hi Andre,
Again, I regret that you are having issues with TPTP.

Your scenario/configuration is tested and should work using the latest version of TPTP 4.5.2. If you are not using IPv6 (see 4.CTI.9 and 4.CTI.10 from http://www.eclipse.org/tptp/home/downloads/4.5.0/documents/releasenotes/releasenotes4_5_0.html) and the web server is running locally, I would suggest using the IP address of the local host instead of the host name, loopback address (for example, 127.0.0.1), or 'localhost' in the URL. For example, http://24.89.213.179. If this does not resolve your problem, please open a TPTP defect (https://bugs.eclipse.org/bugs/enter_bug.cgi?product=TPTP%20Testing).

PS
__________________________

Paul Slauenwhite
IBM Toronto Lab, Canada

Internet: paules@...
Telephone: [phone]
Tie Line: 313-3861
__________________________

Please consider the environment before printing this email.

Andre <Andre.Kuhn@...>

Andre <Andre.Kuhn@...>
Sent by: tptp-testing-tools-dev-bounces@...

01/16/2009 08:49 AM

Please respond to
TPTP Testing Tools Project developer discussions <tptp-testing-tools-dev@...>

To	tptp-testing-tools-dev@...
cc
Subject	Re: [tptp-testing-tools-dev] Utterly fail to set up a TPTP URL Test

Paul, many thanks for your response and your hint to the TPTP release notes!
To answer some of your questions:
OS:
Windows XP Prof,
JRE (SUN):
java version "1.6.0_07" Java(TM) SE Runtime Environment (build 1.6.0_07-b06)            
Java HotSpot(TM) Client VM (build 10.0-b23, mixed mode, sharing)
TPTP: 4.5 (added to Eclipse Version: 3.4.0 via Software-Update: Ganymede
branch)
Browser: Firefox 3.0.5

Unfortunately, we cannot free any resources to help making TPTP capable of
handling complex transactional scenarios.

Cheers
André

--
View this message in context: http://www.nabble.com/Utterly-fail-to-set-up-a-TPTP-URL-Test-tp21357057p21498643.html
Sent from the Eclipse TPTP - Testing Tools - Dev mailing list archive at Nabble.com.

_______________________________________________
tptp-testing-tools-dev mailing list
tptp-testing-tools-dev@...
https://dev.eclipse.org/mailman/listinfo/tptp-testing-tools-dev





_______________________________________________
tptp-testing-tools-dev mailing list
tptp-testing-tools-dev@...
https://dev.eclipse.org/mailman/listinfo/tptp-testing-tools-dev