Nabble - HtmlUnit - General

Fw: 403 forbidden

2009-12-17T09:21:57Z

Hi Gus,

* You must subscribe to the list before posting

* What about webClient.setThrowExceptionOnFailingStatusCode(false);

Ahmed

----
Blog: http://asashour.blogspot.com

----- Forwarded Message ----

Hi,

Is there a way to suppress stopping on receiving a 403 error. I am using htmlunit to access a site which is returning, mistakenly it seems a 403 error. The site also returns the html for the form. Thus a user using a browser sees the form fills it out and is able to use the site. HTMLUnit stops processing with the error.

com.gargoylesoftware.htmlunit.FailingHttpStatusCodeException: 403 Forbidden for https://my.airtricity.com/ews/welcome.jsp

Thanks,

Gus

------------------------------------------------------------------------------
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Javascript processing error

2009-12-16T23:35:32Z

Hi

I'm working on a scraping a site with ridiculously deeply nested frames and I'm getting Javascript exceptions when executing the javascript "parent.main.focus()" with the message "message=[TypeError: Method "focus" called on incompatible object. ...]. Walking the site manually works ok. [EDIT] I have setThrowExceptionOnScriptError(false) set on my webclient, but I'm still getting these errors

Any suggestions on how to deal with this?

Regards

Non-deterministic behavior with JavaScript

2009-12-16T17:28:18Z

I'm having some trouble with an application I'm writing, and hope that someone can clear up some questions for me.

The application loads an HTML page which has several IFRAMES, uses lots of JavaScript, and performs some cross-browser functionality before settling down and displaying the page to the user. It works beautifully in a browser every time.

However, when I use Htmlunit, it works properly about 2/3 of the time. The other 1/3 of the time, some of the JavaScript files never get fetched from the server, and the processing does not work properly.

My naive understanding was that when I call webClient.getPage(url) it will block until all of the JavaScript processing is complete. My testing suggests that this isn't the case - the call will return while there is still JavaScript executing. I'm not totally sure of this, the only diagnostics I have are writing to the console which is not entirely reliable. I also see the call waitForBackgroundJavaScriptStartingBefore which suggests this also (although I've had no luck using it).

So I can run the same exact test twice with all the same data and have Htmlunit succeed once and fail once. The only non-deterministic part of the test would seem to be the speed at which files are fetched from the web server. I'm thinking that perhaps this is creating some sort of race condition within Htmlunit. Is this possible?

Anyone have any ideas on what I can look at? The processing that Htmlunit does on the JavaScript *should* be very deterministic (right?).

Sander

--
Sander A. Smith
President

Sericon Technology Inc.
71 Marquette Ave.
Toronto, Ontario M6A 1X8
(416)781-3988

Link to me on LinkedIn
http://www.linkedin.com/in/sandersmith

Join our community of people interested in testing Facebook applications
http://www.TestFacebook.com

Learn about advanced tools for testing social networking applications
http://www.FriendRunner.com

http://www.sericontech.com

Fw: Next Release?

2009-12-16T14:45:40Z

Hi Dan,

* You must subscribe to the list before posting.

* We hope to have a release by end of this month.

Ahmed

----
Blog: http://asashour.blogspot.com

----- Forwarded Message ----

Hello,

Any idea when the next release will be stamped? Is there a schedule I can check?

Thanks,

Dan

------------------------------------------------------------------------------
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: Enclosing Page sometime disappear

2009-12-16T07:49:56Z

Bug in current window computation? An example is welcome.

Cheers,
Marc.

Adim a écrit :
> Hi,
> On my application I notice that sometimes after I successfully load and use
> (xpath queries) then few seconds later the page turns to null (I use the
> same web client - webClient.getCurrentWindow().getEnclosedPage() ).
> Any idea why it could happens? is there a some sort of time out?
>
> Regards,
> Adi.

------------------------------------------------------------------------------
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Enclosing Page sometime disappear

2009-12-16T07:37:58Z

Hi,
On my application I notice that sometimes after I successfully load and use (xpath queries) then few seconds later the page turns to null (I use the same web client - webClient.getCurrentWindow().getEnclosedPage() ).
Any idea why it could happens? is there a some sort of time out?

Regards,
Adi.

Re: List of files downloaded

2009-12-16T03:55:38Z

Ahmed,

I spent many hours trying to figure this one out. Your solution works great. Thanks a lot.

Sander

On Tue, Dec 15, 2009 at 11:09 PM, Ahmed Ashour <asashour@...> wrote:

Hi Sander,

You can subclass HttpWebConnection, and override getResponse() method, something like:

        webClient.setWebConnection(new HttpWebConnection(webClient) {
            @Override
            public WebResponse getResponse(WebRequestSettings settings)
            throws IOException {
                System.out.println(settings.getUrl());
                return super.getResponse(settings);
            }
        });

Yours,

Ahmed
----
Blog: http://asashour.blogspot.com

From: Sander A. Smith <smithsa@...>
To: htmlunit-user@...
Sent: Wed, December 16, 2009 6:00:26 AM
Subject: [Htmlunit-user] List of files downloaded

I'm trying to create a list of the files (and their URLs) that are downloaded in response to an action to load a page. I can see how to get the JavaScript files by registering a ScriptPreProcessor, but what do I do about the JPGs, CSSs, etc.? How can I be notified when they load?

Sander

--
Sander A. Smith
President

Sericon Technology Inc.
71 Marquette Ave.
Toronto, Ontario M6A 1X8
(416)781-3988

Link to me on LinkedIn
http://www.linkedin.com/in/sandersmith

Join our community of people interested in testing Facebook applications
http://www.TestFacebook.com

Learn about advanced tools for testing social networking applications
http://www.FriendRunner.com

http://www.sericontech.com

------------------------------------------------------------------------------
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

--
Sander A. Smith
President

Sericon Technology Inc.
71 Marquette Ave.
Toronto, Ontario M6A 1X8
(416)781-3988

Link to me on LinkedIn
http://www.linkedin.com/in/sandersmith

Join our community of people interested in testing Facebook applications
http://www.TestFacebook.com

Learn about advanced tools for testing social networking applications
http://www.FriendRunner.com

http://www.sericontech.com

------------------------------------------------------------------------------
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: List of files downloaded

2009-12-16T01:39:14Z

You can have a look at the DebuggingWebConnection as well, it generates
a report of all downloaded files.

Cheers,
Marc.

Ahmed Ashour a écrit :

> Hi Sander,
>
> You can subclass HttpWebConnection, and override getResponse() method,
> something like:
>
> webClient.setWebConnection(new HttpWebConnection(webClient) {
> @Override
> public WebResponse getResponse(WebRequestSettings settings)
> throws IOException {
> System.out.println(settings.getUrl());
> return super.getResponse(settings);
> }
> });
> Yours,
> Ahmed
> ----
> Blog: http://asashour.blogspot.com
> ------------------------------------------------------------------------
> *From:* Sander A. Smith <smithsa@...>
> *To:* htmlunit-user@...
> *Sent:* Wed, December 16, 2009 6:00:26 AM
> *Subject:* [Htmlunit-user] List of files downloaded
>
> I'm trying to create a list of the files (and their URLs) that are
> downloaded in response to an action to load a page. I can see how to get
> the JavaScript files by registering a ScriptPreProcessor, but what do I
> do about the JPGs, CSSs, etc.? How can I be notified when they load?
>
> Sander
>
> --
> Sander A. Smith
> President
>
> Sericon Technology Inc.
> 71 Marquette Ave.
> Toronto, Ontario M6A 1X8
> (416)781-3988
>
> Link to me on LinkedIn
> http://www.linkedin.com/in/sandersmith
>
> Join our community of people interested in testing Facebook applications
> http://www.TestFacebook.com
>
> Learn about advanced tools for testing social networking applications
> http://www.FriendRunner.com
>
> http://www.sericontech.com

Fw: ArrayIndexOutOfBoundsException in EncodingSniffer

2009-12-15T21:33:52Z

Hello Charles,

* You must subscribe to the list before posting.

* With 2.7-snapshot, I have a different error.

Anyway, please open a bug report.

Ahmed
----

Blog: http://asashour.blogspot.com

----- Forwarded Message ----
The attached message has been automatically discarded.

Hi,
I am using HtmlUnit 2.6 to scrape a website:
http://infopost.spectraenergy.com/infopost/default.asp?pipe=AG
This site loads & works properly in IE and Firefox.
In HtmlUnit, one of the iframes fails to load (404 error) so I try to ignore it, by calling
webClient.setThrowExceptionOnFailingStatusCode(false); before calling getPage(). (I'm not sure if this part is relevant).
Anyway then I get another error:
Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 4099
at com.gargoylesoftware.htmlunit.util.EncodingSniffer.indexOfSubArray(EncodingSniffer.java:716)
at com.gargoylesoftware.htmlunit.util.EncodingSniffer.sniffEncodingFromMetaTag(EncodingSniffer.java:351)
at com.gargoylesoftware.htmlunit.util.EncodingSniffer.sniffHtmlEncoding(EncodingSniffer.java:225)
at com.gargoylesoftware.htmlunit.util.EncodingSniffer.sniffEncoding(EncodingSniffer.java:134)
at com.gargoylesoftware.htmlunit.WebResponseImpl.getContentCharsetOrNull(WebResponseImpl.java:179)
at com.gargoylesoftware.htmlunit.html.HTMLParser.parse(HTMLParser.java:329)
at com.gargoylesoftware.htmlunit.html.HTMLParser.parseHtml(HTMLParser.java:304)
at com.gargoylesoftware.htmlunit.DefaultPageCreator.createHtmlPage(DefaultPageCreator.java:134)
at com.gargoylesoftware.htmlunit.DefaultPageCreator.createPage(DefaultPageCreator.java:101)
at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseInto(WebClient.java:447)
at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:330)
at com.gargoylesoftware.htmlunit.html.BaseFrame.loadInnerPageIfPossible(BaseFrame.java:125)
at com.gargoylesoftware.htmlunit.html.BaseFrame.loadInnerPage(BaseFrame.java:95)
at com.gargoylesoftware.htmlunit.html.HtmlPage.loadFrames(HtmlPage.java:1780)
at com.gargoylesoftware.htmlunit.html.HtmlPage.initialize(HtmlPage.java:176)
at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseInto(WebClient.java:454)
at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:330)
at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:387)
at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:372)
at GetPage.main(GetPage.java:21)

I'm not sure how to get around this one! Can anyone help please?

------------------------------------------------------------------------------
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: facebook login

2009-12-15T21:11:51Z

Hi Sander,

Public sites like facebook changes frequently.

By default, HtmlUnit fail with any JS error (just like real browsers), you can configure that with webClient.setThrowExceptionOnScriptError(false), however the website may not work correctly in this case.

Regarding the below case, the API was incorrectly used:

In the source of facebook login:

This can be accessed by:

page.getElementById("login_form")

Not by:

page.getFormByName("login_form");

Because the form does not have a name.

Ahmed

----
Blog: http://asashour.blogspot.com

From: Sander A. Smith <smithsa@...>
To: htmlunit-user@...
Sent: Tue, December 15, 2009 10:11:31 PM
Subject: Re: [Htmlunit-user] facebook login

Okay, I'm a bit confused here, maybe someone can clue me in.

My understanding was that Htmlunit has a problem with Facebook because the JavaScript that Facebook uses is known to be problematic. The browsers are able to deal with this, but Htmlunit can't. Of course, it's open source built by volunteers, so I'll give you guys some slack and appreciate all of the stuff that DOES work.

But now it sounds like things may work depending on how the HTML elements are addressed. Access them one way and things fail, but if you use XPath they work. Seems to me that this is competely separate from any JavaScript issues - what's going on?

Sander

On Tue, Dec 15, 2009 at 9:15 AM, Ahmed Ashour <asashour@...> wrote:

Great news.

ihavealegohead wrote:

>
>
>
> ihavealegohead wrote:
>>
>> I am testing htmlunit with facebook. I try a login, but fails:
>>
>> run:
>> Dec 14, 2009 5:50:12 PM
>> com.gargoylesoftware.htmlunit.IncorrectnessListenerImpl notify
>> WARNING: Expected content type of 'application/javascript' or
>> 'application/ecmascript' for remotely loaded JavaScript element at
>> 'http://b.static.ak.fbcdn.net/rsrc.php/zCOXE/hash/dbni8t78.js', but got
>> 'application/x-javascript'.
>> Exception in thread "main"
>> com.gargoylesoftware.htmlunit.ElementNotFoundException:
>> elementName=[form] attributeName=[name] attributeValue=[login_form]
>> at
>> com.gargoylesoftware.htmlunit.html.HtmlPage.getFormByName(HtmlPage.java:588)
>> at fblogin.Main.main(Main.java:36)
>> Java Result: 1
>> BUILD SUCCESSFUL (total time: 10 seconds)
>>
>>
>> Indeed, the login form attribute is login_form:
>>
>> <form method="POST"
>> action="https://login.facebook.com/login.php?login_attempt=1"
>> id="login_form">
>>
>> Here is my source:
>>
>> package fblogin;
>> import java.io.IOException;
>> import java.net.URL;
>>
>> import com.gargoylesoftware.htmlunit.BrowserVersion;
>> import com.gargoylesoftware.htmlunit.Page;
>> import com.gargoylesoftware.htmlunit.RefreshHandler;
>> import com.gargoylesoftware.htmlunit.WebClient;
>> import com.gargoylesoftware.htmlunit.html.HtmlForm;
>> import com.gargoylesoftware.htmlunit.html.HtmlPage;
>>
>>
>>
>> /**
>> *
>> * @author me
>> */
>> public class Main {
>>
>> /**
>> * @param args the command line arguments
>> */
>> public static void main(String[] args) throws Exception {
>> // Create and initialize WebClient object
>> WebClient webClient = new WebClient(BrowserVersion.FIREFOX_3);
>> webClient.setThrowExceptionOnScriptError(false);
>> webClient.setRefreshHandler(new RefreshHandler() {
>> public void handleRefresh(Page page, URL url, int arg) throws
>> IOException {
>> System.out.println("handleRefresh");
>> }
>>
>> });
>> // visit Facebook login page and get the Form object
>>
>> HtmlPage page = (HtmlPage)
>> webClient.getPage("http://www.facebook.com/login.php");
>> HtmlForm form = page.getFormByName("login_form");
>>
>> // Enter login and passwd
>> form.getInputByName("email").setValueAttribute("me@...");
>> form.getInputByName("pass").setValueAttribute("PASS");
>> // Click "Login" button/link
>> page = (HtmlPage) form.getInputByValue("Login").click();
>>
>> }
>> }
>>
>>
>> Any idea how I messed this up?
>>
>
>
> I wasn't able to get that code to work, so I switched it to Xpath:
>
> HtmlForm form =
> page.getFirstByXPath(".//*[@id='login_form']");

> form.getInputByName("email").setValueAttribute("me@...");
> form.getInputByName("pass").setValueAttribute("pass");

> page = (HtmlPage) form.getInputByValue("Login").click();
>
>
> -Thank You-
>
>
>

--
View this message in context: http://old.nabble.com/facebook-login-tp26780472p26795475.html

Sent from the HtmlUnit - General mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: List of files downloaded

2009-12-15T20:09:57Z

Hi Sander,

You can subclass HttpWebConnection, and override getResponse() method, something like:

        webClient.setWebConnection(new HttpWebConnection(webClient) {
            @Override
            public WebResponse getResponse(WebRequestSettings settings)
            throws IOException {
                System.out.println(settings.getUrl());
                return super.getResponse(settings);
            }
        });

Yours,

Ahmed

----
Blog: http://asashour.blogspot.com

From: Sander A. Smith <smithsa@...>
To: htmlunit-user@...
Sent: Wed, December 16, 2009 6:00:26 AM
Subject: [Htmlunit-user] List of files downloaded

I'm trying to create a list of the files (and their URLs) that are downloaded in response to an action to load a page. I can see how to get the JavaScript files by registering a ScriptPreProcessor, but what do I do about the JPGs, CSSs, etc.? How can I be notified when they load?

List of files downloaded

2009-12-15T19:00:26Z

Re: facebook login

2009-12-15T11:11:31Z

Okay, I'm a bit confused here, maybe someone can clue me in.

Sander

On Tue, Dec 15, 2009 at 9:15 AM, Ahmed Ashour <asashour@...> wrote:

Great news.

ihavealegohead wrote:
>
>
>
> ihavealegohead wrote:
>>
>> I am testing htmlunit with facebook. I try a login, but fails:
>>
>> run:
>> Dec 14, 2009 5:50:12 PM
>> com.gargoylesoftware.htmlunit.IncorrectnessListenerImpl notify
>> WARNING: Expected content type of 'application/javascript' or
>> 'application/ecmascript' for remotely loaded JavaScript element at
>> 'http://b.static.ak.fbcdn.net/rsrc.php/zCOXE/hash/dbni8t78.js', but got
>> 'application/x-javascript'.
>> Exception in thread "main"
>> com.gargoylesoftware.htmlunit.ElementNotFoundException:
>> elementName=[form] attributeName=[name] attributeValue=[login_form]
>> at
>> com.gargoylesoftware.htmlunit.html.HtmlPage.getFormByName(HtmlPage.java:588)
>> at fblogin.Main.main(Main.java:36)
>> Java Result: 1
>> BUILD SUCCESSFUL (total time: 10 seconds)
>>
>>
>> Indeed, the login form attribute is login_form:
>>
>> <form method="POST"
>> action="https://login.facebook.com/login.php?login_attempt=1"
>> id="login_form">
>>
>> Here is my source:
>>
>> package fblogin;
>> import java.io.IOException;
>> import java.net.URL;
>>
>> import com.gargoylesoftware.htmlunit.BrowserVersion;
>> import com.gargoylesoftware.htmlunit.Page;
>> import com.gargoylesoftware.htmlunit.RefreshHandler;
>> import com.gargoylesoftware.htmlunit.WebClient;
>> import com.gargoylesoftware.htmlunit.html.HtmlForm;
>> import com.gargoylesoftware.htmlunit.html.HtmlPage;

>>
>>
>>
>> /**
>> *
>> * @author me
>> */
>> public class Main {
>>
>> /**
>> * @param args the command line arguments
>> */
>> public static void main(String[] args) throws Exception {
>> // Create and initialize WebClient object
>> WebClient webClient = new WebClient(BrowserVersion.FIREFOX_3);
>> webClient.setThrowExceptionOnScriptError(false);
>> webClient.setRefreshHandler(new RefreshHandler() {
>> public void handleRefresh(Page page, URL url, int arg) throws
>> IOException {
>> System.out.println("handleRefresh");
>> }
>>
>> });
>> // visit Facebook login page and get the Form object
>>
>> HtmlPage page = (HtmlPage)
>> webClient.getPage("http://www.facebook.com/login.php");
>> HtmlForm form = page.getFormByName("login_form");
>>
>> // Enter login and passwd
>> form.getInputByName("email").setValueAttribute("me@...");
>> form.getInputByName("pass").setValueAttribute("PASS");
>> // Click "Login" button/link
>> page = (HtmlPage) form.getInputByValue("Login").click();
>>
>> }
>> }
>>
>>
>> Any idea how I messed this up?
>>
>
>
> I wasn't able to get that code to work, so I switched it to Xpath:
>
> HtmlForm form =
> page.getFirstByXPath(".//*[@id='login_form']");

> form.getInputByName("email").setValueAttribute("me@...");
> form.getInputByName("pass").setValueAttribute("pass");

> page = (HtmlPage) form.getInputByValue("Login").click();
>
>
> -Thank You-
>
>
>

--
View this message in context: http://old.nabble.com/facebook-login-tp26780472p26795475.html

Sent from the HtmlUnit - General mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: facebook login

2009-12-15T06:15:04Z

Great news.

ihavealegohead wrote:

ihavealegohead wrote:

I am testing htmlunit with facebook. I try a login, but fails:

run:
Dec 14, 2009 5:50:12 PM com.gargoylesoftware.htmlunit.IncorrectnessListenerImpl notify
WARNING: Expected content type of 'application/javascript' or 'application/ecmascript' for remotely loaded JavaScript element at 'http://b.static.ak.fbcdn.net/rsrc.php/zCOXE/hash/dbni8t78.js', but got 'application/x-javascript'.
Exception in thread "main" com.gargoylesoftware.htmlunit.ElementNotFoundException: elementName=[form] attributeName=[name] attributeValue=[login_form]
at com.gargoylesoftware.htmlunit.html.HtmlPage.getFormByName(HtmlPage.java:588)
at fblogin.Main.main(Main.java:36)
Java Result: 1
BUILD SUCCESSFUL (total time: 10 seconds)

Indeed, the login form attribute is login_form:

<form method="POST" action="https://login.facebook.com/login.php?login_attempt=1" id="login_form">

Here is my source:

package fblogin;
import java.io.IOException;
import java.net.URL;

import com.gargoylesoftware.htmlunit.BrowserVersion;
import com.gargoylesoftware.htmlunit.Page;
import com.gargoylesoftware.htmlunit.RefreshHandler;
import com.gargoylesoftware.htmlunit.WebClient;
import com.gargoylesoftware.htmlunit.html.HtmlForm;
import com.gargoylesoftware.htmlunit.html.HtmlPage;

/**
*
* @author me
*/
public class Main {

/**
* @param args the command line arguments
*/
public static void main(String[] args) throws Exception {
// Create and initialize WebClient object
WebClient webClient = new WebClient(BrowserVersion.FIREFOX_3);
webClient.setThrowExceptionOnScriptError(false);
webClient.setRefreshHandler(new RefreshHandler() {
public void handleRefresh(Page page, URL url, int arg) throws IOException {
System.out.println("handleRefresh");
}

});
// visit Facebook login page and get the Form object

HtmlPage page = (HtmlPage) webClient.getPage("http://www.facebook.com/login.php");
HtmlForm form = page.getFormByName("login_form");

// Enter login and passwd
form.getInputByName("email").setValueAttribute("me@email.com");
form.getInputByName("pass").setValueAttribute("PASS");
// Click "Login" button/link
page = (HtmlPage) form.getInputByValue("Login").click();

}
}

Any idea how I messed this up?

I wasn't able to get that code to work, so I switched it to Xpath:

HtmlForm form = page.getFirstByXPath(".//*[@id='login_form']");
form.getInputByName("email").setValueAttribute("me@email.com");
form.getInputByName("pass").setValueAttribute("pass");
page = (HtmlPage) form.getInputByValue("Login").click();

-Thank You-

Re: facebook login

2009-12-15T06:05:11Z

ihavealegohead wrote:

I am testing htmlunit with facebook. I try a login, but fails:

run:
Dec 14, 2009 5:50:12 PM com.gargoylesoftware.htmlunit.IncorrectnessListenerImpl notify
WARNING: Expected content type of 'application/javascript' or 'application/ecmascript' for remotely loaded JavaScript element at 'http://b.static.ak.fbcdn.net/rsrc.php/zCOXE/hash/dbni8t78.js', but got 'application/x-javascript'.
Exception in thread "main" com.gargoylesoftware.htmlunit.ElementNotFoundException: elementName=[form] attributeName=[name] attributeValue=[login_form]
at com.gargoylesoftware.htmlunit.html.HtmlPage.getFormByName(HtmlPage.java:588)
at fblogin.Main.main(Main.java:36)
Java Result: 1
BUILD SUCCESSFUL (total time: 10 seconds)

Indeed, the login form attribute is login_form:

<form method="POST" action="https://login.facebook.com/login.php?login_attempt=1" id="login_form">

Here is my source:

package fblogin;
import java.io.IOException;
import java.net.URL;

import com.gargoylesoftware.htmlunit.BrowserVersion;
import com.gargoylesoftware.htmlunit.Page;
import com.gargoylesoftware.htmlunit.RefreshHandler;
import com.gargoylesoftware.htmlunit.WebClient;
import com.gargoylesoftware.htmlunit.html.HtmlForm;
import com.gargoylesoftware.htmlunit.html.HtmlPage;

/**
*
* @author me
*/
public class Main {

/**
* @param args the command line arguments
*/
public static void main(String[] args) throws Exception {
// Create and initialize WebClient object
WebClient webClient = new WebClient(BrowserVersion.FIREFOX_3);
webClient.setThrowExceptionOnScriptError(false);
webClient.setRefreshHandler(new RefreshHandler() {
public void handleRefresh(Page page, URL url, int arg) throws IOException {
System.out.println("handleRefresh");
}

});
// visit Facebook login page and get the Form object

HtmlPage page = (HtmlPage) webClient.getPage("http://www.facebook.com/login.php");
HtmlForm form = page.getFormByName("login_form");

// Enter login and passwd
form.getInputByName("email").setValueAttribute("me@email.com");
form.getInputByName("pass").setValueAttribute("PASS");
// Click "Login" button/link
page = (HtmlPage) form.getInputByValue("Login").click();

}
}

Any idea how I messed this up?

I wasn't able to get that code to work, so I switched it to Xpath:

HtmlForm form = page.getFirstByXPath(".//*[@id='login_form']");
form.getInputByName("email").setValueAttribute("me@email.com");
form.getInputByName("pass").setValueAttribute("pass");
page = (HtmlPage) form.getInputByValue("Login").click();

-Thank You-

Re: wrong content encoding

2009-12-14T23:20:18Z

the encoding sniffer returns charset null.
it extracts 8859-1 from
content="text/html; charset=8859-1"

but Charset.isSupported(charset); returns false.
it seems than to take the

TextUtil.DEFAULT_CHARSET = "ISO-8859-1";

if i add
response.getRequestSettings().setCharset(charset);
to my test code, my problem is fixed in this special case.
this could be also done in the constructor of StringWebResponse.

public StringWebResponse(final String content, final String charset,
final URL originatingURL) {
super(getWebResponseData(content, charset), new
WebRequestSettings(originatingURL, HttpMethod.GET), 0);
}

regards
reinhard

reinhard schwab schrieb:

> hi,
>
> the content of
> http://www.donauwirt.at/
> is in UTF-8, but meta tag in document claims to be ISO-8859-1.
>
> htmlunit overrules the encoding i provide, UTF-8, detected by some
> charset detection tool.
>
> here the sample code and the output.
> i use a recent svn version and also a 2.7 snapshot.
>
> String charset = encoding;
> String content = null;
> try {
> content = new String(contentBytes, charset);
> } catch (UnsupportedEncodingException e) {
> e.printStackTrace();
> }
>
> WebResponse response = new StringWebResponse(content, charset, base);
> HtmlPage page = null;
> try {
> page = createHtmlPage(response, window);
> // LOG.info(page.getInputEncoding());
> LOG.info("charset " + charset);
> LOG.info("page.getEncoding() " + page.getPageEncoding());
> LOG.info("title " + page.getTitleText());
>
>
> INFO 06:54:08,366 Test2: charset UTF-8
> INFO 06:54:08,369 Test2: page.getEncoding() ISO-8859-1
> INFO 06:54:08,867 Test2: title Donauwirt online - Herbst - die Zeit
> des GenieÃens
>
> there exists a similar bug
> http://sourceforge.net/tracker/index.php?func=detail&aid=2860732&group_id=47038&atid=448266
> which is closed.
>
> regards
> reinhard
>
> ------------------------------------------------------------------------------
> Return on Information:
> Google Enterprise Search pays you back
> Get the facts.
> http://p.sf.net/sfu/google-dev2dev
> _______________________________________________
> Htmlunit-user mailing list
> Htmlunit-user@...
> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

wrong content encoding

2009-12-14T22:05:42Z

hi,

the content of
http://www.donauwirt.at/
is in UTF-8, but meta tag in document claims to be ISO-8859-1.

htmlunit overrules the encoding i provide, UTF-8, detected by some
charset detection tool.

here the sample code and the output.
i use a recent svn version and also a 2.7 snapshot.

String charset = encoding;
String content = null;
try {
content = new String(contentBytes, charset);
} catch (UnsupportedEncodingException e) {
e.printStackTrace();
}

WebResponse response = new StringWebResponse(content, charset, base);
HtmlPage page = null;
try {
page = createHtmlPage(response, window);
// LOG.info(page.getInputEncoding());
LOG.info("charset " + charset);
LOG.info("page.getEncoding() " + page.getPageEncoding());
LOG.info("title " + page.getTitleText());

INFO 06:54:08,366 Test2: charset UTF-8
INFO 06:54:08,369 Test2: page.getEncoding() ISO-8859-1
INFO 06:54:08,867 Test2: title Donauwirt online - Herbst - die Zeit
des GenieÃens

there exists a similar bug
http://sourceforge.net/tracker/index.php?func=detail&aid=2860732&group_id=47038&atid=448266
which is closed.

regards
reinhard

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: facebook login

2009-12-14T20:14:54Z

Hi,

* You must subscribe to the list before posting.
* The last time Facebook was checked, there were errors in Facebook website (as shown by JS errors in real browsers), which could be 'ignored' in real browsers, but not with HtmlUnit.

If you think HtmlUnit is incorrect, please open a bug report, preferably with minimal test case as hinted in http://htmlunit.sourceforge.net/submittingJSBugs.html

Yours,
Ahmed

ihavealegohead wrote:

I am testing htmlunit with facebook. I try a login, but fails:

run:
Dec 14, 2009 5:50:12 PM com.gargoylesoftware.htmlunit.IncorrectnessListenerImpl notify
WARNING: Expected content type of 'application/javascript' or 'application/ecmascript' for remotely loaded JavaScript element at 'http://b.static.ak.fbcdn.net/rsrc.php/zCOXE/hash/dbni8t78.js', but got 'application/x-javascript'.
Exception in thread "main" com.gargoylesoftware.htmlunit.ElementNotFoundException: elementName=[form] attributeName=[name] attributeValue=[login_form]
at com.gargoylesoftware.htmlunit.html.HtmlPage.getFormByName(HtmlPage.java:588)
at fblogin.Main.main(Main.java:36)
Java Result: 1
BUILD SUCCESSFUL (total time: 10 seconds)

Indeed, the login form attribute is login_form:

<form method="POST" action="https://login.facebook.com/login.php?login_attempt=1" id="login_form">

Here is my source:

package fblogin;
import java.io.IOException;
import java.net.URL;

import com.gargoylesoftware.htmlunit.BrowserVersion;
import com.gargoylesoftware.htmlunit.Page;
import com.gargoylesoftware.htmlunit.RefreshHandler;
import com.gargoylesoftware.htmlunit.WebClient;
import com.gargoylesoftware.htmlunit.html.HtmlForm;
import com.gargoylesoftware.htmlunit.html.HtmlPage;

/**
*
* @author me
*/
public class Main {

/**
* @param args the command line arguments
*/
public static void main(String[] args) throws Exception {
// Create and initialize WebClient object
WebClient webClient = new WebClient(BrowserVersion.FIREFOX_3);
webClient.setThrowExceptionOnScriptError(false);
webClient.setRefreshHandler(new RefreshHandler() {
public void handleRefresh(Page page, URL url, int arg) throws IOException {
System.out.println("handleRefresh");
}

});
// visit Facebook login page and get the Form object

HtmlPage page = (HtmlPage) webClient.getPage("http://www.facebook.com/login.php");
HtmlForm form = page.getFormByName("login_form");

// Enter login and passwd
form.getInputByName("email").setValueAttribute("me@email.com");
form.getInputByName("pass").setValueAttribute("PASS");
// Click "Login" button/link
page = (HtmlPage) form.getInputByValue("Login").click();

}
}

Any idea how I messed this up?

facebook login

2009-12-14T16:54:43Z

I am testing htmlunit with facebook. I try a login, but fails:

run:
Dec 14, 2009 5:50:12 PM com.gargoylesoftware.htmlunit.IncorrectnessListenerImpl notify
WARNING: Expected content type of 'application/javascript' or 'application/ecmascript' for remotely loaded JavaScript element at 'http://b.static.ak.fbcdn.net/rsrc.php/zCOXE/hash/dbni8t78.js', but got 'application/x-javascript'.
Exception in thread "main" com.gargoylesoftware.htmlunit.ElementNotFoundException: elementName=[form] attributeName=[name] attributeValue=[login_form]
at com.gargoylesoftware.htmlunit.html.HtmlPage.getFormByName(HtmlPage.java:588)
at fblogin.Main.main(Main.java:36)
Java Result: 1
BUILD SUCCESSFUL (total time: 10 seconds)

Indeed, the login form attribute is login_form:

<form method="POST" action="https://login.facebook.com/login.php?login_attempt=1" id="login_form">

Here is my source:

package fblogin;
import java.io.IOException;
import java.net.URL;

import com.gargoylesoftware.htmlunit.BrowserVersion;
import com.gargoylesoftware.htmlunit.Page;
import com.gargoylesoftware.htmlunit.RefreshHandler;
import com.gargoylesoftware.htmlunit.WebClient;
import com.gargoylesoftware.htmlunit.html.HtmlForm;
import com.gargoylesoftware.htmlunit.html.HtmlPage;

/**
*
* @author me
*/
public class Main {

/**
* @param args the command line arguments
*/
public static void main(String[] args) throws Exception {
// Create and initialize WebClient object
WebClient webClient = new WebClient(BrowserVersion.FIREFOX_3);
webClient.setThrowExceptionOnScriptError(false);
webClient.setRefreshHandler(new RefreshHandler() {
public void handleRefresh(Page page, URL url, int arg) throws IOException {
System.out.println("handleRefresh");
}

});
// visit Facebook login page and get the Form object

HtmlPage page = (HtmlPage) webClient.getPage("http://www.facebook.com/login.php");
HtmlForm form = page.getFormByName("login_form");

// Enter login and passwd
form.getInputByName("email").setValueAttribute("me@email.com");
form.getInputByName("pass").setValueAttribute("PASS");
// Click "Login" button/link
page = (HtmlPage) form.getInputByValue("Login").click();

}
}

Any idea how I messed this up?

possible bug?

2009-12-14T06:18:18Z

Hello,

I am using htmlunit to simulate a user selecting a drop
down menu item on http://www.hsbc.com.hk/1/2/hk/mortgages/valuation.
The page loads fine on a real browser, but htmlunit appears to choke by
running out of heap space of 1GB. Here's the code I used:

WebClient webClient = new WebClient(BrowserVersion.INTERNET_EXPLORER_7);
// load the page
HtmlPage selectZonePage = webClient.getPage("http://www.hsbc.com.hk/1/2/hk/mortgages/valuation");

// get the selector
HtmlSelect zoneSelector = (HtmlSelect) selectZonePage.getByXPath("//select[@name='PC_7_2_IEP_locateinput.zone']").get(0);

HtmlOption option = zoneSelector.getOption(1);

// select an item from the menu
HtmlPage newPage = (HtmlPage)zoneSelector.setSelectedAttribute(option.getValueAttribute(),
true);

// never returns

I looked at the debug output and it appears that it is continuously
loading some javascript code and doesn't return. So I am wondering if
that is because of a problem with the javascript on the site or a
possible bug or perhaps my misuse of the API?

Thanks,
Lob

Yahoo!香港提供網上安全攻略，教你如何防範黑客! 請前往 http://hk.promo.yahoo.com/security/ 了解更多!

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: A error when htmlunit-2.7-SNAPSHOT used for parsing GoogleCodeSearch result's Webpages

2009-12-14T02:01:03Z

Hi Dai,

Please open a bug report.

The smaller the html/js involved, the quicker it should be fixed.

Please try to isolate a minimal case as hinted in http://htmlunit.sourceforge.net/submittingJSBugs.html

Ahmed

----
Blog: http://asashour.blogspot.com

From: Dai Phan the <bigword7681@...>
To: htmlunit-develop@...
Cc: htmlunit user <htmlunit-user@...>
Sent: Sun, December 13, 2009 9:05:21 PM
Subject: [Htmlunit-user] A error when htmlunit-2.7-SNAPSHOT used for parsing GoogleCodeSearch result's Webpages

Dear everyone,
I am trying use htmlunit-2.7-SNAPSHOT,
to parse some of result's webpages of GoogleCodeSearch,
for instance "http://www.google.com/codesearch/p?hl=en#OsXOG0jgXZ8/make/test/HelloWorld.java".

This is my code, and the attached file with Log of error. I am very grateful to you for your explanation for this issue. How I should correct it?

import java.io.IOException;
import java.net.MalformedURLException;

import com.gargoylesoftware.htmlunit.FailingHttpStatusCodeException;
import com.gargoylesoftware.htmlunit.WebClient;
import com.gargoylesoftware.htmlunit.html.HtmlPage;

public class TestGooglePaser {
public static void main(String[] args)
throws FailingHttpStatusCodeException, MalformedURLException, IOException {

final WebClient webClient = new WebClient();
final HtmlPage page = webClient
.getPage("http://www.google.com/codesearch/p?hl=en#OsXOG0jgXZ8/make/test/HelloWorld.java");
webClient.waitForBackgroundJavaScriptStartingBefore(10000);
webClient.waitForBackgroundJavaScript(10000);

System.out.println(page.asXml());
}
}

This is sumary of error:
SEVERE: Job run failed with unexpected RuntimeException: TypeError: Cannot read property "caller" from undefined (http://www.google.com/codesearch/js/BrowsePage/B1C9F2A3FB805855187D6A49CB08D19B.cache.js#2317)

======= EXCEPTION START ========
EcmaError: lineNumber=[2317] column=[0] lineSource=[null] name=[TypeError] sourceName=[http://www.google.com/codesearch/js/BrowsePage/B1C9F2A3FB805855187D6A49CB08D19B.cache.js]
message=[TypeError: Cannot read property "caller" from undefined (http://www.google.com/codesearch/js/BrowsePage/B1C9F2A3FB805855187D6A49CB08D19B.cache.js#2317)]
com.gargoylesoftware.htmlunit.ScriptException: TypeError: Cannot read property "caller" from undefined (http://www.google.com/codesearch/js/BrowsePage/B1C9F2A3FB805855187D6A49CB08D19B.cache.js#2317)
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$HtmlUnitContextAction.run(JavaScriptEngine.java:526)
....
== CALLING JAVASCRIPT ==
function () {
if (/loaded|complete/.test(k.readyState)) {
A();
}
}
======= EXCEPTION END ========

Thank you very much !

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev

_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

A error when htmlunit-2.7-SNAPSHOT used for parsing GoogleCodeSearch result's Webpages

2009-12-13T10:05:21Z

Dear everyone,
I am trying use htmlunit-2.7-SNAPSHOT,
to parse some of result's webpages of GoogleCodeSearch,
for instance "http://www.google.com/codesearch/p?hl=en#OsXOG0jgXZ8/make/test/HelloWorld.java".

This is my code, and the attached file with Log of error. I am very grateful to you for your explanation for this issue. How I should correct it?

import java.io.IOException;
import java.net.MalformedURLException;

import com.gargoylesoftware.htmlunit.FailingHttpStatusCodeException;
import com.gargoylesoftware.htmlunit.WebClient;
import com.gargoylesoftware.htmlunit.html.HtmlPage;

public class TestGooglePaser {
public static void main(String[] args)
throws FailingHttpStatusCodeException, MalformedURLException, IOException {

final WebClient webClient = new WebClient();
final HtmlPage page = webClient
.getPage("http://www.google.com/codesearch/p?hl=en#OsXOG0jgXZ8/make/test/HelloWorld.java");
webClient.waitForBackgroundJavaScriptStartingBefore(10000);
webClient.waitForBackgroundJavaScript(10000);

System.out.println(page.asXml());
}
}

This is sumary of error:
SEVERE: Job run failed with unexpected RuntimeException: TypeError: Cannot read property "caller" from undefined (http://www.google.com/codesearch/js/BrowsePage/B1C9F2A3FB805855187D6A49CB08D19B.cache.js#2317)

======= EXCEPTION START ========
EcmaError: lineNumber=[2317] column=[0] lineSource=[null] name=[TypeError] sourceName=[http://www.google.com/codesearch/js/BrowsePage/B1C9F2A3FB805855187D6A49CB08D19B.cache.js]
message=[TypeError: Cannot read property "caller" from undefined (http://www.google.com/codesearch/js/BrowsePage/B1C9F2A3FB805855187D6A49CB08D19B.cache.js#2317)]
com.gargoylesoftware.htmlunit.ScriptException: TypeError: Cannot read property "caller" from undefined (http://www.google.com/codesearch/js/BrowsePage/B1C9F2A3FB805855187D6A49CB08D19B.cache.js#2317)
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$HtmlUnitContextAction.run(JavaScriptEngine.java:526)
....
== CALLING JAVASCRIPT ==
function () {
if (/loaded|complete/.test(k.readyState)) {
A();
}
}
======= EXCEPTION END ========

Thank you very much !

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev

_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

log_run_with_GoogleCodeSearch.doc (54K) Download Attachment

Leong 想跟您聊天

2009-12-13T03:11:06Z

-----------------------------------------------------------------------
Leong希望通过 Google 的一些最炫的新产品与您保持更密切的联系。

如果您已经拥有 Gmail 或 Google Talk，请访问：
http://mail.google.com/mail/b-be4f6af167-de3e23a671-3952c05ea98ba9ad
您需要点击此链接才能与Leong聊天。

要获取 Gmail（Google 提供的免费电子邮件帐户，存储空间超过 2,800 MB）并与Leong聊天，请访问：
http://mail.google.com/mail/a-be4f6af167-de3e23a671-3952c05ea98ba9ad

Gmail 提供以下功能：
- 直接在 Gmail 中进行即时消息传递
- 强大的垃圾邮件防护功能
- 可用于查找邮件的内置搜索功能，以及实用的邮件整理方法（将邮件整理到“会话”中）
- 没有弹出式广告或不相干的横幅广告，只显示文字广告和与邮件内容相关的信息
以上所有功能均免费为您提供。此外，我们还提供了更多服务！打开 Gmail 帐户后，您还可以访问 Google Talk（即时消息传输服务）：

http://www.google.com/talk/intl/zh-CN/

Google Talk 提供以下功能：
- 无需下载即可供您在任何地方使用的基于网络的聊天功能
- 与 Gmail 帐户同步的联系人列表
- 免费、高品质的 PC 间语音呼叫服务（下载 Google Talk 客户端后）

我们一直致力于增加新的功能并不断改进服务，因此我们还可能会定期请您提供意见和建议。感谢您为我们的产品改进所提供的帮助！

此致
Google 小组敬上

要了解有关 Gmail 和 Google Talk 的详细信息，请访问：
http://mail.google.com/mail/help/intl/zh_CN/about.html
http://www.google.com/talk/intl/zh-CN/about.html

（如果点击本邮件中提供的网址不起作用，请将其复制并粘贴到浏览器的地址栏中）。
------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: Htmlunit + Flash

2009-12-12T14:45:01Z

Hi Sander,

:) :)

As you see in [1], there is no reply for one and a half year.

I don't know if it is legal, or no interest in such project. Obviously, it needs a huge effort and time.

[1] http://forums.adobe.com/message/245779#245779

Ahmed

----
Blog: http://asashour.blogspot.com

From: Sander A. Smith <smithsa@...>
To: htmlunit-user@...
Sent: Sat, December 12, 2009 11:39:47 PM
Subject: Re: [Htmlunit-user] Htmlunit + Flash

Hey Ahmed,

Thanks for the reply. I'm glad you did because I have a followup question for you about why there's no Open Source Flash component, based on something you posted to the Adobe site.

Is there no Flash component simply because no one has stepped up to create an Open Source one, or is the problem a legal/licensing issue from Adobe? I respect the fact that this is currently out of scope for Htmlunit - I'm just trying to understand for myself why that is.

Even without Flash, Htmlunit is great. Thanks to everyone who's a part of it.

Sander

On Sat, Dec 12, 2009 at 12:24 PM, Ahmed Ashour <asashour@...> wrote:

Hi Sander,

As mentioned previously, there is no OpenSource runtime environment for Flash in Java, that's why it is out of scope of HtmlUnit currently.

Ahmed
----
Blog: http://asashour.blogspot.com/

From: Marc Guillemot <mguillemot@...>
To: htmlunit-user@...
Sent: Fri, December 11, 2009 6:47:17 PM
Subject: Re: [Htmlunit-user] Htmlunit + Flash

Hi Sander

HtmlUnit doesn't simulate Flash :-(
No idea if it would be possible or not, but we have already enough to do
with HTML ;-)

Cheers,
Marc.

Sander A. Smith a écrit :

> I need a way to automate the testing of a Flash-based game, and am
> looking towards Htmlunit to see if it's possible. I've seen some mention
> of this in the past, and it looks like there's no support for Flash
> because Adobe doesn't want the content to be accessible in a headless
> way. Is this still true? I've seen that Selenium has a way to
> incorporate Flash, but they're using real browsers. However, ther are
> other factors which make Htmlunit much more appealing than Selenium.
>
> Any ideas?
>
> --
> Sander A. Smith
> President
>
> Sericon Technology Inc.
> 71 Marquette Ave.
> Toronto, Ontario M6A 1X8
> (416)781-3988
>
> Link to me on LinkedIn
> http://www.linkedin.com/in/sandersmith
>
> Join our community of people interested in testing Facebook applications
> http://www.testfacebook.com/
>
> Learn about advanced tools for testing social networking applications
> http://www.friendrunner.com/
>
> http://www.sericontech.com/

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev

_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev

_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: Htmlunit + Flash

2009-12-12T14:04:05Z

Hi Sander:

I agree with Ahmed about a runtime environment for Flash. However, there are other ways to accomplish test automation of Flash/Flex applications. Here are some ideas:

PushToTest TestMaker provides an AMF protocol handler to do functional testing and load and performance testing of a Flex backend. http://www.pushtotest.com.

BrowserMob runs Selenium RC tests in the real browser in Amazon EC2 machine instances. You running the real browser in EC2 instances. http://browsermob.com/performance-testing

FlexMonkey (http://code.google.com/p/flexmonkey) is a record/playback tool for Flex apps. It includes support to playback in a continuous integration environment.

We are looking into building a FlexMonkey script runner for TestMaker too.

-Frank

On Dec 12, 2009, at 9:24 AM, Ahmed Ashour wrote:

Hi Sander,

As mentioned previously, there is no OpenSource runtime environment for Flash in Java, that's why it is out of scope of HtmlUnit currently.

Ahmed
----
Blog: http://asashour.blogspot.com
From: Marc Guillemot <mguillemot@...>
To: htmlunit-user@...
Sent: Fri, December 11, 2009 6:47:17 PM
Subject: Re: [Htmlunit-user] Htmlunit + Flash

Hi Sander

HtmlUnit doesn't simulate Flash :-(
No idea if it would be possible or not, but we have already enough to do
with HTML ;-)

Cheers,
Marc.

Sander A. Smith a écrit :

> I need a way to automate the testing of a Flash-based game, and am
> looking towards Htmlunit to see if it's possible. I've seen some mention
> of this in the past, and it looks like there's no support for Flash
> because Adobe doesn't want the content to be accessible in a headless
> way. Is this still true? I've seen that Selenium has a way to
> incorporate Flash, but they're using real browsers. However, ther are
> other factors which make Htmlunit much more appealing than Selenium.
>
> Any ideas?
>
> --
> Sander A. Smith
> President
>
> Sericon Technology Inc.
> 71 Marquette Ave.
> Toronto, Ontario M6A 1X8
> (416)781-3988
>
> Link to me on LinkedIn
> http://www.linkedin.com/in/sandersmith
>
> Join our community of people interested in testing Facebook applications
> http://www.TestFacebook.com
>
> Learn about advanced tools for testing social networking applications
> http://www.FriendRunner.com
>
> http://www.sericontech.com

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

--
Frank Cohen, http://www.PushToTest.com, phone 408 871 0122
PushToTest, the open-source test automation company
Twitter: fcohen, LinkedIn: Frank Cohen

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev

_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: Htmlunit + Flash

2009-12-12T12:39:47Z

Hey Ahmed,

Thanks for the reply. I'm glad you did because I have a followup question for you about why there's no Open Source Flash component, based on something you posted to the Adobe site.

Even without Flash, Htmlunit is great. Thanks to everyone who's a part of it.

Sander

On Sat, Dec 12, 2009 at 12:24 PM, Ahmed Ashour <asashour@...> wrote:

Hi Sander,

As mentioned previously, there is no OpenSource runtime environment for Flash in Java, that's why it is out of scope of HtmlUnit currently.

Ahmed
----
Blog: http://asashour.blogspot.com

From: Marc Guillemot <mguillemot@...>
To: htmlunit-user@...
Sent: Fri, December 11, 2009 6:47:17 PM
Subject: Re: [Htmlunit-user] Htmlunit + Flash

Hi Sander

HtmlUnit doesn't simulate Flash :-(
No idea if it would be possible or not, but we have already enough to do
with HTML ;-)

Cheers,
Marc.

Sander A. Smith a écrit :
> I need a way to automate the testing of a Flash-based game, and am
> looking towards Htmlunit to see if it's possible. I've seen some mention
> of this in the past, and it looks like there's no support for Flash
> because Adobe doesn't want the content to be accessible in a headless
> way. Is this still true? I've seen that Selenium has a way to
> incorporate Flash, but they're using real browsers. However, ther are
> other factors which make Htmlunit much more appealing than Selenium.
>
> Any ideas?
>
> --
> Sander A. Smith
> President
>
> Sericon Technology Inc.
> 71 Marquette Ave.
> Toronto, Ontario M6A 1X8
> (416)781-3988
>
> Link to me on LinkedIn
> http://www.linkedin.com/in/sandersmith
>
> Join our community of people interested in testing Facebook applications
> http://www.TestFacebook.com
>
> Learn about advanced tools for testing social networking applications
> http://www.FriendRunner.com
>
> http://www.sericontech.com

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev

_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

--
Sander A. Smith
President

Sericon Technology Inc.
71 Marquette Ave.
Toronto, Ontario M6A 1X8
(416)781-3988

Link to me on LinkedIn
http://www.linkedin.com/in/sandersmith

Join our community of people interested in testing Facebook applications
http://www.TestFacebook.com

Learn about advanced tools for testing social networking applications
http://www.FriendRunner.com

http://www.sericontech.com

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev

_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: Htmlunit + Flash

2009-12-12T09:24:40Z

Hi Sander,

As mentioned previously, there is no OpenSource runtime environment for Flash in Java, that's why it is out of scope of HtmlUnit currently.

Ahmed

----
Blog: http://asashour.blogspot.com

From: Marc Guillemot <mguillemot@...>
To: htmlunit-user@...
Sent: Fri, December 11, 2009 6:47:17 PM
Subject: Re: [Htmlunit-user] Htmlunit + Flash

Hi Sander

HtmlUnit doesn't simulate Flash :-(
No idea if it would be possible or not, but we have already enough to do
with HTML ;-)

Cheers,
Marc.

Sander A. Smith a écrit :

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev

_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Fw: New implementation of document.lastModified is incorrect

2009-12-12T08:23:05Z

Hi Richard,

* You must subscribe to the list before posting.

* Please provide minimal case that shows HtmlUnit behavior is different than real browsers, patches are more than welcome.

Ahmed

----
Blog: http://asashour.blogspot.com

----- Forwarded Message ----

I just noticed that the (newly-added in response to bug #2875273) implementation of document.lastModified is incorrect.

>From https://htmlunit.svn.sourceforge.net/svnroot/htmlunit/trunk/htmlunit/src/main/java/com/gargoylesoftware/htmlunit/javascript/host/html/HTMLDocument.java :
/**
* Returns the last modification date of the document.
* @see <a href="https://developer.mozilla.org/en/DOM/document.lastModified">Mozilla documentation</a>
* @return the date as string
*/
public String jsxGet_lastModified() {
if (lastModified_ == null) {
final WebResponse webResponse = getPage().getWebResponse();
String stringDate = webResponse.getResponseHeaderValue("Last-Modified");
if (stringDate == null) {
stringDate = webResponse.getResponseHeaderValue("Date");
}

final Date lastModified = parseDateOrNow(stringDate);
lastModified_ = formatHttpDate(lastModified);
}

return lastModified_;
}

>From https://htmlunit.svn.sourceforge.net/svnroot/htmlunit/trunk/htmlunit/src/main/java/com/gargoylesoftware/htmlunit/util/StringUtils.java :
/**
* Formats the specified date according to RFC 1123.
*
* @param date the date to format
* @return the specified date, formatted according to RFC 1123
*/
public static String formatHttpDate(final Date date) {
WebAssert.notNull("date", date);
return DateUtil.formatDate(date);
}

Note that formatHttpDate uses HttpClient's DateUtil.formatDate, which outputs in RFC 1123 (as noted in the comments), which is correct for HTTP headers but is NOT the format of document.lastModified.

According to https://developer.mozilla.org/en/DOM/document.lastModified (mentioned in the comments above):
<<<<<
document.lastModified
Table of contents

1. 1. Summary
2. 2. Syntax
3. 3. Example
4. 4. Notes
5. 5. Specification

« Gecko DOM Reference
Summary

Returns a string containing the date and time on which the current document was last modified.
Syntax

var string = document.lastModified;

Example

dump(document.lastModified);
// returns: Tuesday, July 10, 2001 10:19:42

Notes

Note that as a string, lastModified cannot easily be used for comparisions between the modified dates of documents.
Specification

DOM Level 0. Not part of any standard.

MSDN: lastModified Property
>>>>>

This is full of lies! Firefox follows the MSIE format, and MSIE follows the format documented by MSDN (which, ironically, is referenced by the erroneous Mozilla documentation):

>From http://msdn.microsoft.com/en-us/library/ms533946(VS.85).aspx:
<<<<<

lastModified Property

Gets the date that the page was last modified, if the page supplies one.

Syntax

[ sModified = ] object.lastModified

Possible Values

sModified String that receives the most recent date the page was modified, in the form "MM/DD/YY hh:mm:ss".

The property is read-only. The property has no default value.

Standards Information

There is no public standard that applies to this property.
>>>>>

Note that the correct format, as listed above, is "MM/DD/YY hh:mm:ss", and not RFC 1123 (which is "EEE, dd MMM yyyy HH:mm:ss zzz", according to HttpClient's constants).
Open this in a browser and see for yourself!

<html><body><script type="text/javascript">
document.writeln(document.lastModified);
</script></body></html>

Rich Eggert

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev

_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: Free javascript threads when closing the WebClient

2009-12-11T08:59:55Z

Adi,
I've committed my changes. If you check out sources from SVN or give a
bit time to the build server to produce a new snapshot, you should have
a better closeAllWindows.

Btw, you can thanks Frank Cohen for this fix: he paid me (I hope that I
get my money ;-)) to fix an other issue and I could start working on
closeAllWindows in the remaining time as he had problem with it too (in
fact it took me far more time, but I wanted to see it fixed, or at least
improved).

Cheers,
Marc.

Adim a écrit :

> Try this one as well is think it behave the same:
> http://www.homeless.co.il/sale/default.asp
>
> Regards,
> Adi.
>
>
>
> Marc Guillemot wrote:
>> Do you have other examples? I think that I've found a simple fix in this
>> case.
>>
>> Cheers,
>> Marc.
>>
>> Adim a écrit :
>>> You can use:
>>> http://www.winwin.co.il/RealEstate/ForSale/RealEstatePage.aspx
>>>
>>> Regards,
>>> Adi.
>>>
>>>
>>> Marc Guillemot wrote:
>>>> your example contains:
>>>>
>>>> HtmlPage page = (HtmlPage) webClient.getPage("some website that uses
>>>> JS");
>>>>
>>>> and the problem surely doesn't appear for all sites that uses JS ;-)
>>>>
>>>> Cheers,
>>>> Marc.
>>>>
>>>> Adim a écrit :
>>>>> Thanks
>>>>> My post example does reproduce the problem, please remove the
>>>>> deregisterWebWindow() call and run it.
>>>>>
>>>>> Regards,
>>>>> Adi.
>>>>>
>>>>>
>>>>> Marc Guillemot wrote:
>>>>>> closeAllWindows should do the job. If it doesn't, it may be due to an
>>>>>> incorrect usage (call to deregisterWebWindow?) or to a bug. If it is a
>>>>>> but, it should be fixed ;-)
>>>>>>
>>>>>> Jason, Adi: can you produce a simple example where not all threads are
>>>>>> stopped?
>>>>>>
>>>>>> Cheers,
>>>>>> Marc.
>>>>>>
>>>>>> jason franklin-stokes a écrit :
>>>>>>> closeallwindows definately does not always do the job - that is 100%
>>>>>>> certain.
>>>>>>>
>>>>>>> i will definately give
>>>>>>> webClient.getCurrentWindow().getJobManager().shutdown(); this a shot
>>>>>>> this
>>>>>>> afternoon and let you know if this did anything on my end.
>>>>>>>
>>>>>>> thanks a million for the info - i was considering catching still
>>>>>>> running
>>>>>>> threads from htmunit afterclose all windows and then terminating them
>>>>>>> -
>>>>>>> that would be an awful thing to have to do - so i really hope this
>>>>>>> works
>>>>>>> out.
>>>>>>>
>>>>>>> let you know
>>>>>>>
>>>>>>> jason.
>>>>>>>
>>>>>>> On Dec 9, 2009, at 1:05 PM, Adim wrote:
>>>>>>>
>>>>>>>> Thanks a good question...
>>>>>>>> Somehow it stayed there, so does closeAllWindows() do the job? what
>>>>>>>> is
>>>>>>>> the
>>>>>>>> different between a window and a top level window?
>>>>>>>>
>>>>>>>> Regards,
>>>>>>>> Adi.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> Marc Guillemot wrote:
>>>>>>>>> Hi,
>>>>>>>>>
>>>>>>>>> why do you use:
>>>>>>>>> webClient.deregisterWebWindow(webClient.getCurrentWindow());
>>>>>>>>>
>>>>>>>>> Cheers,
>>>>>>>>> Marc.
>>>>>>>>>
>>>>>>>>> Adim a écrit :
>>>>>>>>>> Hi all,
>>>>>>>>>> I want to share we you a problem I solved:
>>>>>>>>>> After running a profiler I notice that after I closed the
>>>>>>>>>> WebClient
>>>>>>>>>> I
>>>>>>>>>> still
>>>>>>>>>> have some javascript job thread waiting...
>>>>>>>>>> Here is the simple code:
>>>>>>>>>> final WebClient webClient = new
>>>>>>>>>> WebClient(BrowserVersion.INTERNET_EXPLORER_7);
>>>>>>>>>> webClient.setThrowExceptionOnScriptError(false);
>>>>>>>>>> webClient.setCssEnabled(false);
>>>>>>>>>> webClient.setRefreshHandler(new RefreshHandler() {
>>>>>>>>>> public void handleRefresh(Page page, URL url, int seconds) throws
>>>>>>>>>> IOException {
>>>>>>>>>> }
>>>>>>>>>> });
>>>>>>>>>> webClient.setJavaScriptEnabled(true);
>>>>>>>>>> webClient.setThrowExceptionOnFailingStatusCode(false);
>>>>>>>>>>
>>>>>>>>>> HtmlPage page = (HtmlPage) webClient.getPage("some website that
>>>>>>>>>> uses
>>>>>>>>>> JS");
>>>>>>>>>>
>>>>>>>>>> // Close the client
>>>>>>>>>> webClient.deregisterWebWindow(webClient.getCurrentWindow());
>>>>>>>>>> webClient.closeAllWindows();
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> I solved the problem by adding the following line at the beginning
>>>>>>>>>> of
>>>>>>>>>> the
>>>>>>>>>> close client section:
>>>>>>>>>> webClient.getCurrentWindow().getJobManager().shutdown();
>>>>>>>>>> This line shutdown the waiting JS threads.
>>>>>>>>>>
>>>>>>>>>> Enjoy.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>> ------------------------------------------------------------------------------
>>>>>>>>> Return on Information:
>>>>>>>>> Google Enterprise Search pays you back
>>>>>>>>> Get the facts.
>>>>>>>>> http://p.sf.net/sfu/google-dev2dev
>>>>>>>>> _______________________________________________
>>>>>>>>> Htmlunit-user mailing list
>>>>>>>>> Htmlunit-user@...
>>>>>>>>> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>>>>>>>>>
>>>>>>>>>
>>>>>>>> --
>>>>>>>> View this message in context:
>>>>>>>> http://old.nabble.com/Free-javascript-threads-when-closing-the-WebClient-tp26708191p26709199.html
>>>>>>>> Sent from the HtmlUnit - General mailing list archive at Nabble.com.
>>>>>>>>
>>>>>>>>
>>>>>>>> ------------------------------------------------------------------------------
>>>>>>>> Return on Information:
>>>>>>>> Google Enterprise Search pays you back
>>>>>>>> Get the facts.
>>>>>>>> http://p.sf.net/sfu/google-dev2dev
>>>>>>>> _______________________________________________
>>>>>>>> Htmlunit-user mailing list
>>>>>>>> Htmlunit-user@...
>>>>>>>> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>>>>>>> ------------------------------------------------------------------------------
>>>>>>> Return on Information:
>>>>>>> Google Enterprise Search pays you back
>>>>>>> Get the facts.
>>>>>>> http://p.sf.net/sfu/google-dev2dev
>>>>>>> _______________________________________________
>>>>>>> Htmlunit-user mailing list
>>>>>>> Htmlunit-user@...
>>>>>>> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>>>>>>>
>>>>>> ------------------------------------------------------------------------------
>>>>>> Return on Information:
>>>>>> Google Enterprise Search pays you back
>>>>>> Get the facts.
>>>>>> http://p.sf.net/sfu/google-dev2dev
>>>>>> _______________________________________________
>>>>>> Htmlunit-user mailing list
>>>>>> Htmlunit-user@...
>>>>>> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>>>>>>
>>>>>>
>>>> ------------------------------------------------------------------------------
>>>> Return on Information:
>>>> Google Enterprise Search pays you back
>>>> Get the facts.
>>>> http://p.sf.net/sfu/google-dev2dev
>>>> _______________________________________________
>>>> Htmlunit-user mailing list
>>>> Htmlunit-user@...
>>>> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>>>>
>>>>
>>
>> ------------------------------------------------------------------------------
>> Return on Information:
>> Google Enterprise Search pays you back
>> Get the facts.
>> http://p.sf.net/sfu/google-dev2dev
>> _______________________________________________
>> Htmlunit-user mailing list
>> Htmlunit-user@...
>> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>>
>>
>

Re: Htmlunit + Flash

2009-12-11T07:47:17Z

Hi Sander

HtmlUnit doesn't simulate Flash :-(
No idea if it would be possible or not, but we have already enough to do
with HTML ;-)

Cheers,
Marc.

Sander A. Smith a écrit :

> I need a way to automate the testing of a Flash-based game, and am
> looking towards Htmlunit to see if it's possible. I've seen some mention
> of this in the past, and it looks like there's no support for Flash
> because Adobe doesn't want the content to be accessible in a headless
> way. Is this still true? I've seen that Selenium has a way to
> incorporate Flash, but they're using real browsers. However, ther are
> other factors which make Htmlunit much more appealing than Selenium.
>
> Any ideas?
>
> --
> Sander A. Smith
> President
>
> Sericon Technology Inc.
> 71 Marquette Ave.
> Toronto, Ontario M6A 1X8
> (416)781-3988
>
> Link to me on LinkedIn
> http://www.linkedin.com/in/sandersmith
>
> Join our community of people interested in testing Facebook applications
> http://www.TestFacebook.com
>
> Learn about advanced tools for testing social networking applications
> http://www.FriendRunner.com
>
> http://www.sericontech.com
>
>
> ------------------------------------------------------------------------
>
> ------------------------------------------------------------------------------
> Return on Information:
> Google Enterprise Search pays you back
> Get the facts.
> http://p.sf.net/sfu/google-dev2dev
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> Htmlunit-user mailing list
> Htmlunit-user@...
> https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: Free javascript threads when closing the WebClient

2009-12-11T07:45:56Z

Thanks for the feedback. This is always good to know that HtmlUnit's
code is not that bad ;-)

Cheers,
Marc.

jason franklin-stokes a écrit :

> Dear all,
>
> I am please to announce that I have found the culprit for my problems - of course it has nothing to do with the htmlunit code.
>
> I am using the jruby htmlunit wrapper called celerity.
>
> it has two methods which are causing problems.
>
> click_and_attach in the Browser class
>
> and
>
> add_listner in the Listner class
>
> I will be letting the celerity guys know - but i thought i would let you know first.
>
> best and thanks for the help.
>
> Jason
>
>
> On Dec 9, 2009, at 3:21 PM, Marc Guillemot wrote:
>
>> can you provide it as Java code?
>>
>> Cheers,
>> Marc.
>>
>> jason franklin-stokes a écrit :
>>> here my example;
>>>
>>> . goto: http://www.swisspost.ch/
>>> 2. click and sycronize javascript: element with the path
>>> /html/body/div[2]/div/div[4]/div[1]/ul[2]/li[2]/a
>>> 3. click and syncronize javascript: element with the path
>>> /html/body/div[2]/div/div[4]/div[1]/ul[1]/li[1]/a
>>> 4. click and syncronise javascript: element with the path
>>> /html/body/div[2]/div/div[3]/div[3]/div[1]/div/div/ul[3]/li/div[2]/div[5]/ul/li/div/ul/li[7]/ul/li[2]/a
>>>
>>> 5. close all windows
>>>
>>> the result is a javascript thread alive and kicking.
>>>

How to get current page when click() doesn't return new one?

2009-12-11T01:45:56Z

Hi,

I'm writing a test for my richfaces application. I use rich:panelMenu (and panelMenuItems - http://docs.jboss.org/richfaces/3.3.2.GA/en/devguide/html/rich_panelMenuItem.html) for page navigation. PanelMenuItem component is repersented in html as <td> tag, and this is a clickable element.

<td style="width: 100%;" id="iconinvoices" class="dr-pmenu-group-self-label rich-pmenu-item-label"><input type="hidden" name="panelMenuActioninvoices"/>Invoices</td>

This html element (id="iconinvoices") hasn't got onclick attribute but in richfaces events are invoked by other JS code

var params = new Object();params['current'] = 'invoices';new PanelMenuItem(ids, params,{myId:'invoices',parentId:'j_id16'},{type:"item",onopen:"",onclose:"",event:"click",mode:"server",target:"",disabled:false,target:"",name:"invoices"},{},new Array("dr-pmenu-hovered-element","rich-pmenu-hovered-element"),1,false,true,false,"A4J.AJAX.Submit('_viewRoot',null,event,{'similarityGroupingId':'invoices','parameters':{'current':'invoices','invoices':'invoices'} ,'actionUrl':'/web\x2Dcompany/pages/invoiceslist.jsf'} )","","left","/web-company/a4j/g/3_3_1.GAorg.richfaces.renderkit.html.iconimages.PanelMenuIconGrid/DATB/eAFLP78AAAN2Adc_.jsf","/web-company/a4j/g/3_3_1.GAorg.richfaces.renderkit.html.iconimages.PanelMenuIconGrid/DATB/eAFLP78AAAN2Adc_.jsf" ,"" ,"/web-company/a4j/g/3_3_1.GAorg.richfaces.renderkit.html.iconimages.PanelMenuIconSpacer/DATB/eAFLP78AAAN2Adc_.jsf");

PanelMenuItem class can be found here - http://anonsvn.jboss.org/repos/richfaces/tags/3.3.1.GA/ui/panelmenu/src/main/resources/org/richfaces/renderkit/html/scripts/panelMenu.js

so after click on id="iconinvoices" elements new page is loaded.

In HtmlElements class method click() is following code

        final ScriptResult scriptResult = fireEvent(event);
        final Page currentPage;
        if (scriptResult == null) {
            currentPage = page;
        }
        else {
            currentPage = scriptResult.getNewPage();
        }

In my case, scriptResult is always null.

My, question is how to receive a reference to new current page and test panelMenu navigation case?

--
Best regards,
Marcin Cetnarski

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev

_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: Free javascript threads when closing the WebClient

2009-12-10T07:52:27Z

Dear all,

I am please to announce that I have found the culprit for my problems - of course it has nothing to do with the htmlunit code.

I am using the jruby htmlunit wrapper called celerity.

it has two methods which are causing problems.

click_and_attach in the Browser class

and

add_listner in the Listner class

I will be letting the celerity guys know - but i thought i would let you know first.

best and thanks for the help.

Jason

On Dec 9, 2009, at 3:21 PM, Marc Guillemot wrote:

> can you provide it as Java code?
>
> Cheers,
> Marc.
>
> jason franklin-stokes a écrit :
>> here my example;
>>
>> . goto: http://www.swisspost.ch/
>> 2. click and sycronize javascript: element with the path
>> /html/body/div[2]/div/div[4]/div[1]/ul[2]/li[2]/a
>> 3. click and syncronize javascript: element with the path
>> /html/body/div[2]/div/div[4]/div[1]/ul[1]/li[1]/a
>> 4. click and syncronise javascript: element with the path
>> /html/body/div[2]/div/div[3]/div[3]/div[1]/div/div/ul[3]/li/div[2]/div[5]/ul/li/div/ul/li[7]/ul/li[2]/a
>>
>> 5. close all windows
>>
>> the result is a javascript thread alive and kicking.
>>
>
> ------------------------------------------------------------------------------
> Return on Information:
> Google Enterprise Search pays you back
> Get the facts.
> http://p.sf.net/sfu/google-dev2dev
> _______________________________________________
> Htmlunit-user mailing list
> Htmlunit-user@...
> https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Htmlunit + Flash

2009-12-10T07:13:01Z

I need a way to automate the testing of a Flash-based game, and am looking towards Htmlunit to see if it's possible. I've seen some mention of this in the past, and it looks like there's no support for Flash because Adobe doesn't want the content to be accessible in a headless way. Is this still true? I've seen that Selenium has a way to incorporate Flash, but they're using real browsers. However, ther are other factors which make Htmlunit much more appealing than Selenium.

Any ideas?

--
Sander A. Smith
President

Sericon Technology Inc.
71 Marquette Ave.
Toronto, Ontario M6A 1X8
(416)781-3988

Link to me on LinkedIn
http://www.linkedin.com/in/sandersmith

Join our community of people interested in testing Facebook applications
http://www.TestFacebook.com

Learn about advanced tools for testing social networking applications
http://www.FriendRunner.com

http://www.sericontech.com

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev

_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: GWT and htmunit

2009-12-09T15:09:36Z

Hi Vishal,

Try to put alerts() in various places in JavaScript, please read more in http://htmlunit.sourceforge.net/submittingJSBugs.html

If you can't debug furuther, provide your GWT application (with -PRETTY style), but it will take some time for someone to verify.

Ahmed

----
Blog: http://asashour.blogspot.com

From: "Santoshi, Vishal" <Vishal_Santoshi@...>
To: "htmlunit-user@..." <htmlunit-user@...>
Sent: Wed, December 9, 2009 8:44:43 PM
Subject: Re: [Htmlunit-user] GWT and htmunit

I have this small code snippet

public static void main(String[] args) throws FailingHttpStatusCodeException, MalformedURLException, IOException{
final WebClient webClient = new WebClient();
webClient.waitForBackgroundJavaScriptStartingBefore(20000);
webClient.waitForBackgroundJavaScript(40000);

System.getProperties().put("org.apache.commons.logging.simplelog.defaultlog", "trace");

final HtmlPage page = webClient.getPage("http://localhost:8080/g-control/gwtc/wellbeing/WellbeingEntryPoint.html#wbs/welcome");
System.out.println(page.asXml());

}

The url "http://localhost:8080/g-control/gwtc/wellbeing/WellbeingEntryPoint.html#wbs/welcome" should load up a compiled GWT JS and execute it, from within the html.
A lot of Place change events occur ( events ), and at least one GWT Deffered Command are executed , with at least 2 Browser History change events created and interecpted
I need to get to the contents ( that I know are rendered on the browser ). When I execute the above code , I get this ( I am putting the log that are relevant)

[java] <script type="text/javascript" language="javascript" src="wellbeing.nocache.js">
[java] </script>
[java] <script defer="defer">
[java] //<![CDATA[
[java] wellbeing.onInjectionDone('wellbeing')
[java] //]]>
[java] </script>

Now I am sure I am missing something here. I see the <script defer="defer"> added. I also see the onInjectionDone(..) blurted out. I do not see the content however.

________________________________________
From: Ahmed Ashour [asashour@...]
Sent: Wednesday, December 09, 2009 11:31 AM
To: htmlunit-user@...
Subject: Re: [Htmlunit-user] GWT and htmunit

Hi Vishal,

>> * Are there examples to hit a url , load up GWT JS ( asynchronous ) , wait for all executions ( asynchrnoous ) to do their magic and feed the specific parts

Sure, GWT tests are already include in HtmlUnit test suite, have a look at:
http://htmlunit.svn.sf.net/viewvc/htmlunit/trunk/htmlunit/src/test/java/com/gargoylesoftware/htmlunit/libraries/GWT17Test.java?revision=5220&view=markup#l_61
If AJAX doesn't work, have a look at http://htmlunit.sourceforge.net/faq.html#AJAXDoesNotWork

Don't hesitate to ask if you have an issue.

Yours,
Ahmed
----
Blog: http://asashour.blogspot.com
________________________________
From: "Santoshi, Vishal" <Vishal_Santoshi@...>
To: "htmlunit-user@..." <htmlunit-user@...>
Sent: Wed, December 9, 2009 7:01:59 PM
Subject: [Htmlunit-user] GWT and htmunit

I am new to htmlunit and thus need some advise.

We want to use htmlunit for raw html scraping. Ours is a GWT application that shows reports based on some usecase ( included images through JFree and some fancy GWT canvas etc , the data being fed through asynchronous RPC calls ).
A user may decide to export the GWT Page they see as a pdf, and we would like to be able to export the Page as html and feed it to a "pdf creating " engine ( Yes html -> pdf engine).
This brings one question ( especially due to the asynchrnous nature of GWT/ AJAX ) .

* Are there examples to hit a url , load up GWT JS ( asynchronous ) , wait for all executions ( asynchrnoous ) to do their magic and feed the specific parts of the JS with data through RPC , and finally get the raw html.
* Is it even possible?

I have seen GWT7 example, but that seems an iota of the functionality we may need ( even though I should say that have not gone deep into it ) .

IMPORTANT NOTICE: This e-mail message and all attachments, if any, may contain confidential and privileged material and are intended only for the person or entity to which the message is addressed. If you are not an intended recipient, you are hereby notified that any use, dissemination, distribution, disclosure, or copying of this information is unauthorized and strictly prohibited. If you have received this communication in error, please contact the sender immediately by reply e-mail, and destroy all copies of the original message.

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...<mailto:Htmlunit-user@...>
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

IMPORTANT NOTICE: This e-mail message and all attachments, if any, may contain confidential and privileged material and are intended only for the person or entity to which the message is addressed. If you are not an intended recipient, you are hereby notified that any use, dissemination, distribution, disclosure, or copying of this information is unauthorized and strictly prohibited. If you have received this communication in error, please contact the sender immediately by reply e-mail, and destroy all copies of the original message.

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev

_______________________________________________
Htmlunit-user mailing list
Htmlunit-user@...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user