htmlunit-user — Discussion of the use of HtmlUnit

Re: [Htmlunit-user] jQuery Template & Widget support

[Ahmed A. <asa...@ya...>]

Hi Satya,

It is not library-specific, but rather a specific method/property not properly handled by HtmlUnit.

HtmlUnit is meant to simulate real browsers behavior, and 'most' (but not all) JavaScript functions/properties are correctly implemented.

However, one can easily come across a situation of a certain flow of methods, in which HtmlUnit doesn't behave as real browsers (IE/FF/Chrome different versions).

Hope that clarifies,
Ahmed

________________________________
 From: Satyanarayana K <kri...@ya...>
To: Ahmed Ashour <asa...@ya...>; "htm...@li..." <htm...@li...> 
Sent: Tuesday, December 3, 2013 4:49 PM
Subject: Re: [Htmlunit-user] jQuery Template & Widget support
 


Hi Ahmed,

I do not understand one thing and so seek your guidance in understanding that: Is there a need to add new code to HtmlUnit for handling the jQuery library or any specific JavaScript library? Is it not sufficient that the complete JavaScript syntax is handled by the JavaScript Engine? If there is a need to write library-specific-code, what exactly is the reason? Is it the case that jQuery has introduced some custom syntax and that is the reason warranting custom-code? Or is it that jQuery has introduced some complex custom data-structures and these need some custom code? If the latter is the reason, is it not possible to have a generic set of routines for recursively reducing any complex data-structure to the primitive types in JavaScript that are already covered by the syntax? I have some experience in meta-level-coding and may be able to provide some inputs for developing such generic set of routines.

Thanks,
Satya



On Tuesday, December 3, 2013 7:06 PM, Ahmed Ashour <asa...@ya...> wrote:
 
Hi Anant,

I would say give it try.

Unfortunately, jQuery test suite isn't passing even in real browsers, that's why we didn't put effort to make sure HtmlUnit passes all the tests.

The team is here to help, in case you find an issue.

Yours,
Ahmed

________________________________
 From: Anant Toradmal <tor...@gm...>
To: htm...@li... 
Sent: Tuesday, December 3, 2013 1:33 PM
Subject: [Htmlunit-user] jQuery Template & Widget support
 


Hi Team,

I am using HTMLUnit to test our websites now I am planning to use it to test one of our web based application which has, jQuery 1.10.2, jQuery Templates 1.0.0 and jQuery UI - v1.10.3.
So does HTMLUnit supports this version of jQuery and its plugins?

PS: We have recently upgraded our HTMLUnit to the latest 2.14-SNAPSHOT version.

Really appreciate your help with this.

Thanks & Regards,
Anant P. Toradmal


------------------------------------------------------------------------------
Rapidly troubleshoot problems before they affect your business. Most IT 
organizations don't have a clear picture of how application performance 
affects their revenue. With AppDynamics, you get 100% visibility into your 
Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk

_______________________________________________
Htmlunit-user mailing list
Htm...@li...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: [Htmlunit-user] jQuery Template & Widget support

[Anant T. <tor...@gm...>]

Hi Ahmed,

Thanks for your help. I will definitely give it a try.

Thanks & Regards,
Anant P. Toradmal


On Tue, Dec 3, 2013 at 7:02 PM, Ahmed Ashour <asa...@ya...> wrote:

> Hi Anant,
>
> I would say give it try.
>
> Unfortunately, jQuery test suite isn't passing even in real browsers,
> that's why we didn't put effort to make sure HtmlUnit passes all the tests.
>
> The team is here to help, in case you find an issue.
>
> Yours,
> Ahmed
>   ------------------------------
>  *From:* Anant Toradmal <tor...@gm...>
> *To:* htm...@li...
> *Sent:* Tuesday, December 3, 2013 1:33 PM
> *Subject:* [Htmlunit-user] jQuery Template & Widget support
>
> Hi Team,
>
> I am using HTMLUnit to test our websites now I am planning to use it to
> test one of our web based application which has, jQuery 1.10.2, jQuery
> Templates 1.0.0 and jQuery UI - v1.10.3.
> So does HTMLUnit supports this version of jQuery and its plugins?
>
> PS: We have recently upgraded our HTMLUnit to the latest 2.14-SNAPSHOT
> version.
>
> Really appreciate your help with this.
>
> Thanks & Regards,
> Anant P. Toradmal
>
>
>
> ------------------------------------------------------------------------------
> Rapidly troubleshoot problems before they affect your business. Most IT
> organizations don't have a clear picture of how application performance
> affects their revenue. With AppDynamics, you get 100% visibility into your
> Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics
> Pro!
> http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk
> _______________________________________________
> Htmlunit-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>
>

Re: [Htmlunit-user] jQuery Template & Widget support

[Satyanarayana K <kri...@ya...>]

Hi Ahmed,

I do not understand one thing and so seek your guidance in understanding that: Is there a need to add new code to HtmlUnit for handling the jQuery library or any specific JavaScript library? Is it not sufficient that the complete JavaScript syntax is handled by the JavaScript Engine? If there is a need to write library-specific-code, what exactly is the reason? Is it the case that jQuery has introduced some custom syntax and that is the reason warranting custom-code? Or is it that jQuery has introduced some complex custom data-structures and these need some custom code? If the latter is the reason, is it not possible to have a generic set of routines for recursively reducing any complex data-structure to the primitive types in JavaScript that are already covered by the syntax? I have some experience in meta-level-coding and may be able to provide some inputs for developing such generic set of routines.

Thanks,
Satya



On Tuesday, December 3, 2013 7:06 PM, Ahmed Ashour <asa...@ya...> wrote:
 
Hi Anant,

I would say give it try.

Unfortunately, jQuery test suite isn't passing even in real browsers, that's why we didn't put effort to make sure HtmlUnit passes all the tests.

The team is here to help, in case you find an issue.

Yours,
Ahmed

________________________________
 From: Anant Toradmal <tor...@gm...>
To: htm...@li... 
Sent: Tuesday, December 3, 2013 1:33 PM
Subject: [Htmlunit-user] jQuery Template & Widget support
 


Hi Team,

I am using HTMLUnit to test our websites now I am planning to use it to test one of our web based application which has, jQuery 1.10.2, jQuery Templates 1.0.0 and jQuery UI - v1.10.3.
So does HTMLUnit supports this version of jQuery and its plugins?

PS: We have recently upgraded our HTMLUnit to the latest 2.14-SNAPSHOT version.

Really appreciate your help with this.

Thanks & Regards,
Anant P. Toradmal


------------------------------------------------------------------------------
Rapidly troubleshoot problems before they affect your business. Most IT 
organizations don't have a clear picture of how application performance 
affects their revenue. With AppDynamics, you get 100% visibility into your 
Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk

_______________________________________________
Htmlunit-user mailing list
Htm...@li...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: [Htmlunit-user] jQuery Template & Widget support

[Ahmed A. <asa...@ya...>]

Hi Anant,

I would say give it try.

Unfortunately, jQuery test suite isn't passing even in real browsers, that's why we didn't put effort to make sure HtmlUnit passes all the tests.

The team is here to help, in case you find an issue.

Yours,
Ahmed

________________________________
 From: Anant Toradmal <tor...@gm...>
To: htm...@li... 
Sent: Tuesday, December 3, 2013 1:33 PM
Subject: [Htmlunit-user] jQuery Template & Widget support
 


Hi Team,

I am using HTMLUnit to test our websites now I am planning to use it to test one of our web based application which has, jQuery 1.10.2, jQuery Templates 1.0.0 and jQuery UI - v1.10.3.
So does HTMLUnit supports this version of jQuery and its plugins?

PS: We have recently upgraded our HTMLUnit to the latest 2.14-SNAPSHOT version.

Really appreciate your help with this.

Thanks & Regards,
Anant P. Toradmal

[Htmlunit-user] jQuery Template & Widget support

[Anant T. <tor...@gm...>]

Hi Team,

I am using HTMLUnit to test our websites now I am planning to use it to
test one of our web based application which has, jQuery 1.10.2, jQuery
Templates 1.0.0 and jQuery UI - v1.10.3.
So does HTMLUnit supports this version of jQuery and its plugins?

PS: We have recently upgraded our HTMLUnit to the latest 2.14-SNAPSHOT
version.

Really appreciate your help with this.

Thanks & Regards,
Anant P. Toradmal

Re: [Htmlunit-user] HtmlUnit Support for JavaScript

[Satyanarayana K <kri...@ya...>]

Thanks, Ahmed.

- Satya



On Monday, December 2, 2013 12:04 PM, Ahmed Ashour <asa...@ya...> wrote:
 
Hi,

1. I agree with you, disabling JavaScript shouldn't be recommended, however sometimes simple scraping is needed, without JS functionality.

2. Yes, window.postMessage() is supported.

3. JS engine is Rhino, which I think is no more related to FF support, but focuses more on the JS standard, its history is in [1].

Hope that helps,
Ahmed

[1] https://developer.mozilla.org/en-US/docs/Rhino/History


________________________________
 From: Satyanarayana K <kri...@ya...>
To: "htm...@li..." <htm...@li...> 
Sent: Saturday, November 30, 2013 4:45 PM
Subject: [Htmlunit-user] HtmlUnit Support for JavaScript
 


Hi,

I am aware that HtmlUnit is perhaps the only open-source Library for HTML Parsing (Java or Non-Java) that provides native support for javaScript execution. However, I wish to highlight certain aspects for discussion / my own clarification. 

This posting would perhaps be best addressed by the HtmlUnit Development Team:

1. I am somewhat confused by a response that is often posted against some of the issues reported - the response that says the problem or issue would be solved by setting WebClient - javaScriptEnabled property to false. My question is: a. If the page content is driven by javaScript, how does setting WebClient - javaScriptEnabled property to false help or solve the problem? b. If the page content is NOT driven by javaScript, why should the WebClient - javaScriptEnabled property setting matter at all?

2.  I have experienced frequent difficulties in loading javaScript-driven pages, esp those that involved cross-domain-messaging. The expected procedure for reporting javaScript bugs (isolating minimal test case) appears very complex to me as I have very little exposure to or experience with javaScript. I have been able to identify that the issues are traceable to cross-domain-messaging. I would like to know, quite simply: Does HtmlUnit execute cross-domain-messaging calls? This cross-domain-messaging appears to be getting pervasive,  a feature that deserves to be supported by HtmlUnit if not already supported.

3. In the documentation of Selenium WebDriver, I have seen that the javaScript engine used by HtmlUnit is the one that was used by FireFox version 3.6 or thereabouts (The default instantiation of HtmlUnitDriver under Selenium is without javaScript enabled). Today FireFox is in version 24 or so. It appears the javaScript engine used by HtmlUnit is obsolete technology. Is this the reason for the cross-domain-messaging problems?

I use HtmlUnit in web-scraping applications. The above issues happen to be critical for such applications.

Thanks for your time,
Satya
------------------------------------------------------------------------------
Rapidly troubleshoot problems before they affect your business. Most IT 
organizations don't have a clear picture of how application performance 
affects their revenue. With AppDynamics, you get 100% visibility into your 
Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk
_______________________________________________
Htmlunit-user mailing list
Htm...@li...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user




------------------------------------------------------------------------------
Rapidly troubleshoot problems before they affect your business. Most IT 
organizations don't have a clear picture of how application performance 
affects their revenue. With AppDynamics, you get 100% visibility into your 
Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk

_______________________________________________
Htmlunit-user mailing list
Htm...@li...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: [Htmlunit-user] SocksSocketFactory extends final PlainSocketFactory

[Ben S. <sub...@be...>]

>>>>>> I cannot compile HTMLUnit, since SocksSocketFactory extends final
>>>>>> PlainSocketFactory. How can I get around this?

>>>>> You are missing an HTTPClient library jar on your class path or the one
>>>>> you have is out-of-date.
>>>>>
>>>>> Careful, there’s more than one HTTPClient out there.

>>>> Thanks David, to get it right, can you point me towards the right one.
>>>> There is an client in my path but maybe the wrong one.

>>> Chances are you have a typo in your class path if you think you have one
>>> available.

>> That doesn't seem to be the case, since I get the following error message:
>>
>>    [javac] /nas/home3/b/bsmyth/workspace/src/com/gargoylesoftware/htmlunit/SocksSocketFactory.java:33:
>> cannot inherit from final
>> org.apache.http.conn.scheme.PlainSocketFactory
>>    [javac] class SocksSocketFactory extends PlainSocketFactory {
>>
>> To clarify, the htmlunit source is from htmlunit-2.13-src.zip and
>> httpclient-4.3.1.jar is extracted from htmlunit-2.13-bin.zip.

> This again tells me that somehow your libraries in your class path are set up wrongly.
> I’m afraid I will have to defer to wiser heads on this one.

I have solved the problem: there were two instances of
PlainSocketFactory in my classpath! (I diagnosed the problem as
follows, namely, removed the instance of PlainSocketFactory.class from
httpclient-4.3.1.jar and recompiled, knowing that if I got the same
compilation error, then there must have been another instances of
PlainSocketFactory lurking around somewhere.)

Thanks for your help.


Best regards,

Ben

Re: [Htmlunit-user] HtmlUnit Support for JavaScript

[Ahmed A. <asa...@ya...>]

Hi,

1. I agree with you, disabling JavaScript shouldn't be recommended, however sometimes simple scraping is needed, without JS functionality.

2. Yes, window.postMessage() is supported.

3. JS engine is Rhino, which I think is no more related to FF support, but focuses more on the JS standard, its history is in [1].

Hope that helps,
Ahmed

[1] https://developer.mozilla.org/en-US/docs/Rhino/History


________________________________
 From: Satyanarayana K <kri...@ya...>
To: "htm...@li..." <htm...@li...> 
Sent: Saturday, November 30, 2013 4:45 PM
Subject: [Htmlunit-user] HtmlUnit Support for JavaScript
 


Hi,

I am aware that HtmlUnit is perhaps the only open-source Library for HTML Parsing (Java or Non-Java) that provides native support for javaScript execution. However, I wish to highlight certain aspects for discussion / my own clarification. 

This posting would perhaps be best addressed by the HtmlUnit Development Team:

1. I am somewhat confused by a response that is often posted against some of the issues reported - the response that says the problem or issue would be solved by setting WebClient - javaScriptEnabled property to false. My question is: a. If the page content is driven by javaScript, how does setting WebClient - javaScriptEnabled property to false help or solve the problem? b. If the page content is NOT driven by javaScript, why should the WebClient - javaScriptEnabled property setting matter at all?

2.  I have experienced frequent difficulties in loading javaScript-driven pages, esp those that involved cross-domain-messaging. The expected procedure for reporting javaScript bugs (isolating minimal test case) appears very complex to me as I have very little exposure to or experience with javaScript. I have been able to identify that the issues are traceable to cross-domain-messaging. I would like to know, quite simply: Does HtmlUnit execute cross-domain-messaging calls? This cross-domain-messaging appears to be getting pervasive,  a feature that deserves to be supported by HtmlUnit if not already supported.

3. In the documentation of Selenium WebDriver, I have seen that the javaScript engine used by HtmlUnit is the one that was used by FireFox version 3.6 or thereabouts (The default instantiation of HtmlUnitDriver under Selenium is without javaScript enabled). Today FireFox is in version 24 or so. It appears the javaScript engine used by HtmlUnit is obsolete technology. Is this the reason for the cross-domain-messaging problems?

I use HtmlUnit in web-scraping applications. The above issues happen to be critical for such applications.

Thanks for your time,
Satya
------------------------------------------------------------------------------
Rapidly troubleshoot problems before they affect your business. Most IT 
organizations don't have a clear picture of how application performance 
affects their revenue. With AppDynamics, you get 100% visibility into your 
Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk
_______________________________________________
Htmlunit-user mailing list
Htm...@li...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: [Htmlunit-user] SocksSocketFactory extends final PlainSocketFactory

[David T. <da...@de...>]

Curiouser and curiouser!

If you step back a second and consider what “final” means, it should be a little clearer.  A final class cannot be subclassed.  http://en.wikipedia.org/wiki/Final_%28Java%29

This again tells me that somehow your libraries in your class path are set up wrongly.  I’m afraid I will have to defer to wiser heads on this one. 

Are you following the suggestion on the web site?  
http://htmlunit.sourceforge.net/gettingLatestCode.html

“Compiling the code

The preferred way to build HtmlUnit is with maven 3.

mvn compile
This will do an incremental compile of all the code.

mvn clean compile
This will do a clean compile of all the code."

David
--
David W. Taylor, Detayls
www.detayls.com



On Nov 30, 2013, at 3:50 AM, Ben Smyth <sub...@be...> wrote:

>>>>> I cannot compile HTMLUnit, since SocksSocketFactory extends final
>>>>> PlainSocketFactory. How can I get around this?
>>>> You are missing an HTTPClient library jar on your class path or the one
>>>> you have is out-of-date.
>>>> 
>>>> Careful, there’s more than one HTTPClient out there.
>>> Thanks David, to get it right, can you point me towards the right one.
>>> There is an client in my path but maybe the wrong one.
>> Chances are you have a typo in your class path if you think you have one
>> available.
> 
> That doesn't seem to be the case, since I get the following error message:
> 
>    [javac] /nas/home3/b/bsmyth/workspace/src/com/gargoylesoftware/htmlunit/SocksSocketFactory.java:33:
> cannot inherit from final
> org.apache.http.conn.scheme.PlainSocketFactory
>    [javac] class SocksSocketFactory extends PlainSocketFactory {
> 
> To clarify, the htmlunit source is from htmlunit-2.13-src.zip and
> httpclient-4.3.1.jar is extracted from htmlunit-2.13-bin.zip.
> 
> 

[Htmlunit-user] HtmlUnit Support for JavaScript

[Satyanarayana K <kri...@ya...>]

Hi,

I am aware that HtmlUnit is perhaps the only open-source Library for HTML Parsing (Java or Non-Java) that provides native support for javaScript execution. However, I wish to highlight certain aspects for discussion / my own clarification. 

This posting would perhaps be best addressed by the HtmlUnit Development Team:

1. I am somewhat confused by a response that is often posted against some of the issues reported - the response that says the problem or issue would be solved by setting WebClient - javaScriptEnabled property to false. My question is: a. If the page content is driven by javaScript, how does setting WebClient - javaScriptEnabled property to false help or solve the problem? b. If the page content is NOT driven by javaScript, why should the WebClient - javaScriptEnabled property setting matter at all?

2.  I have experienced frequent difficulties in loading javaScript-driven pages, esp those that involved cross-domain-messaging. The expected procedure for reporting javaScript bugs (isolating minimal test case) appears very complex to me as I have very little exposure to or experience with javaScript. I have been able to identify that the issues are traceable to cross-domain-messaging. I would like to know, quite simply: Does HtmlUnit execute cross-domain-messaging calls? This cross-domain-messaging appears to be getting pervasive,  a feature that deserves to be supported by HtmlUnit if not already supported.

3. In the documentation of Selenium WebDriver, I have seen that the javaScript engine used by HtmlUnit is the one that was used by FireFox version 3.6 or thereabouts (The default instantiation of HtmlUnitDriver under Selenium is without javaScript enabled). Today FireFox is in version 24 or so. It appears the javaScript engine used by HtmlUnit is obsolete technology. Is this the reason for the cross-domain-messaging problems?

I use HtmlUnit in web-scraping applications. The above issues happen to be critical for such applications.

Thanks for your time,
Satya

Re: [Htmlunit-user] SocksSocketFactory extends final PlainSocketFactory

[Ben S. <sub...@be...>]

>>>> I cannot compile HTMLUnit, since SocksSocketFactory extends final
>>>> PlainSocketFactory. How can I get around this?
>>> You are missing an HTTPClient library jar on your class path or the one
>>> you have is out-of-date.
>>>
>>> Careful, there’s more than one HTTPClient out there.
>> Thanks David, to get it right, can you point me towards the right one.
>> There is an client in my path but maybe the wrong one.
> Chances are you have a typo in your class path if you think you have one
> available.

That doesn't seem to be the case, since I get the following error message:

    [javac] /nas/home3/b/bsmyth/workspace/src/com/gargoylesoftware/htmlunit/SocksSocketFactory.java:33:
cannot inherit from final
org.apache.http.conn.scheme.PlainSocketFactory
    [javac] class SocksSocketFactory extends PlainSocketFactory {

To clarify, the htmlunit source is from htmlunit-2.13-src.zip and
httpclient-4.3.1.jar is extracted from htmlunit-2.13-bin.zip.

Re: [Htmlunit-user] SocksSocketFactory extends final PlainSocketFactory

[David. T. <da...@de...>]

Chances are you have a typo in your class path if you think you have one available. 

—
Sent from Mailbox for iPhone

On Fri, Nov 29, 2013 at 12:43 PM, Ben Smyth <sub...@be...>
wrote:

> Thanks David, to get it right, can you point me towards the right one.
> There is an client in my path but maybe the wrong one.
> On Nov 29, 2013 6:57 PM, "David Taylor" <da...@de...> wrote:
>> Ben,
>>
>> You are missing an HTTPClient library jar on your class path or the one
>> you have is out-of-date.
>>
>> Careful, there’s more than one HTTPClient out there.
>>
>> David
>> --
>> David W. Taylor, Detayls
>> www.detayls.com
>>
>>
>>
>> On Nov 29, 2013, at 8:54 AM, Ben Smyth <sub...@be...> wrote:
>>
>> > Dear all,
>> >
>> > I cannot compile HTMLUnit, since SocksSocketFactory extends final
>> > PlainSocketFactory. How can I get around this?
>> >
>> >
>> > Best regards,
>> >
>> > Ben
>> >
>> >
>> >
>> >
>> ------------------------------------------------------------------------------
>> > Rapidly troubleshoot problems before they affect your business. Most IT
>> > organizations don't have a clear picture of how application performance
>> > affects their revenue. With AppDynamics, you get 100% visibility into
>> your
>> > Java,.NET, & PHP application. Start your 15-day FREE TRIAL of
>> AppDynamics Pro!
>> >
>> http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk
>> > _______________________________________________
>> > Htmlunit-user mailing list
>> > Htm...@li...
>> > https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>>
>>

Re: [Htmlunit-user] SocksSocketFactory extends final PlainSocketFactory

[Ben S. <sub...@be...>]

Thanks David, to get it right, can you point me towards the right one.
There is an client in my path but maybe the wrong one.
On Nov 29, 2013 6:57 PM, "David Taylor" <da...@de...> wrote:

> Ben,
>
> You are missing an HTTPClient library jar on your class path or the one
> you have is out-of-date.
>
> Careful, there’s more than one HTTPClient out there.
>
> David
> --
> David W. Taylor, Detayls
> www.detayls.com
>
>
>
> On Nov 29, 2013, at 8:54 AM, Ben Smyth <sub...@be...> wrote:
>
> > Dear all,
> >
> > I cannot compile HTMLUnit, since SocksSocketFactory extends final
> > PlainSocketFactory. How can I get around this?
> >
> >
> > Best regards,
> >
> > Ben
> >
> >
> >
> >
> ------------------------------------------------------------------------------
> > Rapidly troubleshoot problems before they affect your business. Most IT
> > organizations don't have a clear picture of how application performance
> > affects their revenue. With AppDynamics, you get 100% visibility into
> your
> > Java,.NET, & PHP application. Start your 15-day FREE TRIAL of
> AppDynamics Pro!
> >
> http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk
> > _______________________________________________
> > Htmlunit-user mailing list
> > Htm...@li...
> > https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>
>

Re: [Htmlunit-user] SocksSocketFactory extends final PlainSocketFactory

[David T. <da...@de...>]

Ben,

You are missing an HTTPClient library jar on your class path or the one you have is out-of-date.

Careful, there’s more than one HTTPClient out there.

David
--
David W. Taylor, Detayls
www.detayls.com



On Nov 29, 2013, at 8:54 AM, Ben Smyth <sub...@be...> wrote:

> Dear all,
> 
> I cannot compile HTMLUnit, since SocksSocketFactory extends final
> PlainSocketFactory. How can I get around this?
> 
> 
> Best regards,
> 
> Ben
> 
> 
> 
> ------------------------------------------------------------------------------
> Rapidly troubleshoot problems before they affect your business. Most IT 
> organizations don't have a clear picture of how application performance 
> affects their revenue. With AppDynamics, you get 100% visibility into your 
> Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
> http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk
> _______________________________________________
> Htmlunit-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlunit-user

[Htmlunit-user] SocksSocketFactory extends final PlainSocketFactory

[Ben S. <sub...@be...>]

Dear all,

I cannot compile HTMLUnit, since SocksSocketFactory extends final
PlainSocketFactory. How can I get around this?


Best regards,

Ben

[Htmlunit-user] Parsing content Strings into HtmlPages

[Andrew P. <ape...@42...>]

I want to parse a content String into an HtmlPage using HtmlParser and
StringWebResponse. This sort of works.

PageParser.java

https://gist.github.com/apennebaker/7680963

However, when the source url is "scp://...", Java throws an error on URL()
construction:

MalformedURLException: unknown protocol: scp

I'm currently using dummy URLs to get around this, but I fear corruption of
data.

Could we add a constructor for StringWebResponse that takes a String url?

Or even better, a constructor for HtmlPage(String content, String
sourceURI)?

-- 
Cheers,

Andrew Pennebaker
ape...@42...

Re: [Htmlunit-user] Problems with Facebook TextBox

[Ronald B. <rb...@rb...>]

Fab,

usually all this fancy web sites are based on AJAX. So the page you finally got in your browser is the result of many request.
Try to wait a bit after the login before you ask the WebClient for the current page again.
In many cases this helps.
For the wait code have a look at http://htmlunit.sourceforge.net/faq.html#AJAXDoesNotWork

    RBRi
    --------------------------
    Wetator
    Smart web application testing
    http://www.wetator.org



On Tue, 26 Nov 2013 21:22:51 +0100 Fab Brio wrote:
>
>Hi, 
>
>I'm trying to build a application on Facebook with HtmlUnit,
>So I want to log my profile, post contents on my wall and on groups pages.
>I have no problem with the login procedure (I find the text boxes, i fill them with name and password and I call "click" on the button.
>
>But I have problem with groups: I fail to grab the text box where I have to write the message.
>
>
>http://oi43.tinypic.com/28vszr6.jpg
>
>I proceed this way:
>
>java.util.logging.Logger.getLogger("com.gargoylesoftware").setLevel(
>                java.util.logging.Level.OFF);
>WebClient client = new WebClient(BrowserVersion.getDefault());
>//log procedure...
>
>page = webClient.getPage("page_url");
>page.getElementByName("xhpc_message_text"); 
>
>the last line throws an exception or returns null: HtmlUnit fails to find the element.
>I tried with the id (u_0_3a in this case) but it changes every time, the name is always the same, so that's why I using name instead of id.
>
>How can I get the textbox element?
>
>The second problem is with the format in which facebook publish my content,
>A normal post shows a title an icon etc. If I use HtmlUnit to fill the box end click on the button to post it, fb shows only the string.
>http://oi42.tinypic.com/2z703k0.jpg
>
>How can I fix it?
>
>I hope that someone have an answer for these problems.
>

[Htmlunit-user] Problems with Facebook TextBox

[Fab B. <swo...@ho...>]

Hi, 

I'm trying to build a application on Facebook with HtmlUnit,
So I want to log my profile, post contents on my wall and on groups pages.
I have no problem with the login procedure (I find the text boxes, i fill them with name and password and I call "click" on the button.

But I have problem with groups: I fail to grab the text box where I have to write the message.


http://oi43.tinypic.com/28vszr6.jpg

I proceed this way:

java.util.logging.Logger.getLogger("com.gargoylesoftware").setLevel(
                java.util.logging.Level.OFF);
WebClient client = new WebClient(BrowserVersion.getDefault());
//log procedure...

page = webClient.getPage("page_url");
page.getElementByName("xhpc_message_text"); 

the last line throws an exception or returns null: HtmlUnit fails to find the element.
I tried with the id (u_0_3a in this case) but it changes every time, the name is always the same, so that's why I using name instead of id.

How can I get the textbox element?

The second problem is with the format in which facebook publish my content,
A normal post shows a title an icon etc. If I use HtmlUnit to fill the box end click on the button to post it, fb shows only the string.
http://oi42.tinypic.com/2z703k0.jpg

How can I fix it?

I hope that someone have an answer for these problems.

Re: [Htmlunit-user] Help with getting the latest build...

[David T. <da...@de...>]

Good, that was exactly what I needed.

Thanks.

David
--
David Taylor, Detayls


On Mon, Nov 25, 2013 at 11:18 AM, Ahmed Ashour <asa...@ya...> wrote:

> Hi David,
>
> Click 'build artifacts'
>
> Ahmed
>
> On Nov 25, 2013, at 10:13 PM, David Taylor <da...@de...> wrote:
>
> Hi!
>
> I needed to get the latest build for our internal testing so I went to:
> http://build.canoo.com/htmlunit/
>
> This site seems to list the builds and what changed but I cannot see a way
> to download a binary with all of the jars.
>
> Can someone help me?
>
> Thanks.
>
> David
> --
> David Taylor, Detayls
>
>
> ------------------------------------------------------------------------------
> Shape the Mobile Experience: Free Subscription
> Software experts and developers: Be at the forefront of tech innovation.
> Intel(R) Software Adrenaline delivers strategic insight and game-changing
> conversations that shape the rapidly evolving mobile landscape. Sign up
> now.
> http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
>
> _______________________________________________
> Htmlunit-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>
>
>
> ------------------------------------------------------------------------------
> Shape the Mobile Experience: Free Subscription
> Software experts and developers: Be at the forefront of tech innovation.
> Intel(R) Software Adrenaline delivers strategic insight and game-changing
> conversations that shape the rapidly evolving mobile landscape. Sign up
> now.
> http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
> _______________________________________________
> Htmlunit-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>
>

Re: [Htmlunit-user] Help with getting the latest build...

[Ahmed A. <asa...@ya...>]

Hi David,

Click 'build artifacts'

Ahmed

> On Nov 25, 2013, at 10:13 PM, David Taylor <da...@de...> wrote:
> 
> Hi!
> 
> I needed to get the latest build for our internal testing so I went to:
> http://build.canoo.com/htmlunit/
> 
> This site seems to list the builds and what changed but I cannot see a way to download a binary with all of the jars.
> 
> Can someone help me?
> 
> Thanks.
> 
> David
> --
> David Taylor, Detayls
> ------------------------------------------------------------------------------
> Shape the Mobile Experience: Free Subscription
> Software experts and developers: Be at the forefront of tech innovation.
> Intel(R) Software Adrenaline delivers strategic insight and game-changing 
> conversations that shape the rapidly evolving mobile landscape. Sign up now. 
> http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
> _______________________________________________
> Htmlunit-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlunit-user

[Htmlunit-user] Help with getting the latest build...

[David T. <da...@de...>]

Hi!

I needed to get the latest build for our internal testing so I went to:
http://build.canoo.com/htmlunit/

This site seems to list the builds and what changed but I cannot see a way
to download a binary with all of the jars.

Can someone help me?

Thanks.

David
--
David Taylor, Detayls

Re: [Htmlunit-user] Excessive .tmp files - issue revisited...

[Ahmed A. <asa...@ya...>]

Hi David,

Fixed in SVN, thanks for raising it up.

Ahmed

________________________________
 From: David Taylor <da...@de...>
To: Ahmed Ashour <asa...@ya...>; "htm...@li..." <htm...@li...> 
Sent: Friday, November 22, 2013 8:49 PM
Subject: Re: [Htmlunit-user] Excessive .tmp files - issue revisited...
 


That's good news.  Thanks!



David
--
David Taylor, Detayls



On Fri, Nov 22, 2013 at 1:56 AM, Ahmed Ashour <asa...@ya...> wrote:

Hi all,
>
>
>- Not deleting all files in closeAllWindows() is a bug, and no workaround should be considered.
>- Let's always keep the discussion around latest version (or preferably SVN version).
>- I retested, and finally was able to simulate the issue, David is right: the issue happens in loading .js files, but not to .html (which made the confusion last time).
>- To be fixed soon.
>
>
>Yours,
>Ahmed
>
>________________________________
>
>From: J <iha...@ya...>
>To: David Taylor <da...@de...> 
>Cc: "htm...@li..." <htm...@li...> 
>Sent: Thursday, November 21, 2013 12:58 AM
>Subject: Re: [Htmlunit-user] Excessive .tmp files - issue revisited...
> 
>
>
>Right -- hence one of the htmlunit users wrote a work around.
>
>  I tried to get around this in 2011 and
 ended up just using the work around.  If someone were to propose a code change I'm sure the dev team would look at it -- sadly this is way above my experience level (which is why I went for the work around in the blog)
>
>
>
>
>

Re: [Htmlunit-user] Excessive .tmp files - issue revisited...

[David T. <da...@de...>]

That's good news.  Thanks!

David
--
David Taylor, Detayls


On Fri, Nov 22, 2013 at 1:56 AM, Ahmed Ashour <asa...@ya...> wrote:

> Hi all,
>
> - Not deleting all files in closeAllWindows() is a bug, and no workaround
> should be considered.
> - Let's always keep the discussion around latest version (or preferably
> SVN version).
> - I retested, and finally was able to simulate the issue, David is right:
> the issue happens in loading .js files, but not to .html (which made the
> confusion last time).
> - To be fixed soon.
>
> Yours,
> Ahmed
>   ------------------------------
>  *From:* J <iha...@ya...>
> *To:* David Taylor <da...@de...>
> *Cc:* "htm...@li..." <
> htm...@li...>
> *Sent:* Thursday, November 21, 2013 12:58 AM
> *Subject:* Re: [Htmlunit-user] Excessive .tmp files - issue revisited...
>
> Right -- hence one of the htmlunit users wrote a work around.
>
>   I tried to get around this in 2011 and ended up just using the work
> around.  If someone were to propose a code change I'm sure the dev team
> would look at it -- sadly this is way above my experience level (which is
> why I went for the work around in the blog)
>
>
>
>   On Wednesday, November 20, 2013 2:53 PM, David Taylor <
> da...@de...> wrote:
>  J,
>
> If that is the case then I really have a problem. My app that uses
> HTMLUnit is intended to stay running for weeks
> .
>
> If these files are not deleted until the JVM exits then this seems like
> incorrect behavior.
>
> David
> --
> David Taylor, Detayls
>
>
> On Wed, Nov 20, 2013 at 1:44 PM, J <iha...@ya...> wrote:
>
> According to the blog, it was stated that the files get deleted on
> calldeleteOnExit, and NOT on closeAllWindows as you have indicated.   In
> other words, the files will NOT be deleted until the JVM exists.  Sounds
> like a feature request not  a bug.
>
>
>
>   On Wednesday, November 20, 2013 11:32 AM, David Taylor <
> da...@de...> wrote:
>   Thanks, J but I really need someone to find the issue.
>
> The tmp files I am seeing are all over 500kb and full of JavaScript so the
> library is not seeing them as a "window" and thus they are not set properly
> as files that need to be deleted when closeAllWindows is called.
>
> David
> --
> David Taylor, Detayls
>
>
> On Wed, Nov 20, 2013 at 8:33 AM, J <iha...@ya...> wrote:
>
> http://www.julespotvin.com/?p=17
>
> ^^ It's on oldy but the solution works for me.
>
> -J
>
>
>    On Monday, November 18, 2013 12:27 PM, David Taylor <da...@de...>
> wrote:
>   I recently asked the list if there was a solution for the temp file
> problem that I have been encountering.
>
> Ahmed was helpful in talking me through it but ultimately no solution was
> found.
>
> To recap
> ,
> my application uses HTMLUnit and correctly calls closeAllWindows but
> html*.tmp files keep stacking up in my temp directory.
>
> After a while the temp files fill the disk.
>
> I have a suspicion that the temp files are created by a JavaScript load
> and so do not get added the Window list.
>
> Does any new information exist on this issue?
>
> Thanks,
>
> David
> --
> David Taylor, Detayls
>
>
> ------------------------------------------------------------------------------
> Shape the Mobile Experience: Free Subscription
> Software experts and developers: Be at the forefront of tech innovation.
> Intel(R) Software Adrenaline delivers strategic insight and game-changing
> conversations that shape the rapidly evolving mobile landscape. Sign up
> now.
> http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
> _______________________________________________
> Htmlunit-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>
>
>
>
> ------------------------------------------------------------------------------
> Shape the Mobile Experience: Free Subscription
> Software experts and developers: Be at the forefront of tech innovation.
> Intel(R) Software Adrenaline delivers strategic insight and game-changing
> conversations that shape the rapidly evolving mobile landscape. Sign up
> now.
> http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
> _______________________________________________
> Htmlunit-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>
>
>
>
>
>
>
>
>
> ------------------------------------------------------------------------------
> Shape the Mobile Experience: Free Subscription
> Software experts and developers: Be at the forefront of tech innovation.
> Intel(R) Software Adrenaline delivers strategic insight and game-changing
> conversations that shape the rapidly evolving mobile landscape. Sign up
> now.
> http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
>
> _______________________________________________
> Htmlunit-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>
>
>
>
> ------------------------------------------------------------------------------
> Shape the Mobile Experience: Free Subscription
> Software experts and developers: Be at the forefront of tech innovation.
> Intel(R) Software Adrenaline delivers strategic insight and game-changing
> conversations that shape the rapidly evolving mobile landscape. Sign up
> now.
> http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
> _______________________________________________
> Htmlunit-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>
>

[Htmlunit-user] Not able to submit a form

[Nitin T. <nt...@ne...>]

Hi,

 

I am trying to enter some values in an HTML form on
http://www.priceline.com/flights/ , submit it and get the resultant page.
But it is taking me back to the same page. I am using the following code -

 

HtmlPage searchPage = (HtmlPage)webClient.getPage(flighturl);

HtmlPage searchResultPage = null;

HtmlForm searchForm = null;

            

if(searchPage != null)

{

                List <HtmlForm> listOfForms = searchPage.getForms();

                

                if(listOfForms != null)

                {    

                    Iterator <HtmlForm> itForms = listOfForms.iterator();

                    HtmlForm form1 = null;

 

                    while(itForms.hasNext())

                    {

                        form1 = itForms.next();

                        

                        if(form1.getInputByName("MDCity_1") != null)

                        {

                            searchForm = form1;

                            break;

                        }

                    }

                }

 

                if(searchForm != null)

                {                                     

 
(searchForm.getInputByName("TripType")).setValueAttribute("MD");

 
(searchForm.getInputByName("MDCity_1")).setValueAttribute("Los Angeles, CA -
Los Angeles Intl Airport (LAX)");

 
(searchForm.getInputByName("MDCity_2")).setValueAttribute("New York City, NY
- All Airports (NYC)");

 
(searchForm.getInputByName("DepDateMD1")).setValueAttribute("11/12/2013");

 

                    HtmlButton searchButton =
searchForm.getElementById("air-submit-btn");                        

                    searchResultPage = searchButton.click();

                    Thread t = Thread.currentThread();

                    t.sleep(120 * 1000);

 

                    searchResultPage =
(HtmlPage)webClient.getCurrentWindow().getEnclosedPage();

                    System.out.println("Page Content: " +
searchResultPage.asXml());

                }

 

It takes me to the same page. Please tell me what I am doing wrong. I am not
making headway.

 

Regards

 

Nitin


Disclaimer :- This e-mail and any attachment may contain confidential, proprietary or legally privileged information. If you are not the original intended recipient and have erroneously received this message, you are prohibited from using, copying, altering or disclosing the content of this message. Please delete it immediately and notify the sender. Newgen Software Technologies Ltd (NSTL)  accepts no responsibilities for loss or damage arising from the use of the information transmitted by this email including damages from virus and further acknowledges that no binding nature of the message shall be implied or assumed unless the sender does so expressly with due authority of NSTL.

Re: [Htmlunit-user] Excessive .tmp files - issue revisited...

[Ahmed A. <asa...@ya...>]

Hi all,

- Not deleting all files in closeAllWindows() is a bug, and no workaround should be considered.
- Let's always keep the discussion around latest version (or preferably SVN version).
- I retested, and finally was able to simulate the issue, David is right: the issue happens in loading .js files, but not to .html (which made the confusion last time).
- To be fixed soon.

Yours,
Ahmed

________________________________
 From: J <iha...@ya...>
To: David Taylor <da...@de...> 
Cc: "htm...@li..." <htm...@li...> 
Sent: Thursday, November 21, 2013 12:58 AM
Subject: Re: [Htmlunit-user] Excessive .tmp files - issue revisited...
 


Right -- hence one of the htmlunit users wrote a work around.

  I tried to get around this in 2011 and ended up just using the work around.  If someone were to propose a code change I'm sure the dev team would look at it -- sadly this is way above my experience level (which is why I went for the work around in the blog)





On Wednesday, November 20, 2013 2:53 PM, David Taylor <da...@de...> wrote:
 
J,


If that is the case then I really have a problem. My app that uses HTMLUnit is intended to stay running for weeks.

If these files are not deleted until the JVM exits then this seems like incorrect behavior.


David
--
David Taylor, Detayls



On Wed, Nov 20, 2013 at 1:44 PM, J <iha...@ya...> wrote:

According to the blog, it was stated that the files get deleted on calldeleteOnExit, and NOT on closeAllWindows as you have indicated.   In other words, the files will NOT be deleted until the JVM exists.  Sounds like a feature request not  a bug. 
>
>
>
>
>
>
>On Wednesday, November 20, 2013 11:32 AM, David Taylor <da...@de...> wrote:
> 
>Thanks, J but I really need someone to find the issue.
>
>
>The tmp files I am seeing are all over 500kb and full of JavaScript so the library is not seeing them as a "window" and thus they are not set properly as files that need to be deleted when closeAllWindows is called.
>
>
>
>David
>--
>David Taylor, Detayls
>
>
>
>On Wed, Nov 20, 2013 at 8:33 AM, J <iha...@ya...> wrote:
>
>http://www.julespotvin.com/?p=17
>>
>>^^ It's on oldy but the solution works for me. 
>>
>>
>>
>>-J
>>
>>
>>
>>
>>On Monday, November 18, 2013 12:27 PM, David Taylor <da...@de...> wrote:
>> 
>>I recently asked the list if there was a solution for the temp file problem that I have been encountering.
>>
>>Ahmed was helpful in talking me through it but ultimately no solution was found.
>>
>>To recap, my application uses HTMLUnit and correctly calls closeAllWindows but html*.tmp files keep stacking up in my temp directory.
>>
>>After a while the temp files fill the disk.
>>
>>I have a suspicion that the temp files are created by a JavaScript load and so do not get added the Window list.
>>
>>Does any new information exist on this issue?
>>
>>Thanks,
>>
>>David
>>
>>--
>>David Taylor, Detayls
>>
>>------------------------------------------------------------------------------
>>Shape the Mobile Experience: Free Subscription
>>Software experts and developers: Be at the forefront of tech innovation.
>>Intel(R) Software Adrenaline delivers strategic insight and game-changing 
>>conversations that shape the rapidly evolving mobile landscape. Sign up now. 
>>http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
>>_______________________________________________
>>Htmlunit-user mailing list
>>Htm...@li...
>>https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>>
>>
>>
>>------------------------------------------------------------------------------
>>Shape the Mobile Experience: Free Subscription
>>Software experts and developers: Be at the forefront of tech innovation.
>>Intel(R) Software Adrenaline delivers strategic insight and game-changing
>>conversations that shape the rapidly evolving mobile landscape. Sign up now.
>>http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
>>_______________________________________________
>>Htmlunit-user mailing list
>>Htm...@li...
>>https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>>
>>
>
>
>




------------------------------------------------------------------------------
Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing 
conversations that shape the rapidly evolving mobile landscape. Sign up now. 
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk

_______________________________________________
Htmlunit-user mailing list
Htm...@li...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user