Menu
▾
▴
htmlunit-user — Discussion of the use of HtmlUnit
You can subscribe to this list here.
| 2003 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
(6) |
Jul
(17) |
Aug
(18) |
Sep
(22) |
Oct
(16) |
Nov
(6) |
Dec
(11) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2004 |
Jan
(11) |
Feb
(10) |
Mar
(34) |
Apr
(26) |
May
(6) |
Jun
(22) |
Jul
(14) |
Aug
(4) |
Sep
(47) |
Oct
(69) |
Nov
(23) |
Dec
(21) |
| 2005 |
Jan
(53) |
Feb
(33) |
Mar
(92) |
Apr
(65) |
May
(63) |
Jun
(57) |
Jul
(43) |
Aug
(132) |
Sep
(61) |
Oct
(75) |
Nov
(60) |
Dec
(130) |
| 2006 |
Jan
(74) |
Feb
(87) |
Mar
(101) |
Apr
(58) |
May
(54) |
Jun
(42) |
Jul
(31) |
Aug
(67) |
Sep
(61) |
Oct
(71) |
Nov
(28) |
Dec
(58) |
| 2007 |
Jan
(53) |
Feb
(50) |
Mar
(96) |
Apr
(66) |
May
(55) |
Jun
(130) |
Jul
(99) |
Aug
(115) |
Sep
(37) |
Oct
(78) |
Nov
(24) |
Dec
(70) |
| 2008 |
Jan
(94) |
Feb
(85) |
Mar
(197) |
Apr
(274) |
May
(119) |
Jun
(143) |
Jul
(193) |
Aug
(99) |
Sep
(160) |
Oct
(120) |
Nov
(178) |
Dec
(109) |
| 2009 |
Jan
(238) |
Feb
(169) |
Mar
(115) |
Apr
(109) |
May
(131) |
Jun
(167) |
Jul
(144) |
Aug
(193) |
Sep
(155) |
Oct
(154) |
Nov
(97) |
Dec
(127) |
| 2010 |
Jan
(108) |
Feb
(127) |
Mar
(176) |
Apr
(113) |
May
(130) |
Jun
(200) |
Jul
(115) |
Aug
(80) |
Sep
(92) |
Oct
(101) |
Nov
(124) |
Dec
(53) |
| 2011 |
Jan
(67) |
Feb
(144) |
Mar
(88) |
Apr
(60) |
May
(89) |
Jun
(54) |
Jul
(68) |
Aug
(81) |
Sep
(48) |
Oct
(40) |
Nov
(10) |
Dec
(20) |
| 2012 |
Jan
(21) |
Feb
(28) |
Mar
(17) |
Apr
(35) |
May
(41) |
Jun
(44) |
Jul
(68) |
Aug
(67) |
Sep
(89) |
Oct
(58) |
Nov
(47) |
Dec
(56) |
| 2013 |
Jan
(49) |
Feb
(28) |
Mar
(46) |
Apr
(31) |
May
(28) |
Jun
(37) |
Jul
(34) |
Aug
(52) |
Sep
(42) |
Oct
(108) |
Nov
(59) |
Dec
(56) |
| 2014 |
Jan
(41) |
Feb
(72) |
Mar
(46) |
Apr
(21) |
May
(19) |
Jun
(17) |
Jul
(15) |
Aug
(40) |
Sep
(11) |
Oct
(3) |
Nov
(5) |
Dec
(31) |
| 2015 |
Jan
(11) |
Feb
(12) |
Mar
(19) |
Apr
(19) |
May
(38) |
Jun
(54) |
Jul
(14) |
Aug
(42) |
Sep
(14) |
Oct
(16) |
Nov
(26) |
Dec
(14) |
| 2016 |
Jan
(3) |
Feb
(1) |
Mar
(24) |
Apr
(5) |
May
(15) |
Jun
(14) |
Jul
(33) |
Aug
(19) |
Sep
(8) |
Oct
(10) |
Nov
|
Dec
(2) |
| 2017 |
Jan
(16) |
Feb
(12) |
Mar
(23) |
Apr
(8) |
May
(11) |
Jun
(20) |
Jul
(21) |
Aug
(20) |
Sep
|
Oct
(6) |
Nov
(9) |
Dec
(2) |
| 2018 |
Jan
(7) |
Feb
(5) |
Mar
(6) |
Apr
(5) |
May
(1) |
Jun
(2) |
Jul
(2) |
Aug
|
Sep
(4) |
Oct
(3) |
Nov
|
Dec
(4) |
| 2019 |
Jan
(2) |
Feb
(2) |
Mar
(3) |
Apr
(4) |
May
|
Jun
(4) |
Jul
(9) |
Aug
(2) |
Sep
|
Oct
(4) |
Nov
(1) |
Dec
(7) |
| 2020 |
Jan
(2) |
Feb
(6) |
Mar
(9) |
Apr
(1) |
May
(1) |
Jun
(15) |
Jul
(1) |
Aug
(1) |
Sep
(2) |
Oct
(6) |
Nov
(3) |
Dec
(5) |
| 2021 |
Jan
(3) |
Feb
(1) |
Mar
(2) |
Apr
(1) |
May
|
Jun
(1) |
Jul
(1) |
Aug
(3) |
Sep
(1) |
Oct
|
Nov
(1) |
Dec
|
| 2022 |
Jan
|
Feb
|
Mar
|
Apr
|
May
(2) |
Jun
(1) |
Jul
(4) |
Aug
|
Sep
|
Oct
|
Nov
(1) |
Dec
(6) |
| 2025 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
(1) |
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
|
From: 歌 <814...@qq...> - 2014-02-26 08:39:10
|
This worked for me.
To remove all output from the latest version of HtmlUnit you just have to add these lines in a static block or in your main class:
java.util.logging.Logger.getLogger("com.gargoylesoftware").setLevel(Level.OFF); System.setProperty("org.apache.commons.logging.Log", "org.apache.commons.logging.impl.NoOpLog");If this cannot work,you can see this page:http://stackoverflow.com/questions/3600557/turning-htmlunit-warnings-offHope you can solve this problem.
------------------ Original ------------------
From: "Arya Farzan";<ary...@gm...>;
Date: Wed, Feb 26, 2014 04:29 PM
To: "htmlunit-user"<htm...@li...>;
Subject: [Htmlunit-user] turning off rhino usage warning
I sometimes get rhino usage warnings when running tests. Is there any way to disable these warning messages from being displayed? |
|
From: Arya F. <ary...@gm...> - 2014-02-26 08:29:07
|
I sometimes get rhino usage warnings when running tests. Is there any way to disable these warning messages from being displayed? |
|
From: Jim X. <jx...@cl...> - 2014-02-19 20:32:53
|
One html page has
<style>
.lastName {
color: blue;
border: 1px solid gray;
padding 2px 3px 4px 5px;
}
</style>
<body>
<form>
<span class="lastName">Last Name</span>
...
</form>
</body>
I just want to call one method to get all css class contents defined on the page for ".lastName". I don't want to call "getColor()", "getBorder()", "getPadding()".
Thanks,
Jim
|
|
From: asashour <asa...@ya...> - 2014-02-19 07:33:53
|
Hi, - You must subscribe to the list before posting - Please provide public URL to test against. Ahmed laughing wrote > my code work well in htmlunit2.13 ,after I upgrade to 2.14 it's not > working thows exceptions as belows, : > WebClientOptions clientOpts = client.getOptions(); > * > clientOpts.setUseInsecureSSL(true); //it's seems like here is not working > and SSL has problems in htmlunit2.14 * > htmlunit-2.14-OSGi.jar * > in my lib > or > * > <dependency> > > <groupId> > net.sourceforge.htmlunit > </groupId> > > <artifactId> > htmlunit > </artifactId> > > <version> > 2.14 > </version> > > </dependency> > * > in MAVEN(pom.xml) are not working > -- View this message in context: http://htmlunit.10904.n7.nabble.com/In-htmlunit2-14-clientOpts-setUseInsecureSSL-true-is-not-working-tp33220p33221.html Sent from the HtmlUnit - General mailing list archive at Nabble.com. |
|
From: Ahmed A. <asa...@ya...> - 2014-02-18 09:01:13
|
Hi Ralf, >> Is this archive thought for any specific Java IDE? Please read http://htmlunit.sourceforge.net/gettingLatestCode.html#Dependencies_for_IDE HtmlUnit scope is to simulate real browsers, and it isn't site-specific API. Ahmed ________________________________ From: Ralf GESELLENSETTER <rg...@gm...> To: htm...@li... Sent: Tuesday, February 18, 2014 11:48 AM Subject: Re: [Htmlunit-user] First obstacles, javascript exception for MRBS. Dear Ahmed, thank you for your work, it's interesting how you can get objects by ID. Is this archive thought for any specific Java IDE? Nevertheless I must admit, that I found some import API for mrbs that enables me to upload ics files. Just as a link for would-be-readers: have a look at mrbs-general mailing list (current threads). Bye Ralf Am 16.02.2014 20:55, schrieb Ahmed Ashour: > Hi, > > Please find attached. > > Ahmed |
|
From: Ralf G. <rg...@gm...> - 2014-02-18 08:48:38
|
Dear Ahmed, thank you for your work, it's interesting how you can get objects by ID. Is this archive thought for any specific Java IDE? Nevertheless I must admit, that I found some import API for mrbs that enables me to upload ics files. Just as a link for would-be-readers: have a look at mrbs-general mailing list (current threads). Bye Ralf Am 16.02.2014 20:55, schrieb Ahmed Ashour: > Hi, > > Please find attached. > > Ahmed -- PGP/GnuPG: pub 1024D/E6DE0971 |
|
From: Ahmed A. <asa...@ya...> - 2014-02-17 12:01:40
|
Hi all, It is a pleasure to announce the immediate availability of HtmlUnit 2.14. The main enhancements: - FF24 is fully supported - IE11 is the main focus in IE family - HttpClient 4.3.2 new API is fully used - Many bug fixes. Change log can be found in http://htmlunit.sourceforge.net/changes-report.html#a2.14 Thanks to all the contributors. As always: Happy Testing! The HtmlUnit team |
|
From: Ronald B. <rb...@rb...> - 2014-02-16 18:55:27
|
>I am just curious what the problem was and how you solved it. Hi David, have a look at SVN commit 9127 and 9128. Additionally i did a post on the developer list that contains some details (https://sourceforge.net/p/htmlunit/mailman/message/31980561/) RBRi |
|
From: David M. G. <mic...@gm...> - 2014-02-16 14:42:46
|
Hi, I checked the memory heap after running a massive load of urls and did not find any memory leak with eclipse mat. Well Done :-) I am just curious what the problem was and how you solved it. Thanks, David On Thu, Feb 13, 2014 at 10:55 AM, David Michael Gang <mic...@gm...>wrote: > Hi, > > Would it be possible to upload this snapshot to maven? > I have a jenkins job which generates the project i run through maven and > it is hard for me to change these dependencies to look on a static jar. > > Thanks, > David > > > > >> >> ------------------------------ >> >> Message: 5 >> Date: Wed, 12 Feb 2014 18:12:00 +0100 (CET) >> From: "Ronald Brill" <rb...@rb...> >> Subject: Re: [Htmlunit-user] problems with java memory when scraping >> data from different hosts. >> To: "htm...@li..." >> <htm...@li...> >> Message-ID: <100...@rb...> >> Content-Type: text/plain; charset="iso-8859-15" >> >> HI David, >> >> i guess you are facing a memory issue of the current implementation. >> I did a first shot trying to solve one part of the problem in SVN commit >> 9127. >> Please give this version an try and report back. >> >> RBRi >> >> On Wed, 12 Feb 2014 09:28:46 +0200 David Michael Gang wrote: >> > >> >Hi all, >> > >> >I have a script which goes over ~1000 links and fetches the data from >> them. >> >I have javascript switched on. >> >The heap size grows up to about 1.5 GB. >> >I performed jmap to get a .hprof file. >> >Afterwards i analyzed the results with eclipsemat and got the following >> >suspects >> > >> >836,303 instances of >> >> >*"com.gargoylesoftware.htmlunit.javascript.host.NodeList$DomHtmlAttributeChangeListenerImpl"*, >> >loaded by *"sun.misc.Launcher$AppClassLoader @ 0x2b21564bd190"* occupy >> >*360,618,336 >> >(35.36%)* bytes. These instances are referenced from one instance of >> >*"java.lang.Object[]"*, loaded by *"<system class loader>"* >> > >> > >> > 44 instances of *"com.gargoylesoftware.htmlunit.html.HtmlPage"*, >> >loaded by *"sun.misc.Launcher$AppClassLoader >> >@ 0x2b21564bd190"* occupy *187,091,104 (18.34%)* bytes. >> > >> >Biggest instances: >> > >> > - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> > 0x2b216fad9408 - 70,380,232 (6.90%) bytes. >> > - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> > 0x2b2162f66988 - 20,142,528 (1.98%) bytes. >> > - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> > 0x2b216a296c60 - 12,966,560 (1.27%) bytes. >> > - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> > 0x2b216a26c390 - 12,966,032 (1.27%) bytes. >> > - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> > 0x2b2168791e60 - 10,687,768 (1.05%) bytes. >> > - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> > 0x2b215b8b5460 - 10,651,168 (1.04%) bytes. >> > - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> > 0x2b215a8090d8 - 10,523,280 (1.03%) bytes. >> > >> > >> > >> >*Keywords* >> >sun.misc.Launcher$AppClassLoader @ 0x2b21564bd190 >> >com.gargoylesoftware.htmlunit.html.HtmlPage >> > >> >What is the meaning of these suspects? >> >How can i reduce the usage of the memory? >> > >> >Thanks, >> >David >> > >> >> >> >> >> ------------------------------ >> >> >> ------------------------------------------------------------------------------ >> Android apps run on BlackBerry 10 >> Introducing the new BlackBerry 10.2.1 Runtime for Android apps. >> Now with support for Jelly Bean, Bluetooth, Mapview and more. >> Get your Android app in front of a whole new audience. Start now. >> >> http://pubads.g.doubleclick.net/gampad/clk?id=124407151&iu=/4140/ostg.clktrk >> >> ------------------------------ >> >> _______________________________________________ >> Htmlunit-user mailing list >> Htm...@li... >> https://lists.sourceforge.net/lists/listinfo/htmlunit-user >> >> >> End of Htmlunit-user Digest, Vol 93, Issue 21 >> ********************************************* >> > > |
|
From: François D. <fdu...@ez...> - 2014-02-14 15:30:59
|
Hi, I want to check some webpages for a specific request to be thrown. I can’t change the source code of this pages because those are not mines but my partners ones. On some of them, there’s errors that interrupt the script. Even with WebClient webClient = new WebClient(BrowserVersion.CHROME); webClient.getOptions().setThrowExceptionOnFailingStatusCode(false); webClient.getOptions().setThrowExceptionOnScriptError(false); webClient.getOptions().setPrintContentOnFailingStatusCode(false); I have stack traces in logs and com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine handleJavaScriptException What can I do ? Thanks |
|
From: David M. G. <mic...@gm...> - 2014-02-14 10:34:10
|
Hi In the meantime I saw a big improvement. I didn't respond yet because these problems pop up under different circumstances and I didn't have time to check all use cases I have in mind. I checked the use case I had and indeed saw that the heap size is not growing as before. I could make more checks and could give a better answer by Sunday night. I would till then run the program with different sites and analyze the heap with Eclipse mat. Thanks, David |
|
From: asashour <asa...@ya...> - 2014-02-14 10:08:50
|
Hi David, Any feedback? The releasing is pending for this ;) Ahmed Ronald Brill wrote > HI David, > > i guess you are facing a memory issue of the current implementation. > I did a first shot trying to solve one part of the problem in SVN commit > 9127. > Please give this version an try and report back. > > RBRi > > On Wed, 12 Feb 2014 09:28:46 +0200 David Michael Gang wrote: >> >>Hi all, >> >>I have a script which goes over ~1000 links and fetches the data from them. >>I have javascript switched on. >>The heap size grows up to about 1.5 GB. >>I performed jmap to get a .hprof file. >>Afterwards i analyzed the results with eclipsemat and got the following >>suspects >> >>836,303 instances of >>*"com.gargoylesoftware.htmlunit.javascript.host.NodeList$DomHtmlAttributeChangeListenerImpl"*, >>loaded by *"sun.misc.Launcher$AppClassLoader @ 0x2b21564bd190"* occupy >>*360,618,336 >>(35.36%)* bytes. These instances are referenced from one instance of >>*"java.lang.Object[]"*, loaded by *" > <system class loader> > "* >> >> >> 44 instances of *"com.gargoylesoftware.htmlunit.html.HtmlPage"*, >>loaded by *"sun.misc.Launcher$AppClassLoader >>@ 0x2b21564bd190"* occupy *187,091,104 (18.34%)* bytes. >> >>Biggest instances: >> >> - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> 0x2b216fad9408 - 70,380,232 (6.90%) bytes. >> - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> 0x2b2162f66988 - 20,142,528 (1.98%) bytes. >> - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> 0x2b216a296c60 - 12,966,560 (1.27%) bytes. >> - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> 0x2b216a26c390 - 12,966,032 (1.27%) bytes. >> - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> 0x2b2168791e60 - 10,687,768 (1.05%) bytes. >> - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> 0x2b215b8b5460 - 10,651,168 (1.04%) bytes. >> - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> 0x2b215a8090d8 - 10,523,280 (1.03%) bytes. >> >> >> >>*Keywords* >>sun.misc.Launcher$AppClassLoader @ 0x2b21564bd190 >>com.gargoylesoftware.htmlunit.html.HtmlPage >> >>What is the meaning of these suspects? >>How can i reduce the usage of the memory? >> >>Thanks, >>David -- View this message in context: http://htmlunit.10904.n7.nabble.com/problems-with-java-memory-when-scraping-data-from-different-hosts-tp33164p33188.html Sent from the HtmlUnit - General mailing list archive at Nabble.com. |
|
From: Ahmed A. <asa...@ya...> - 2014-02-13 09:16:23
|
Hi David, Done. Ahmed ________________________________ From: David Michael Gang <mic...@gm...> To: htm...@li... Sent: Thursday, February 13, 2014 11:55 AM Subject: Re: [Htmlunit-user] problems with java memory when scraping data from different hosts Hi, Would it be possible to upload this snapshot to maven? I have a jenkins job which generates the project i run through maven and it is hard for me to change these dependencies to look on a static jar. Thanks, David > >------------------------------ > >Message: 5 >Date: Wed, 12 Feb 2014 18:12:00 +0100 (CET) >From: "Ronald Brill" <rb...@rb...> >Subject: Re: [Htmlunit-user] problems with java memory when scraping > data from different hosts. >To: "htm...@li..." > <htm...@li...> >Message-ID: <100...@rb...> >Content-Type: text/plain; charset="iso-8859-15" > >HI David, > >i guess you are facing a memory issue of the current implementation. >I did a first shot trying to solve one part of the problem in SVN commit 9127. >Please give this version an try and report back. > > RBRi > >On Wed, 12 Feb 2014 09:28:46 +0200 David Michael Gang wrote: >> >>Hi all, >> >>I have a script which goes over ~1000 links and fetches the data from them. >>I have javascript switched on. >>The heap size grows up to about 1.5 GB. >>I performed jmap to get a .hprof file. >>Afterwards i analyzed the results with eclipsemat and got the following >>suspects >> >>836,303 instances of >>*"com.gargoylesoftware.htmlunit.javascript.host.NodeList$DomHtmlAttributeChangeListenerImpl"*, >>loaded by *"sun.misc.Launcher$AppClassLoader @ 0x2b21564bd190"* occupy >>*360,618,336 >>(35.36%)* bytes. These instances are referenced from one instance of >>*"java.lang.Object[]"*, loaded by *"<system class loader>"* >> >> >> 44 instances of *"com.gargoylesoftware.htmlunit.html.HtmlPage"*, >>loaded by *"sun.misc.Launcher$AppClassLoader >>@ 0x2b21564bd190"* occupy *187,091,104 (18.34%)* bytes. >> >>Biggest instances: >> >> - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> 0x2b216fad9408 - 70,380,232 (6.90%) bytes. >> - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> 0x2b2162f66988 - 20,142,528 (1.98%) bytes. >> - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> 0x2b216a296c60 - 12,966,560 (1.27%) bytes. >> - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> 0x2b216a26c390 - 12,966,032 (1.27%) bytes. >> - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> 0x2b2168791e60 - 10,687,768 (1.05%) bytes. >> - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> 0x2b215b8b5460 - 10,651,168 (1.04%) bytes. >> - com.gargoylesoftware.htmlunit.html.HtmlPage @ >> 0x2b215a8090d8 - 10,523,280 (1.03%) bytes. >> >> >> >>*Keywords* >>sun.misc.Launcher$AppClassLoader @ 0x2b21564bd190 >>com.gargoylesoftware.htmlunit.html.HtmlPage >> >>What is the meaning of these suspects? >>How can i reduce the usage of the memory? >> >>Thanks, >>David >> > > > > >------------------------------ > >------------------------------------------------------------------------------ >Android apps run on BlackBerry 10 >Introducing the new BlackBerry 10.2.1 Runtime for Android apps. >Now with support for Jelly Bean, Bluetooth, Mapview and more. >Get your Android app in front of a whole new audience. Start now. >http://pubads.g.doubleclick.net/gampad/clk?id=124407151&iu=/4140/ostg.clktrk > >------------------------------ > >_______________________________________________ >Htmlunit-user mailing list >Htm...@li... >https://lists.sourceforge.net/lists/listinfo/htmlunit-user > > >End of Htmlunit-user Digest, Vol 93, Issue 21 >********************************************* > ------------------------------------------------------------------------------ Android apps run on BlackBerry 10 Introducing the new BlackBerry 10.2.1 Runtime for Android apps. Now with support for Jelly Bean, Bluetooth, Mapview and more. Get your Android app in front of a whole new audience. Start now. http://pubads.g.doubleclick.net/gampad/clk?id=124407151&iu=/4140/ostg.clktrk _______________________________________________ Htmlunit-user mailing list Htm...@li... https://lists.sourceforge.net/lists/listinfo/htmlunit-user |
|
From: David M. G. <mic...@gm...> - 2014-02-13 08:55:54
|
Hi, Would it be possible to upload this snapshot to maven? I have a jenkins job which generates the project i run through maven and it is hard for me to change these dependencies to look on a static jar. Thanks, David > > ------------------------------ > > Message: 5 > Date: Wed, 12 Feb 2014 18:12:00 +0100 (CET) > From: "Ronald Brill" <rb...@rb...> > Subject: Re: [Htmlunit-user] problems with java memory when scraping > data from different hosts. > To: "htm...@li..." > <htm...@li...> > Message-ID: <100...@rb...> > Content-Type: text/plain; charset="iso-8859-15" > > HI David, > > i guess you are facing a memory issue of the current implementation. > I did a first shot trying to solve one part of the problem in SVN commit > 9127. > Please give this version an try and report back. > > RBRi > > On Wed, 12 Feb 2014 09:28:46 +0200 David Michael Gang wrote: > > > >Hi all, > > > >I have a script which goes over ~1000 links and fetches the data from > them. > >I have javascript switched on. > >The heap size grows up to about 1.5 GB. > >I performed jmap to get a .hprof file. > >Afterwards i analyzed the results with eclipsemat and got the following > >suspects > > > >836,303 instances of > > >*"com.gargoylesoftware.htmlunit.javascript.host.NodeList$DomHtmlAttributeChangeListenerImpl"*, > >loaded by *"sun.misc.Launcher$AppClassLoader @ 0x2b21564bd190"* occupy > >*360,618,336 > >(35.36%)* bytes. These instances are referenced from one instance of > >*"java.lang.Object[]"*, loaded by *"<system class loader>"* > > > > > > 44 instances of *"com.gargoylesoftware.htmlunit.html.HtmlPage"*, > >loaded by *"sun.misc.Launcher$AppClassLoader > >@ 0x2b21564bd190"* occupy *187,091,104 (18.34%)* bytes. > > > >Biggest instances: > > > > - com.gargoylesoftware.htmlunit.html.HtmlPage @ > > 0x2b216fad9408 - 70,380,232 (6.90%) bytes. > > - com.gargoylesoftware.htmlunit.html.HtmlPage @ > > 0x2b2162f66988 - 20,142,528 (1.98%) bytes. > > - com.gargoylesoftware.htmlunit.html.HtmlPage @ > > 0x2b216a296c60 - 12,966,560 (1.27%) bytes. > > - com.gargoylesoftware.htmlunit.html.HtmlPage @ > > 0x2b216a26c390 - 12,966,032 (1.27%) bytes. > > - com.gargoylesoftware.htmlunit.html.HtmlPage @ > > 0x2b2168791e60 - 10,687,768 (1.05%) bytes. > > - com.gargoylesoftware.htmlunit.html.HtmlPage @ > > 0x2b215b8b5460 - 10,651,168 (1.04%) bytes. > > - com.gargoylesoftware.htmlunit.html.HtmlPage @ > > 0x2b215a8090d8 - 10,523,280 (1.03%) bytes. > > > > > > > >*Keywords* > >sun.misc.Launcher$AppClassLoader @ 0x2b21564bd190 > >com.gargoylesoftware.htmlunit.html.HtmlPage > > > >What is the meaning of these suspects? > >How can i reduce the usage of the memory? > > > >Thanks, > >David > > > > > > > ------------------------------ > > > ------------------------------------------------------------------------------ > Android apps run on BlackBerry 10 > Introducing the new BlackBerry 10.2.1 Runtime for Android apps. > Now with support for Jelly Bean, Bluetooth, Mapview and more. > Get your Android app in front of a whole new audience. Start now. > > http://pubads.g.doubleclick.net/gampad/clk?id=124407151&iu=/4140/ostg.clktrk > > ------------------------------ > > _______________________________________________ > Htmlunit-user mailing list > Htm...@li... > https://lists.sourceforge.net/lists/listinfo/htmlunit-user > > > End of Htmlunit-user Digest, Vol 93, Issue 21 > ********************************************* > |
|
From: Ronald B. <rb...@rb...> - 2014-02-12 17:12:18
|
HI David, i guess you are facing a memory issue of the current implementation. I did a first shot trying to solve one part of the problem in SVN commit 9127. Please give this version an try and report back. RBRi On Wed, 12 Feb 2014 09:28:46 +0200 David Michael Gang wrote: > >Hi all, > >I have a script which goes over ~1000 links and fetches the data from them. >I have javascript switched on. >The heap size grows up to about 1.5 GB. >I performed jmap to get a .hprof file. >Afterwards i analyzed the results with eclipsemat and got the following >suspects > >836,303 instances of >*"com.gargoylesoftware.htmlunit.javascript.host.NodeList$DomHtmlAttributeChangeListenerImpl"*, >loaded by *"sun.misc.Launcher$AppClassLoader @ 0x2b21564bd190"* occupy >*360,618,336 >(35.36%)* bytes. These instances are referenced from one instance of >*"java.lang.Object[]"*, loaded by *"<system class loader>"* > > > 44 instances of *"com.gargoylesoftware.htmlunit.html.HtmlPage"*, >loaded by *"sun.misc.Launcher$AppClassLoader >@ 0x2b21564bd190"* occupy *187,091,104 (18.34%)* bytes. > >Biggest instances: > > - com.gargoylesoftware.htmlunit.html.HtmlPage @ > 0x2b216fad9408 - 70,380,232 (6.90%) bytes. > - com.gargoylesoftware.htmlunit.html.HtmlPage @ > 0x2b2162f66988 - 20,142,528 (1.98%) bytes. > - com.gargoylesoftware.htmlunit.html.HtmlPage @ > 0x2b216a296c60 - 12,966,560 (1.27%) bytes. > - com.gargoylesoftware.htmlunit.html.HtmlPage @ > 0x2b216a26c390 - 12,966,032 (1.27%) bytes. > - com.gargoylesoftware.htmlunit.html.HtmlPage @ > 0x2b2168791e60 - 10,687,768 (1.05%) bytes. > - com.gargoylesoftware.htmlunit.html.HtmlPage @ > 0x2b215b8b5460 - 10,651,168 (1.04%) bytes. > - com.gargoylesoftware.htmlunit.html.HtmlPage @ > 0x2b215a8090d8 - 10,523,280 (1.03%) bytes. > > > >*Keywords* >sun.misc.Launcher$AppClassLoader @ 0x2b21564bd190 >com.gargoylesoftware.htmlunit.html.HtmlPage > >What is the meaning of these suspects? >How can i reduce the usage of the memory? > >Thanks, >David > |
|
From: ChrisMBX <chr...@gm...> - 2014-02-12 15:04:27
|
- I've just tried with the latest build and I have the same error. - Unfortunately this is not a public proxy, and I have no info about it (only hostname and port). -- View this message in context: http://htmlunit.10904.n7.nabble.com/Proxy-problem-OK-with-URLConnection-KO-with-WebClient-tp33167p33169.html Sent from the HtmlUnit - General mailing list archive at Nabble.com. |
|
From: Ahmed A. <asa...@ya...> - 2014-02-12 13:50:33
|
Hi, - Please make sure you are using SVN version (http://build.canoo.com/htmlunit/) - What is the proxy server, so we can download and test against? Any public hostname? Ahmed ________________________________ From: ChrisMBX <chr...@gm...> To: htm...@li... Sent: Wednesday, February 12, 2014 4:45 PM Subject: [Htmlunit-user] Proxy problem : OK with URLConnection, KO with WebClient Hi all, I cannot access http pages through a proxy with WebClient. When I use an URLConnection there is no problem : Proxy proxy = new Proxy(Proxy.Type.HTTP, new InetSocketAddress("hostname", 8080)); URLConnection urlConnection = new URL("https://www.google.com/").openConnection(proxy); BufferedReader bufferedReader = null; try { bufferedReader = new BufferedReader(new InputStreamReader(urlConnection.getInputStream())); String line; while ((line = bufferedReader.readLine()) != null) { System.out.println(line); } } finally { if (bufferedReader != null) { bufferedReader.close(); } } But when I try with WebClient, I have an error : WebClient webClient = new WebClient(BrowserVersion.CHROME, "hostname", 8080); webClient.getOptions().setThrowExceptionOnFailingStatusCode(false); webClient.getOptions().setThrowExceptionOnScriptError(false); HtmlPage htmlPage = webClient.getPage("https://www.google.com/"); System.out.println(htmlPage.asText()); The error is "407 Proxy Authentication Required. The ISA Server requires authorization to fulfill the request. Access to the Web Proxy filter is denied." I don't understand why with URLConnection there is no authentification problem. Thank you for your help ! -- View this message in context: http://htmlunit.10904.n7.nabble.com/Proxy-problem-OK-with-URLConnection-KO-with-WebClient-tp33167.html Sent from the HtmlUnit - General mailing list archive at Nabble.com. ------------------------------------------------------------------------------ Android apps run on BlackBerry 10 Introducing the new BlackBerry 10.2.1 Runtime for Android apps. Now with support for Jelly Bean, Bluetooth, Mapview and more. Get your Android app in front of a whole new audience. Start now. http://pubads.g.doubleclick.net/gampad/clk?id=124407151&iu=/4140/ostg.clktrk _______________________________________________ Htmlunit-user mailing list Htm...@li... https://lists.sourceforge.net/lists/listinfo/htmlunit-user |
|
From: ChrisMBX <chr...@gm...> - 2014-02-12 13:45:31
|
Hi all,
I cannot access http pages through a proxy with WebClient.
When I use an URLConnection there is no problem :
Proxy proxy = new Proxy(Proxy.Type.HTTP, new InetSocketAddress("hostname",
8080));
URLConnection urlConnection = new
URL("https://www.google.com/").openConnection(proxy);
BufferedReader bufferedReader = null;
try {
bufferedReader = new BufferedReader(new
InputStreamReader(urlConnection.getInputStream()));
String line;
while ((line = bufferedReader.readLine()) != null) {
System.out.println(line);
}
} finally {
if (bufferedReader != null) {
bufferedReader.close();
}
}
But when I try with WebClient, I have an error :
WebClient webClient = new WebClient(BrowserVersion.CHROME, "hostname",
8080);
webClient.getOptions().setThrowExceptionOnFailingStatusCode(false);
webClient.getOptions().setThrowExceptionOnScriptError(false);
HtmlPage htmlPage = webClient.getPage("https://www.google.com/");
System.out.println(htmlPage.asText());
The error is "407 Proxy Authentication Required. The ISA Server requires
authorization to fulfill the request. Access to the Web Proxy filter is
denied."
I don't understand why with URLConnection there is no authentification
problem.
Thank you for your help !
--
View this message in context: http://htmlunit.10904.n7.nabble.com/Proxy-problem-OK-with-URLConnection-KO-with-WebClient-tp33167.html
Sent from the HtmlUnit - General mailing list archive at Nabble.com.
|
|
From: David M. G. <mic...@gm...> - 2014-02-12 07:28:54
|
Hi all, I have a script which goes over ~1000 links and fetches the data from them. I have javascript switched on. The heap size grows up to about 1.5 GB. I performed jmap to get a .hprof file. Afterwards i analyzed the results with eclipsemat and got the following suspects 836,303 instances of *"com.gargoylesoftware.htmlunit.javascript.host.NodeList$DomHtmlAttributeChangeListenerImpl"*, loaded by *"sun.misc.Launcher$AppClassLoader @ 0x2b21564bd190"* occupy *360,618,336 (35.36%)* bytes. These instances are referenced from one instance of *"java.lang.Object[]"*, loaded by *"<system class loader>"* 44 instances of *"com.gargoylesoftware.htmlunit.html.HtmlPage"*, loaded by *"sun.misc.Launcher$AppClassLoader @ 0x2b21564bd190"* occupy *187,091,104 (18.34%)* bytes. Biggest instances: - com.gargoylesoftware.htmlunit.html.HtmlPage @ 0x2b216fad9408 - 70,380,232 (6.90%) bytes. - com.gargoylesoftware.htmlunit.html.HtmlPage @ 0x2b2162f66988 - 20,142,528 (1.98%) bytes. - com.gargoylesoftware.htmlunit.html.HtmlPage @ 0x2b216a296c60 - 12,966,560 (1.27%) bytes. - com.gargoylesoftware.htmlunit.html.HtmlPage @ 0x2b216a26c390 - 12,966,032 (1.27%) bytes. - com.gargoylesoftware.htmlunit.html.HtmlPage @ 0x2b2168791e60 - 10,687,768 (1.05%) bytes. - com.gargoylesoftware.htmlunit.html.HtmlPage @ 0x2b215b8b5460 - 10,651,168 (1.04%) bytes. - com.gargoylesoftware.htmlunit.html.HtmlPage @ 0x2b215a8090d8 - 10,523,280 (1.03%) bytes. *Keywords* sun.misc.Launcher$AppClassLoader @ 0x2b21564bd190 com.gargoylesoftware.htmlunit.html.HtmlPage What is the meaning of these suspects? How can i reduce the usage of the memory? Thanks, David |
|
From: Ruff, T. <Tho...@so...> - 2014-02-10 18:29:38
|
I tested against the latest HtmlUnit snapshot (2/9/14) and still have the same problem. GWT is not updating the page via AJAX when the 'Calculate' DIV button is pushed. I'm working on getting a releasable version of the GWT project but in the mean-time I noticed this gets output to the debug console immediately after loading the initial GWT page. It looks like the page's CSS links are failing. Not sure why or if this even matters, but this appears several time in the console window:
INFO: statusCode=[404] contentType=[text/html]
Feb 10, 2014 10:09:37 AM com.gargoylesoftware.htmlunit.WebClient printContentIfNecessary
INFO: <html><head><title>JBoss Web/7.2.2.Final-redhat-1 - JBWEB000064: Error report</title><style><!--H1 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;} H2 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;} H3 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;} BODY {font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;} B {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;} P {font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;}A {color : black;}A.name {color : black;}HR {color : #525D76;}--></style> </head><body><h1>JBWEB000065: HTTP Status 404 - /metoccalc/undefined</h1><HR size="1" noshade="noshade"><p><b>JBWEB000309: type</b> JBWEB000067: Status report</p><p><b>JBWEB000068: message</b> <u>/metoccalc/undefined</u></p><p><b>JBWEB000069: description</b> <u>JBWEB000124: The requested resource is not available.</u></p><HR size="1" noshade="noshade"><h3>JBoss Web/7.2.2.Final-redhat-1</h3></body></html>
Feb 10, 2014 10:09:37 AM com.gargoylesoftware.htmlunit.javascript.host.css.CSSStyleSheet loadStylesheet
SEVERE: Exception loading http://nn26.nites.itf.spawar.navy.mil:8080/metoccalc/undefined
com.gargoylesoftware.htmlunit.FailingHttpStatusCodeException: 404 Not Found for http://nn26.nites.itf.spawar.navy.mil:8080/metoccalc/undefined
at com.gargoylesoftware.htmlunit.WebClient.throwFailingHttpStatusCodeExceptionIfNecessary(WebClient.java:496)
at com.gargoylesoftware.htmlunit.javascript.host.css.CSSStyleSheet.loadStylesheet(CSSStyleSheet.java:316)
at com.gargoylesoftware.htmlunit.javascript.host.html.HTMLLinkElement.getSheet(HTMLLinkElement.java:130)
at com.gargoylesoftware.htmlunit.javascript.host.css.StyleSheetList.item(StyleSheetList.java:151)
at com.gargoylesoftware.htmlunit.javascript.host.Window.getComputedStyle(Window.java:1601)
at com.gargoylesoftware.htmlunit.javascript.host.Element.getCurrentStyle(Element.java:545)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at net.sourceforge.htmlunit.corejs.javascript.MemberBox.invoke(MemberBox.java:120)
at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject$GetterSlot.getValue(ScriptableObject.java:320)
at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject$RelinkedSlot.getValue(ScriptableObject.java:373)
at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject.get(ScriptableObject.java:483)
at com.gargoylesoftware.htmlunit.javascript.SimpleScriptable.get(SimpleScriptable.java:85)
at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject.getProperty(ScriptableObject.java:2296)
at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.getObjectProp(ScriptRuntime.java:1472)
at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.getObjectProp(ScriptRuntime.java:1466)
at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpretLoop(Interpreter.java:1241)
at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpret(Interpreter.java:798)
at net.sourceforge.htmlunit.corejs.javascript.InterpretedFunction.call(InterpretedFunction.java:105)
at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.doTopCall(ContextFactory.java:405)
at com.gargoylesoftware.htmlunit.javascript.HtmlUnitContextFactory.doTopCall(HtmlUnitContextFactory.java:309)
at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3031)
at net.sourceforge.htmlunit.corejs.javascript.InterpretedFunction.exec(InterpretedFunction.java:115)
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$3.doRun(JavaScriptEngine.java:561)
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$HtmlUnitContextAction.run(JavaScriptEngine.java:669)
at net.sourceforge.htmlunit.corejs.javascript.Context.call(Context.java:602)
at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.call(ContextFactory.java:507)
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.execute(JavaScriptEngine.java:570)
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.execute(JavaScriptEngine.java:545)
at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptIfPossible(HtmlPage.java:959)
at com.gargoylesoftware.htmlunit.html.HtmlScript.executeInlineScriptIfNeeded(HtmlScript.java:347)
at com.gargoylesoftware.htmlunit.html.HtmlScript.executeScriptIfNeeded(HtmlScript.java:425)
at com.gargoylesoftware.htmlunit.html.HtmlScript$3.execute(HtmlScript.java:266)
at com.gargoylesoftware.htmlunit.html.HtmlScript.onAllChildrenAddedToPage(HtmlScript.java:286)
at com.gargoylesoftware.htmlunit.html.HTMLParser$HtmlUnitDOMBuilder.endElement(HTMLParser.java:683)
at org.apache.xerces.parsers.AbstractSAXParser.endElement(Unknown Source)
at com.gargoylesoftware.htmlunit.html.HTMLParser$HtmlUnitDOMBuilder.endElement(HTMLParser.java:642)
at org.cyberneko.html.HTMLTagBalancer.callEndElement(HTMLTagBalancer.java:1170)
at org.cyberneko.html.HTMLTagBalancer.endElement(HTMLTagBalancer.java:1072)
at org.cyberneko.html.filters.DefaultFilter.endElement(DefaultFilter.java:206)
at org.cyberneko.html.filters.NamespaceBinder.endElement(NamespaceBinder.java:330)
at org.cyberneko.html.HTMLScanner$ContentScanner.scanEndElement(HTMLScanner.java:3116)
at org.cyberneko.html.HTMLScanner$ContentScanner.scan(HTMLScanner.java:2083)
at org.cyberneko.html.HTMLScanner.scanDocument(HTMLScanner.java:918)
at org.cyberneko.html.HTMLConfiguration.parse(HTMLConfiguration.java:499)
at org.cyberneko.html.HTMLConfiguration.parse(HTMLConfiguration.java:452)
at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
at com.gargoylesoftware.htmlunit.html.HTMLParser$HtmlUnitDOMBuilder.parse(HTMLParser.java:899)
at com.gargoylesoftware.htmlunit.html.HTMLParser.parse(HTMLParser.java:242)
at com.gargoylesoftware.htmlunit.html.HTMLParser.parseHtml(HTMLParser.java:188)
at com.gargoylesoftware.htmlunit.DefaultPageCreator.createHtmlPage(DefaultPageCreator.java:268)
at com.gargoylesoftware.htmlunit.DefaultPageCreator.createPage(DefaultPageCreator.java:156)
at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseInto(WebClient.java:437)
at com.gargoylesoftware.htmlunit.WebClient.loadDownloadedResponses(WebClient.java:2024)
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.doProcessPostponedActions(JavaScriptEngine.java:712)
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.access$500(JavaScriptEngine.java:92)
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$HtmlUnitContextAction.run(JavaScriptEngine.java:679)
at net.sourceforge.htmlunit.corejs.javascript.Context.call(Context.java:602)
at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.call(ContextFactory.java:507)
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:616)
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:591)
at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunctionIfPossible(HtmlPage.java:985)
at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptFunctionJob.runJavaScript(JavaScriptFunctionJob.java:53)
at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptExecutionJob.run(JavaScriptExecutionJob.java:102)
at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptJobManagerImpl.runSingleJob(JavaScriptJobManagerImpl.java:328)
at com.gargoylesoftware.htmlunit.javascript.background.DefaultJavaScriptExecutor.run(DefaultJavaScriptExecutor.java:162)
at java.lang.Thread.run(Thread.java:744)
Tom
________________________________
From: Ruff, Thomas
Sent: Friday, February 07, 2014 10:12 PM
To: htm...@li...
Subject: RE: [Htmlunit-user] Trouble testing a GWT application
No, I was testing against the latest stable release (2.13). I'll try using the latest snapshot on Monday. The url is not public and I didn't write the GWT code but I'll see if I can create a minimal version of it that produces the problem. It may take some time to get that approved though.
Thanks Ahmed.
Tom
________________________________
From: Ahmed Ashour [asa...@ya...]
Sent: Thursday, February 06, 2014 5:53 PM
To: htm...@li...
Cc: htm...@li...
Subject: Re: [Htmlunit-user] Trouble testing a GWT application
Hi Tom,
Hope you are you latest HtmlUnit version/snapshot. GWT AJAX example is correctly handled.
Is there a way to send the public URL of the web app? Or you can send the whole project so others can see.
Ahmed
On Feb 7, 2014, at 4:00 AM, "Ruff, Thomas" <Tho...@so...<mailto:Tho...@so...>> wrote:
I'm trying to test a GWT application by filling out some input fields and clicking on a button. When I do this in IE or Chrome the outputDiv I'm looking for is modified via AJAX after clicking on the Calculate button but when I run my test case that div is left unmodified (its original text node value is left unchanged). I've tried waitForBackgroundJavaScript(), waitForBackgroundJavaScriptStartingBefore(), wait() and sleep(), but nothing seems to make a difference. Has anyone else been able to succeed in testing GWT pages that modify themselves with the result of AJAX calls? Do you see anything wrong with my test?
public class MyTest {
@Test
public void calcDensityAltitude() throws Exception {
WebClient webClient = new WebClient(BrowserVersion.INTERNET_EXPLORER_8);
webClient.setAjaxController(new NicelyResynchronizingAjaxController());
HtmlPage page = webClient.getPage("http://mypage");
page.getWebClient().waitForBackgroundJavaScript(10000);
try {
//set input fields
HtmlInput elevation = page.getHtmlElementById("myId");
elevation.setValueAttribute("30.0");
HtmlDivision calButton = page.getFirstByXPath("//*[text()='Calculate']");
page.getWebClient().waitForBackgroundJavaScript(10000);
page = calButton.click();
page.getWebClient().waitForBackgroundJavaScript(10000);
//try 20 times to wait .5 second each for filling the page.
HtmlLabel outputDiv=null;
for (int i = 0; i < 20; i++) {
outputDiv = page.getFirstByXPath("//*[text()='11422']");
if (null != outputDiv) {
break;
}
synchronized (page) { //also tried to sleep() instead
page.wait(500);
}
}
int remainingTasks = page.getWebClient().waitForBackgroundJavaScript(10000);
System.out.println("remaining JS tasks: " + remainingTasks);
System.out.println(page.asXml());
Assert.assertNotNull(outputDiv);
String output = outputDiv.getTextContent();
System.out.println("Desity Altitude: " + output);
} catch (...) {...}
webClient.closeAllWindows();
}
}
Thanks,
Tom
|
|
From: David M. G. <mic...@gm...> - 2014-02-10 15:04:48
|
Hi all, I have the following challenging question :-) The following url http://www.unioviedo.es/reunido/index.php/EBL/article/view/9962/9779 embeds a pdf with the javascript library pdfobject http://pdfobject.com/ If it would be an ordinary frame, i could just have detected that the frame contains an unexpectedpage with the type pdf and could have fetched the pdf with pdfbox. I have the following code: package test; import java.io.IOException; import java.net.MalformedURLException; import com.gargoylesoftware.htmlunit.BrowserVersion; import com.gargoylesoftware.htmlunit.FailingHttpStatusCodeException; import com.gargoylesoftware.htmlunit.ImmediateRefreshHandler; import com.gargoylesoftware.htmlunit.WebClient; import com.gargoylesoftware.htmlunit.html.HtmlPage; public class PdfObject { public static void main(String[] args) throws FailingHttpStatusCodeException, MalformedURLException, IOException { // TODO Auto-generated method stub String url = " http://www.unioviedo.es/reunido/index.php/EBL/article/view/9962/9779"; WebClient client = new WebClient(BrowserVersion.FIREFOX_24); client.setRefreshHandler(new ImmediateRefreshHandler()); final HtmlPage page = client.getPage(url); client.waitForBackgroundJavaScriptStartingBefore(5000); System.out.println(page.asXml()); } } As we can see the pdf object is not initialized. Maybe this is because of the implementation of the javascript function in htmlunit This function is used by pdfobject //Detects unbranded PDF support var hasGeneric = function (){ var plugin = navigator.mimeTypes["application/pdf"]; return (plugin && plugin.enabledPlugin); }; If this is false the javascript is not initialized. How can i cause pdfobject to work with htmlunit? Thanks, David |
|
From: asashour <asa...@ya...> - 2014-02-10 11:10:27
|
Reposting to the list. laughing wrote <http://htmlunit.10904.n7.nabble.com/file/n33122/1.jpg> > * > your link is not the real download linnk, I solve your problem use my code > as below with htmlunit2.13 * > > <http://htmlunit.10904.n7.nabble.com/file/n33122/2.jpg> -- View this message in context: http://htmlunit.10904.n7.nabble.com/htmlunit-and-keep-alive-tp32658p33133.html Sent from the HtmlUnit - General mailing list archive at Nabble.com. |
|
From: David M. G. <mic...@gm...> - 2014-02-09 07:50:25
|
Hi, It works now fine. Thanks, David > Message: 3 > Date: Thu, 6 Feb 2014 19:52:37 +0300 > From: Ahmed Ashour <asa...@ya...> > Subject: Re: [Htmlunit-user] htmlunit dies on page > To: "htm...@li..." > <htm...@li...> > Cc: "htm...@li..." > <htm...@li...> > Message-ID: <CF3...@ya...> > Content-Type: text/plain; charset="us-ascii" > > Hi David, > > The change was done on core-js snapshot, not in HtmlUnit proper. > > Ahmed > > > On Feb 6, 2014, at 7:06 PM, David Michael Gang <mic...@gm...> > wrote: > > > > Hi, > > > > I don't see the build. > > The latest build at the site build.canoo.com/htmlunit/buildresults > > was at "02/05/2014 21:25:25". > > > > Thanks, > > David > > > > > > > >> On Thu, Feb 6, 2014 at 4:50 PM, < > htm...@li...> wrote: > >> Send Htmlunit-user mailing list submissions to > >> htm...@li... > >> > >> To subscribe or unsubscribe via the World Wide Web, visit > >> https://lists.sourceforge.net/lists/listinfo/htmlunit-user > >> or, via email, send a message with subject or body 'help' to > >> htm...@li... > >> > >> You can reach the person managing the list at > >> htm...@li... > >> > >> When replying, please edit your Subject line so it is more specific > >> than "Re: Contents of Htmlunit-user digest..." > >> > >> > >> Today's Topics: > >> > >> 1. Re: htmlunit dies on page (Ahmed Ashour) > >> 2. First obstacles, javascript exception for MRBS. (rg...@gm...) > >> 3. Re: First obstacles, javascript exception for MRBS. (Ronald Brill) > >> 4. Re: java.lang.ClassCastException: > >> com.gargoylesoftware.htmlunit.TextPage cannot be cast to > >> com.gargoylesoftware.htmlunit.html.HtmlPage (Ahmed Ashour) > >> > >> > >> ---------------------------------------------------------------------- > >> > >> Message: 1 > >> Date: Wed, 5 Feb 2014 07:37:16 -0800 (PST) > >> From: Ahmed Ashour <asa...@ya...> > >> Subject: Re: [Htmlunit-user] htmlunit dies on page > >> To: "htm...@li..." > >> <htm...@li...> > >> Message-ID: > >> <139...@we...> > >> Content-Type: text/plain; charset="us-ascii" > >> > >> Fixed in snapshot. > >> > >> Ahmed > >> > >> ________________________________ > >> From: Ahmed Ashour <asa...@ya...> > >> To: "htm...@li..." < > htm...@li...> > >> Sent: Wednesday, February 5, 2014 5:12 PM > >> Subject: Re: [Htmlunit-user] htmlunit dies on page > >> > >> > >> > >> Hi David, > >> > >> I confirm, this is an issue. > >> > >> Stay tuned. > >> > >> Ahmed > > > ------------------------------------------------------------------------------ > > Managing the Performance of Cloud-Based Applications > > Take advantage of what the Cloud has to offer - Avoid Common Pitfalls. > > Read the Whitepaper. > > > http://pubads.g.doubleclick.net/gampad/clk?id=121051231&iu=/4140/ostg.clktrk > > _______________________________________________ > > Htmlunit-user mailing list > > Htm...@li... > > https://lists.sourceforge.net/lists/listinfo/htmlunit-user > -------------- next part -------------- > An HTML attachment was scrubbed... > > ------------------------------ > > > ------------------------------------------------------------------------------ > Managing the Performance of Cloud-Based Applications > Take advantage of what the Cloud has to offer - Avoid Common Pitfalls. > Read the Whitepaper. > > http://pubads.g.doubleclick.net/gampad/clk?id=121051231&iu=/4140/ostg.clktrk > > ------------------------------ > > _______________________________________________ > Htmlunit-user mailing list > Htm...@li... > https://lists.sourceforge.net/lists/listinfo/htmlunit-user > > > End of Htmlunit-user Digest, Vol 93, Issue 16 > ********************************************* > |
|
From: Ruff, T. <Tho...@so...> - 2014-02-08 06:13:40
|
No, I was testing against the latest stable release (2.13). I'll try using the latest snapshot on Monday. The url is not public and I didn't write the GWT code but I'll see if I can create a minimal version of it that produces the problem. It may take some time to get that approved though.
Thanks Ahmed.
Tom
________________________________
From: Ahmed Ashour [asa...@ya...]
Sent: Thursday, February 06, 2014 5:53 PM
To: htm...@li...
Cc: htm...@li...
Subject: Re: [Htmlunit-user] Trouble testing a GWT application
Hi Tom,
Hope you are you latest HtmlUnit version/snapshot. GWT AJAX example is correctly handled.
Is there a way to send the public URL of the web app? Or you can send the whole project so others can see.
Ahmed
On Feb 7, 2014, at 4:00 AM, "Ruff, Thomas" <Tho...@so...<mailto:Tho...@so...>> wrote:
I'm trying to test a GWT application by filling out some input fields and clicking on a button. When I do this in IE or Chrome the outputDiv I'm looking for is modified via AJAX after clicking on the Calculate button but when I run my test case that div is left unmodified (its original text node value is left unchanged). I've tried waitForBackgroundJavaScript(), waitForBackgroundJavaScriptStartingBefore(), wait() and sleep(), but nothing seems to make a difference. Has anyone else been able to succeed in testing GWT pages that modify themselves with the result of AJAX calls? Do you see anything wrong with my test?
public class MyTest {
@Test
public void calcDensityAltitude() throws Exception {
WebClient webClient = new WebClient(BrowserVersion.INTERNET_EXPLORER_8);
webClient.setAjaxController(new NicelyResynchronizingAjaxController());
HtmlPage page = webClient.getPage("http://mypage");
page.getWebClient().waitForBackgroundJavaScript(10000);
try {
//set input fields
HtmlInput elevation = page.getHtmlElementById("myId");
elevation.setValueAttribute("30.0");
HtmlDivision calButton = page.getFirstByXPath("//*[text()='Calculate']");
page.getWebClient().waitForBackgroundJavaScript(10000);
page = calButton.click();
page.getWebClient().waitForBackgroundJavaScript(10000);
//try 20 times to wait .5 second each for filling the page.
HtmlLabel outputDiv=null;
for (int i = 0; i < 20; i++) {
outputDiv = page.getFirstByXPath("//*[text()='11422']");
if (null != outputDiv) {
break;
}
synchronized (page) { //also tried to sleep() instead
page.wait(500);
}
}
int remainingTasks = page.getWebClient().waitForBackgroundJavaScript(10000);
System.out.println("remaining JS tasks: " + remainingTasks);
System.out.println(page.asXml());
Assert.assertNotNull(outputDiv);
String output = outputDiv.getTextContent();
System.out.println("Desity Altitude: " + output);
} catch (...) {...}
webClient.closeAllWindows();
}
}
Thanks,
Tom
|
|
From: <rg...@gm...> - 2014-02-07 23:24:48
|
Dear Ahmed, dear list subscribers, thank you for giving it a try, as well. Anyway, your test seems to run well till there. It would be helpful for me, having a sound test environment, so maybe anybody could send me their project file /folder as archive? What IDE/environment are you using, anyway? Is it possible that my free Java SDK causes the problems? java -version java version "1.7.0_51" OpenJDK Runtime Environment (IcedTea 2.4.4) (7u51-2.4.4-1) OpenJDK 64-Bit Server VM (build 24.45-b08, mixed mode) Kind regards Ralf Am 06.02.2014 18:25, schrieb Ahmed Ashour: > It gives: > > "Unknown user > Log in > You do not have the necessary rights to view this page." -- PGP/GnuPG: pub 1024D/E6DE0971 |
189 messages has been excluded from this view by a project administrator.
