Menu
▾
▴
htmlunit-user — Discussion of the use of HtmlUnit
You can subscribe to this list here.
| 2003 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
(6) |
Jul
(17) |
Aug
(18) |
Sep
(22) |
Oct
(16) |
Nov
(6) |
Dec
(11) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2004 |
Jan
(11) |
Feb
(10) |
Mar
(34) |
Apr
(26) |
May
(6) |
Jun
(22) |
Jul
(14) |
Aug
(4) |
Sep
(47) |
Oct
(69) |
Nov
(23) |
Dec
(21) |
| 2005 |
Jan
(53) |
Feb
(33) |
Mar
(92) |
Apr
(65) |
May
(63) |
Jun
(57) |
Jul
(43) |
Aug
(132) |
Sep
(61) |
Oct
(75) |
Nov
(60) |
Dec
(130) |
| 2006 |
Jan
(74) |
Feb
(87) |
Mar
(101) |
Apr
(58) |
May
(54) |
Jun
(42) |
Jul
(31) |
Aug
(67) |
Sep
(61) |
Oct
(71) |
Nov
(28) |
Dec
(58) |
| 2007 |
Jan
(53) |
Feb
(50) |
Mar
(96) |
Apr
(66) |
May
(55) |
Jun
(130) |
Jul
(99) |
Aug
(115) |
Sep
(37) |
Oct
(78) |
Nov
(24) |
Dec
(70) |
| 2008 |
Jan
(94) |
Feb
(85) |
Mar
(197) |
Apr
(274) |
May
(119) |
Jun
(143) |
Jul
(193) |
Aug
(99) |
Sep
(160) |
Oct
(120) |
Nov
(178) |
Dec
(109) |
| 2009 |
Jan
(238) |
Feb
(169) |
Mar
(115) |
Apr
(109) |
May
(131) |
Jun
(167) |
Jul
(144) |
Aug
(193) |
Sep
(155) |
Oct
(154) |
Nov
(97) |
Dec
(127) |
| 2010 |
Jan
(108) |
Feb
(127) |
Mar
(176) |
Apr
(113) |
May
(130) |
Jun
(200) |
Jul
(115) |
Aug
(80) |
Sep
(92) |
Oct
(101) |
Nov
(124) |
Dec
(53) |
| 2011 |
Jan
(67) |
Feb
(144) |
Mar
(88) |
Apr
(60) |
May
(89) |
Jun
(54) |
Jul
(68) |
Aug
(81) |
Sep
(48) |
Oct
(40) |
Nov
(10) |
Dec
(20) |
| 2012 |
Jan
(21) |
Feb
(28) |
Mar
(17) |
Apr
(35) |
May
(41) |
Jun
(44) |
Jul
(68) |
Aug
(67) |
Sep
(89) |
Oct
(58) |
Nov
(47) |
Dec
(56) |
| 2013 |
Jan
(49) |
Feb
(28) |
Mar
(46) |
Apr
(31) |
May
(28) |
Jun
(37) |
Jul
(34) |
Aug
(52) |
Sep
(42) |
Oct
(108) |
Nov
(59) |
Dec
(56) |
| 2014 |
Jan
(41) |
Feb
(72) |
Mar
(46) |
Apr
(21) |
May
(19) |
Jun
(17) |
Jul
(15) |
Aug
(40) |
Sep
(11) |
Oct
(3) |
Nov
(5) |
Dec
(31) |
| 2015 |
Jan
(11) |
Feb
(12) |
Mar
(19) |
Apr
(19) |
May
(38) |
Jun
(54) |
Jul
(14) |
Aug
(42) |
Sep
(14) |
Oct
(16) |
Nov
(26) |
Dec
(14) |
| 2016 |
Jan
(3) |
Feb
(1) |
Mar
(24) |
Apr
(5) |
May
(15) |
Jun
(14) |
Jul
(33) |
Aug
(19) |
Sep
(8) |
Oct
(10) |
Nov
|
Dec
(2) |
| 2017 |
Jan
(16) |
Feb
(12) |
Mar
(23) |
Apr
(8) |
May
(11) |
Jun
(20) |
Jul
(21) |
Aug
(20) |
Sep
|
Oct
(6) |
Nov
(9) |
Dec
(2) |
| 2018 |
Jan
(7) |
Feb
(5) |
Mar
(6) |
Apr
(5) |
May
(1) |
Jun
(2) |
Jul
(2) |
Aug
|
Sep
(4) |
Oct
(3) |
Nov
|
Dec
(4) |
| 2019 |
Jan
(2) |
Feb
(2) |
Mar
(3) |
Apr
(4) |
May
|
Jun
(4) |
Jul
(9) |
Aug
(2) |
Sep
|
Oct
(4) |
Nov
(1) |
Dec
(7) |
| 2020 |
Jan
(2) |
Feb
(6) |
Mar
(9) |
Apr
(1) |
May
(1) |
Jun
(15) |
Jul
(1) |
Aug
(1) |
Sep
(2) |
Oct
(6) |
Nov
(3) |
Dec
(5) |
| 2021 |
Jan
(3) |
Feb
(1) |
Mar
(2) |
Apr
(1) |
May
|
Jun
(1) |
Jul
(1) |
Aug
(3) |
Sep
(1) |
Oct
|
Nov
(1) |
Dec
|
| 2022 |
Jan
|
Feb
|
Mar
|
Apr
|
May
(2) |
Jun
(1) |
Jul
(4) |
Aug
|
Sep
|
Oct
|
Nov
(1) |
Dec
(6) |
| 2025 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
(1) |
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
|
From: Christoff, K. <kch...@no...> - 2015-12-02 15:46:10
|
Hello, I'm trying to automate a cloudera installation by using htmlunit-2.19. I've downloaded cloudera-manager-installer.bin from cloudera. After executing it, a cloudera manager installer web site is available at http://localhost:7180. I'm trying to navigate this web site and supply inputs using htmlunit-2.19 to complete my installation. I can use htmlunit to login and navigate to the page where I can enter the hostnames of what will become my hadoop cluster. After setting a textArea on this page with my comma-separated list of hostnames, I find and click a "Search" button on the page. The page, I believe, executes some javascript to go out and find these hosts. After finding them, the page is updated with a list of the nodes. At this point, a previously unavailable "Continue" button on the page becomes available. I'd like to click it to move to the next page and continue my installation. However, my java program never sees the updated list of nodes and I cannot move forward. I know that htmlunit normally does not wait for javascript to finish, so I've taken steps to allow for that. As you'll see in my attached code, I've: webClient.setAjaxController(new NicelyResynchronizingAjaxController()); and after clicking the "Search" button: webClient.waitForBackgroundJavaScript(10000); but I've not been successful. How can I capture the page updates and continue my installation? thank you, Kyle |
|
From: Christoff, K. <kch...@no...> - 2015-12-02 15:35:37
|
Hello, I'm trying to automate a cloudera installation by using htmlunit-2.19. I've downloaded cloudera-manager-installer.bin from cloudera. After executing it, a cloudera manager installer web site is available at http://localhost:7180. I'm trying to navigate this web site and supply inputs using htmlunit-2.19 to complete my installation. I can use htmlunit to login and navigate to the page where I can enter the hostnames of what will become my hadoop cluster. After setting a textArea on this page with my comma-separated list of hostnames, I find and click a "Search" button on the page. The page, I believe, executes some javascript to go out and find these hosts. After finding them, the page is updated with a list of the nodes. At this point, a previously unavailable "Continue" button on the page becomes available. I'd like to click it to move to the next page and continue my installation. However, my java program never sees the updated list of nodes and I cannot move forward. I know that htmlunit normally does not wait for javascript to finish, so I've taken steps to allow for that. As you'll see in my attached code, I've: webClient.setAjaxController(new NicelyResynchronizingAjaxController()); and after clicking the "Search" button: webClient.waitForBackgroundJavaScript(10000); but I've not been successful. How can I capture the page updates and continue my installation? thank you, Kyle |
|
From: Ahmed A. <asa...@ya...> - 2015-11-26 09:00:43
|
Hi Teryl,
Check the code of WebResponseData.
Specifically:
final String encoding = getHeader(headers, "content-encoding"); if (encoding != null) { if (StringUtils.contains(encoding, "gzip")) { stream = new GZIPInputStream(stream); }
Ahmed From: tptaylor <ter...@gm...>
To: htm...@li...
Sent: Wednesday, November 25, 2015 8:27 PM
Subject: [Htmlunit-user] Question about decompression of JavaScript in HTMLUnit
Hi everyone,
What Class does the decompression of gzipped js files in HTMLUnit? Is it
done by the Rhino javascript engine? I'm noticing that when I mine
websites that some files aren't being decompressed before they are ran;
therefore, I'm seeing an "Illegal characters" script exception at times.
I'm trying to track down a consistent case, but it seems to occur in weird
situations. I'm using the DebugWebConnection, so i can actually decompress
the files with gunzip after they've been written.
Cheers,
Teryl
|
|
From: tptaylor <ter...@gm...> - 2015-11-25 20:10:06
|
Hi everyone, What Class does the decompression of gzipped js files in HTMLUnit? Is it done by the Rhino javascript engine? I'm noticing that when I mine websites that some files aren't being decompressed before they are ran; therefore, I'm seeing an "Illegal characters" script exception at times. I'm trying to track down a consistent case, but it seems to occur in weird situations. I'm using the DebugWebConnection, so i can actually decompress the files with gunzip after they've been written. Cheers, Teryl -- View this message in context: http://htmlunit.10904.n7.nabble.com/Question-about-decompression-of-JavaScript-in-HTMLUnit-tp37776.html Sent from the HtmlUnit - General mailing list archive at Nabble.com. |
|
From: Manish G. <tin...@ou...> - 2015-11-19 13:55:33
|
I am developing an application that mobilizes an old legacy web application. Frontend is developed using JQueryMobile/backbone etc. The backend server piece uses HTMLUnit to connect to the legacy application, transforms the data and presents to the frontend in JSON. The results so far have been great. Currently, I fire up a webclient for each action called in struts. I save WebClient cookies in session to retrieve them in subsequent request and assign them to newly created webclient for a user session. I also tried saving the whole webclient as part of struts session, and tried to re-use it again on subsequent request, it failed sometimes. However, this approach will not probably work when I roll this out to users (around 1200). I was thinking about creating a WebClient pool using Apache's Commons Object Pool library. And, use it by getting a webclient from pool, use it and return it back to pool on each request. I plan to store HTMLPage in the session. I can associate cookies stored in the session with webclient fetched from the pool. The question really is, how do I associate HTMLPage that is stored in the session with the newly fetched webclient? for e.g.: I open a page, click on a button that executes javascript and changes content on the page. I take this content and present it to front end. On the subsequent struts request, webclient needs to act on the page saved in the session. Am I doing this right? Would appreciate any help in this regard. Thanks |
|
From: Ahmed A. <asa...@ya...> - 2015-11-16 09:38:09
|
Hi Teryl, HTMLElement and descendants are part of the JavaScript objects, and they have their DomNode assigned. DomNode is a parallel hierarchy where it handles the relation between elements. You can use htmlPage.addDomChangeListener. Also, you could post your code so far, so others can continue from where you have reached. Ahmed From: tptaylor <ter...@gm...> To: htm...@li... Sent: Sunday, November 15, 2015 12:02 AM Subject: Re: [Htmlunit-user] Question about scraping object/embed tags from website Hi Ahmed, How are HTMLObjectElement, and HtmlObject linked? I have verified that an HTMLObjectElement object is created by the Javascript and it is added to the document object, as when I check it's ownerDocument, it is the root URL given above. I also add a WebWindowListener to the WebClient. The WebListener is fired multiple times, but not when the HTMLObjectElement is added, and the HtmlObject doesn't appear in the HtmlPage object. I was thinking of adding in a DOMListener to try and see if that is triggered when the dom is changed, but I'm not sure where I would do that. Is that something you do directly after getPage is called on HtmlPage? Cheers, Teryl |
|
From: tptaylor <ter...@gm...> - 2015-11-14 23:44:08
|
Hi Ahmed, How are HTMLObjectElement, and HtmlObject linked? I have verified that an HTMLObjectElement object is created by the Javascript and it is added to the document object, as when I check it's ownerDocument, it is the root URL given above. I also add a WebWindowListener to the WebClient. The WebListener is fired multiple times, but not when the HTMLObjectElement is added, and the HtmlObject doesn't appear in the HtmlPage object. I was thinking of adding in a DOMListener to try and see if that is triggered when the dom is changed, but I'm not sure where I would do that. Is that something you do directly after getPage is called on HtmlPage? Cheers, Teryl -- View this message in context: http://htmlunit.10904.n7.nabble.com/Question-about-scraping-object-embed-tags-from-website-tp37745p37750.html Sent from the HtmlUnit - General mailing list archive at Nabble.com. |
|
From: tptaylor <ter...@gm...> - 2015-11-13 23:07:59
|
Hi Ahmed, Thanks for the reply. I've been doing some digging, and the script is actually an event loop thread, and it builds an object tag with embed tags inside, and adds it to the HTMLDocument of the owning page. I verified that it gets added, in HTMLUnit by printing out the owner document of the object tag. It's URL corresponds with the page I give it. Basically, the javascript creates the object tag as a string, creates an HtmlDivElement, and then adds the object to the div, through using div.innerHtml. The div's owning document is HTMLDocument. I have a couple of questions around this. One is, are HtmlPage and HtmlDocument one and the same? and so if I call getByXPath on HTMLPage, it should access the stuff added? even through the use of the innerHtml? And, if so, is there a Page listener that listens for additions and removals of tags from the page? I'll keep digging to see if I can characterize it more. Thanks again, Teryl -- View this message in context: http://htmlunit.10904.n7.nabble.com/Question-about-scraping-object-embed-tags-from-website-tp37745p37749.html Sent from the HtmlUnit - General mailing list archive at Nabble.com. |
|
From: Ahmed A. <asa...@ya...> - 2015-11-13 10:03:04
|
Hi Teryl, In real Chrome, there are no generated elements as well. I am not sure how the website works. I guess you need to dig in the JavaScript, please read http://htmlunit.sourceforge.net/submittingJSBugs.html Ahmed From: Teryl Taylor <ter...@gm...> To: htm...@li... Sent: Friday, November 13, 2015 12:41 AM Subject: [Htmlunit-user] Question about scraping object/embed tags from website Hi guys, There is a website that runs a flash video: http://fast.wistia.net/embed/playlists/ba40yik7fl?loop=true&autoPlay=true&controlsVisibleOnLoad=false&version=v1&videoFoam=true And I'm trying to find the embed or object tags that launch the video, so I did the following: BrowserVersion browser = BrowserVersion.FIREFOX_38; PluginConfiguration acrobat = new PluginConfiguration("Adobe Acrobat", "Adobe PDF Plug-In For Firefox and Netscape 11.0.12", "11", "nppdf32.dll"); browser.getPlugins().add(acrobat);PluginConfiguration flash = new PluginConfiguration("Shockwave Flash","Shockwave Flash 19.0 r0", "19", "NPSWF32_19_0_0_226.dll"); //17,0,0,188 flash.getMimeTypes().add(new PluginConfiguration.MimeType("application/x-shockwave-flash", "Shockwave Flash", "swf")); browser.getPlugins().add(flash); webClient.addRequestHeader("ClientIP", clientIP); webClient.getOptions().setThrowExceptionOnScriptError(false); webClient.getOptions().setThrowExceptionOnFailingStatusCode(false); webClient.getOptions().setAppletEnabled(true); webClient.getOptions().setCssEnabled(true); webClient.getOptions().setTimeout(20000); webClient.setJavaScriptTimeout(5000); webClient.getOptions().setJavaScriptEnabled(true); webClient.getCookieManager().setCookiesEnabled(true); webClient.setAjaxController(new NicelyResynchronizingAjaxController()); Page p = webClient.getPage(url);if(p != null && p.isHtmlPage()){ int scriptsWaiting = webClient.waitForBackgroundJavaScript(30000); System.out.println("Scripts waiting: " + Integer.toString(scriptsWaiting)); HtmlPage page = (HtmlPage)p; java.util.List<HtmlEmbed> embeds = (List<HtmlEmbed>) page.getByXPath("//embed"); for(HtmlEmbed embed: embeds) { System.out.println("Embed tag found..\n"); } java.util.List<HtmlObject> objects = (List<HtmlObject>) page.getByXPath("//object"); for(HtmlObject object: objects) { System.out.println("Object tag found..\n"); } } The website just sits there for the 30 seconds, and no tags are found. Everything is generated by javascript. Am I searching for the tags in the proper way? Or is there some DOM object I should be checking? There are no exceptions in HTMLUnit. And hte site loads up great in the regular firefox. Any advice you could give would be great. Best, Teryl ------------------------------------------------------------------------------ _______________________________________________ Htmlunit-user mailing list Htm...@li... https://lists.sourceforge.net/lists/listinfo/htmlunit-user |
|
From: Teryl T. <ter...@gm...> - 2015-11-12 23:41:18
|
Hi guys, There is a website that runs a flash video: http://fast.wistia.net/embed/playlists/ba40yik7fl?loop=true&autoPlay=true&controlsVisibleOnLoad=false&version=v1&videoFoam=true And I'm trying to find the embed or object tags that launch the video, so I did the following: BrowserVersion browser = BrowserVersion.FIREFOX_38; PluginConfiguration acrobat = new PluginConfiguration("Adobe Acrobat", "Adobe PDF Plug-In For Firefox and Netscape 11.0.12", "11", "nppdf32.dll"); browser.getPlugins().add(acrobat); PluginConfiguration flash = new PluginConfiguration("Shockwave Flash","Shockwave Flash 19.0 r0", "19", "NPSWF32_19_0_0_226.dll"); //17,0,0,188 flash.getMimeTypes().add(new PluginConfiguration.MimeType("application/x-shockwave-flash", "Shockwave Flash", "swf")); browser.getPlugins().add(flash); webClient.addRequestHeader("ClientIP", clientIP); webClient.getOptions().setThrowExceptionOnScriptError(false); webClient.getOptions().setThrowExceptionOnFailingStatusCode(false); webClient.getOptions().setAppletEnabled(true); webClient.getOptions().setCssEnabled(true); webClient.getOptions().setTimeout(20000); webClient.setJavaScriptTimeout(5000); webClient.getOptions().setJavaScriptEnabled(true); webClient.getCookieManager().setCookiesEnabled(true); webClient.setAjaxController(new NicelyResynchronizingAjaxController()); Page p = webClient.getPage(url); if(p != null && p.isHtmlPage()) { int scriptsWaiting = webClient.waitForBackgroundJavaScript(30000); System.out.println("Scripts waiting: " + Integer.toString(scriptsWaiting)); HtmlPage page = (HtmlPage)p; java.util.List<HtmlEmbed> embeds = (List<HtmlEmbed>) page.getByXPath("//embed"); for(HtmlEmbed embed: embeds) { System.out.println("Embed tag found..\n"); } java.util.List<HtmlObject> objects = (List<HtmlObject>) page.getByXPath("//object"); for(HtmlObject object: objects) { System.out.println("Object tag found..\n"); } } The website just sits there for the 30 seconds, and no tags are found. Everything is generated by javascript. Am I searching for the tags in the proper way? Or is there some DOM object I should be checking? There are no exceptions in HTMLUnit. And hte site loads up great in the regular firefox. Any advice you could give would be great. Best, Teryl |
|
From: Teryl T. <ter...@gm...> - 2015-11-12 22:20:51
|
Hi guys, I'm fine with removing IE8 as well. You could however stick up an archived version of the last htmlunit that supports it just in case someone wants it. The most supported browser sounds like a great idea. Cheers, Teryl On Thu, Nov 12, 2015 at 3:41 PM, Ronald Brill <rb...@rb...> wrote: > Regarding the default browser i like Marc's idea to define something like > BestSupported and set this as default. > If someone takes no care about the browser we provide always the best > simulation available. > > For many of the support cases i faced during the last weeks this approach > seems to be the correct one. > > BTW: best supported is FF38 at the moment. > > RBRi > > On Thu, 12 Nov 2015 16:03:57 +0000 Parham, Clinton wrote: > > > >I'm fine with removing IE8 support. > > > >And vote to set Chrome as the default thanks. > > > >From: Ahmed Ashour [mailto:asa...@ya...] > >Sent: Thursday, November 12, 2015 10:34 AM > >To: htm...@li... > >Subject: [Htmlunit-user] Internet Explorer 8 > > > >Hi all, > > > >We are thinking to remove Internet Explorer 8 support. > > > >Its current usage according to StatCounter is less than 2% [1]. > > > >Also note that IE11 has an option for "Enterprise Mode" to behave like > IE8. > > > >Any objection against its removal? And what should be the default > Browser, IE11 or Chrome? > > > >Looking forward to getting your feedback. > > > >Ahmed > > > >[1] http://gs.statcounter.com/#browser_version-ww-monthly-201410-201510 > > > >________________________________ > > > >The contents contained herein may contain confidential information. If > you are not the intended recipient, you are hereby notified that any > disclosure, copying, distribution, printing or action taken on the contents > is strictly prohibited. If you have > >received this email in error, please notify the sender immediately and > delete this message. > > > > > > > >----< Inline text [text-plain-04.txt] >------------------ > > > > >------------------------------------------------------------------------------ > > > > > > > >----< Inline text [text-plain-05.txt] >------------------ > > > >_______________________________________________ > >Htmlunit-user mailing list > >Htm...@li... > >https://lists.sourceforge.net/lists/listinfo/htmlunit-user > > > > > > > > ------------------------------------------------------------------------------ > _______________________________________________ > Htmlunit-user mailing list > Htm...@li... > https://lists.sourceforge.net/lists/listinfo/htmlunit-user > |
|
From: Ronald B. <rb...@rb...> - 2015-11-12 20:41:42
|
Regarding the default browser i like Marc's idea to define something like BestSupported and set this as default. If someone takes no care about the browser we provide always the best simulation available. For many of the support cases i faced during the last weeks this approach seems to be the correct one. BTW: best supported is FF38 at the moment. RBRi On Thu, 12 Nov 2015 16:03:57 +0000 Parham, Clinton wrote: > >I'm fine with removing IE8 support. > >And vote to set Chrome as the default thanks. > >From: Ahmed Ashour [mailto:asa...@ya...] >Sent: Thursday, November 12, 2015 10:34 AM >To: htm...@li... >Subject: [Htmlunit-user] Internet Explorer 8 > >Hi all, > >We are thinking to remove Internet Explorer 8 support. > >Its current usage according to StatCounter is less than 2% [1]. > >Also note that IE11 has an option for "Enterprise Mode" to behave like IE8. > >Any objection against its removal? And what should be the default Browser, IE11 or Chrome? > >Looking forward to getting your feedback. > >Ahmed > >[1] http://gs.statcounter.com/#browser_version-ww-monthly-201410-201510 > >________________________________ > >The contents contained herein may contain confidential information. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution, printing or action taken on the contents is strictly prohibited. If you have >received this email in error, please notify the sender immediately and delete this message. > > > >----< Inline text [text-plain-04.txt] >------------------ > >------------------------------------------------------------------------------ > > > >----< Inline text [text-plain-05.txt] >------------------ > >_______________________________________________ >Htmlunit-user mailing list >Htm...@li... >https://lists.sourceforge.net/lists/listinfo/htmlunit-user > > |
|
From: Parham, C. <cp...@bi...> - 2015-11-12 16:19:56
|
I’m fine with removing IE8 support. And vote to set Chrome as the default… thanks. From: Ahmed Ashour [mailto:asa...@ya...] Sent: Thursday, November 12, 2015 10:34 AM To: htm...@li... Subject: [Htmlunit-user] Internet Explorer 8 Hi all, We are thinking to remove Internet Explorer 8 support. Its current usage according to StatCounter is less than 2% [1]. Also note that IE11 has an option for "Enterprise Mode" to behave like IE8. Any objection against its removal? And what should be the default Browser, IE11 or Chrome? Looking forward to getting your feedback. Ahmed [1] http://gs.statcounter.com/#browser_version-ww-monthly-201410-201510 ________________________________ The contents contained herein may contain confidential information. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution, printing or action taken on the contents is strictly prohibited. If you have received this email in error, please notify the sender immediately and delete this message. |
|
From: Ahmed A. <asa...@ya...> - 2015-11-12 15:33:51
|
Hi all, We are thinking to remove Internet Explorer 8 support. Its current usage according to StatCounter is less than 2% [1]. Also note that IE11 has an option for "Enterprise Mode" to behave like IE8. Any objection against its removal? And what should be the default Browser, IE11 or Chrome? Looking forward to getting your feedback. Ahmed [1] http://gs.statcounter.com/#browser_version-ww-monthly-201410-201510 |
|
From: Ahmed A. <asa...@ya...> - 2015-11-12 11:26:23
|
Hi all, It is a pleasure to announce the release of HtmlUnit 2.19. This release comes with a significant number of fixes and enhancements, in addition to CSS Media Query support. The list of changes can be found in [1]. Happy Testing!The HtmlUnit team [1] http://htmlunit.sourceforge.net/changes-report.html#a2.19 |
|
From: Ahmed A. <asa...@ya...> - 2015-11-10 18:27:16
|
Hi, new WebClient(); uses IE8 by default. Please change that to new WebClient(BrowserVersion.CHROME); Ahmed From: blackman <ma...@ho...> To: htm...@li... Sent: Tuesday, November 10, 2015 6:32 PM Subject: [Htmlunit-user] HtmlUnit and angularJS Hello all, I'm using the latest stable release of Htmlunit. I wrote the following snipet of code to fecth the page https://exchange.xforce.ibmcloud.com/index.html: When viewed in Firefox or IE, the source of this page contains this non-empty div: * <div id="wrapper" class="" autoscroll="true" ui-view="" ng-if="!loading" style=""> <div id="homepage-wrapper"> ....other divs </div> </div> * The code : * try { WebClient webClient = new WebClient(); webClient.getOptions().setCssEnabled(true); webClient.setCssErrorHandler(new SilentCssErrorHandler()); webClient.getOptions().setThrowExceptionOnFailingStatusCode(false); webClient.getOptions().setThrowExceptionOnScriptError(false); webClient.getOptions().setTimeout(5000); webClient.getOptions().setJavaScriptEnabled(true); webClient.getOptions().setPopupBlockerEnabled(true); webClient.getOptions().setPrintContentOnFailingStatusCode(false); webClient.waitForBackgroundJavaScript(10000); HtmlPage page = webClient.getPage("https://exchange.xforce.ibmcloud.comindex.html"); System.out.println(page.asXml()); } catch (Throwable err) { err.printStackTrace(); } * When i run this code , i've lots of scripts errors : * com.gargoylesoftware.htmlunit.ScriptException: TypeError: Cannot find function addEventListener in object [object HTMLDocument]. (https://exchange.xforce.ibmcloud.com/scripts/vendor.js#31) at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$HtmlUnitContextAction.run(JavaScriptEngine.java:865) at net.sourceforge.htmlunit.corejs.javascript.Context.call(Context.java:628) at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.call(ContextFactory.java:513) at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.execute(JavaScriptEngine.java:747) at com.gargoylesoftware.htmlunit.html.HtmlPage.loadExternalJavaScriptFile(HtmlPage.java:1032) at com.gargoylesoftware.htmlunit.html.HtmlScript.executeScriptIfNeeded(HtmlScript.java:395) at com.gargoylesoftware.htmlunit.html.HtmlScript$3.execute(HtmlScript.java:270) at com.gargoylesoftware.htmlunit.html.HtmlScript.onAllChildrenAddedToPage(HtmlScript.java:290) ... caused by Caused by: net.sourceforge.htmlunit.corejs.javascript.EcmaError: ReferenceError: "angular" is not defined. (https://exchange.xforce.ibmcloud.com/scripts/external/ng-ckeditor.js#3) at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.constructError(ScriptRuntime.java:3935) at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.constructError(ScriptRuntime.java:3919) at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.notFoundError(ScriptRuntime.java:3996) at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.name(ScriptRuntime.java:1846) at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpretLoop(Interpreter.java:1627) at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpret(Interpreter.java:798) at net.sourceforge.htmlunit.corejs.javascript.InterpretedFunction.call(InterpretedFunction.java:105) at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.doTopCall(ContextFactory.java:411) at com.gargoylesoftware.htmlunit.javascript.HtmlUnitContextFactory.doTopCall(HtmlUnitCont * and the page.asXml() give me an empty div * <div ng-if="!loading" id="wrapper" ui-view="" autoscroll="true"> </div> * >From the error , I suppose htmunit not able to run AngularJS scripts on this page. Or is the problem with the page itself ? Why the div is empty? and is there any way of getting its contents even if there is script errors? Many thanks. -- View this message in context: http://htmlunit.10904.n7.nabble.com/HtmlUnit-and-angularJS-tp37720.html Sent from the HtmlUnit - General mailing list archive at Nabble.com. ------------------------------------------------------------------------------ _______________________________________________ Htmlunit-user mailing list Htm...@li... https://lists.sourceforge.net/lists/listinfo/htmlunit-user |
|
From: blackman <ma...@ho...> - 2015-11-10 18:13:29
|
Hello all, I'm using the latest stable release of Htmlunit. I wrote the following snipet of code to fecth the page https://exchange.xforce.ibmcloud.com/index.html: When viewed in Firefox or IE, the source of this page contains this non-empty div: * <div id="wrapper" class="" autoscroll="true" ui-view="" ng-if="!loading" style=""> <div id="homepage-wrapper"> ....other divs </div> </div> * The code : * try { WebClient webClient = new WebClient(); webClient.getOptions().setCssEnabled(true); webClient.setCssErrorHandler(new SilentCssErrorHandler()); webClient.getOptions().setThrowExceptionOnFailingStatusCode(false); webClient.getOptions().setThrowExceptionOnScriptError(false); webClient.getOptions().setTimeout(5000); webClient.getOptions().setJavaScriptEnabled(true); webClient.getOptions().setPopupBlockerEnabled(true); webClient.getOptions().setPrintContentOnFailingStatusCode(false); webClient.waitForBackgroundJavaScript(10000); HtmlPage page = webClient.getPage("https://exchange.xforce.ibmcloud.comindex.html"); System.out.println(page.asXml()); } catch (Throwable err) { err.printStackTrace(); } * When i run this code , i've lots of scripts errors : * com.gargoylesoftware.htmlunit.ScriptException: TypeError: Cannot find function addEventListener in object [object HTMLDocument]. (https://exchange.xforce.ibmcloud.com/scripts/vendor.js#31) at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$HtmlUnitContextAction.run(JavaScriptEngine.java:865) at net.sourceforge.htmlunit.corejs.javascript.Context.call(Context.java:628) at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.call(ContextFactory.java:513) at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.execute(JavaScriptEngine.java:747) at com.gargoylesoftware.htmlunit.html.HtmlPage.loadExternalJavaScriptFile(HtmlPage.java:1032) at com.gargoylesoftware.htmlunit.html.HtmlScript.executeScriptIfNeeded(HtmlScript.java:395) at com.gargoylesoftware.htmlunit.html.HtmlScript$3.execute(HtmlScript.java:270) at com.gargoylesoftware.htmlunit.html.HtmlScript.onAllChildrenAddedToPage(HtmlScript.java:290) ... caused by Caused by: net.sourceforge.htmlunit.corejs.javascript.EcmaError: ReferenceError: "angular" is not defined. (https://exchange.xforce.ibmcloud.com/scripts/external/ng-ckeditor.js#3) at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.constructError(ScriptRuntime.java:3935) at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.constructError(ScriptRuntime.java:3919) at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.notFoundError(ScriptRuntime.java:3996) at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.name(ScriptRuntime.java:1846) at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpretLoop(Interpreter.java:1627) at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpret(Interpreter.java:798) at net.sourceforge.htmlunit.corejs.javascript.InterpretedFunction.call(InterpretedFunction.java:105) at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.doTopCall(ContextFactory.java:411) at com.gargoylesoftware.htmlunit.javascript.HtmlUnitContextFactory.doTopCall(HtmlUnitCont * and the page.asXml() give me an empty div * <div ng-if="!loading" id="wrapper" ui-view="" autoscroll="true"> </div> * >From the error , I suppose htmunit not able to run AngularJS scripts on this page. Or is the problem with the page itself ? Why the div is empty? and is there any way of getting its contents even if there is script errors? Many thanks. -- View this message in context: http://htmlunit.10904.n7.nabble.com/HtmlUnit-and-angularJS-tp37720.html Sent from the HtmlUnit - General mailing list archive at Nabble.com. |
|
From: Ahmed A. <asa...@ya...> - 2015-11-09 05:58:22
|
Hi,
You need to remove the direct HttpClient dependency, because it is already referenced by HtmlUnit by a newer version. <dependency>
<groupId>commons-httpclient</groupId>
<artifactId>commons-httpclient</artifactId>
<version>3.1</version>
</dependency>You can see the used versions in eclipse.Ahmed
From: Mn Kishore <ma...@gm...>
To: Htm...@li...
Sent: Sunday, November 8, 2015 10:08 AM
Subject: [Htmlunit-user] issue in using Htmlunit with Maven dependency
0 down vote favorite I have added Htmlunit Maven dependency by adding the following to my pom.xml<dependency>
<groupId>net.sourceforge.htmlunit</groupId>
<artifactId>htmlunit</artifactId>
<version>2.18</version>
</dependency> When I am trying to run the application, I am getting the following error:Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/http/conn/ssl/NoopHostnameVerifier
at com.gargoylesoftware.htmlunit.httpclient.HtmlUnitSSLConnectionSocketFactory.buildSSLSocketFactory(HtmlUnitSSLConnectionSocketFactory.java:112)
at com.gargoylesoftware.htmlunit.HttpWebConnection.configureHttpsScheme(HttpWebConnection.java:597)
at com.gargoylesoftware.htmlunit.HttpWebConnection.createHttpClient(HttpWebConnection.java:532)
at com.gargoylesoftware.htmlunit.HttpWebConnection.getHttpClientBuilder(HttpWebConnection.java:494)
at com.gargoylesoftware.htmlunit.HttpWebConnection.getResponse(HttpWebConnection.java:158)
at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseFromWebConnection(WebClient.java:1321)
at com.gargoylesoftware.htmlunit.WebClient.loadWebResponse(WebClient.java:1238)
at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:346)
at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:415)
at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:400)The following is my complete pom.xml: |
|
From: Ahmed A. <asa...@ya...> - 2015-11-09 05:07:43
|
Hi Teryl,
Since real browsers have this method, HtmlUnit should follow.
Thanks for reporting, it has been committed to SVN.
Please use latest snapshot or build [1].
Thanks,Ahmed From: Teryl Taylor <ter...@gm...>
To: htm...@li...
Sent: Sunday, November 8, 2015 10:44 PM
Subject: [Htmlunit-user] HTMLDocument missing hasFocus?
Hi Everyone,
I'm mining an amazon page, and I get the following error in the log:
SEVERE: Error logged: {"m":"TypeError: Cannot find function hasFocus in object [object HTMLDocument]. (http://z-ecx.images-amazon.com/images/G/01/vap/video/airy2/prod/2.0.1283.0/js/airy.skin._V289604501_.js#5318)","f":"http://www.amazon.com/Etekcity-Digital-Hanging-Postal-Luggage/dp/B00NW62PCA/ref=cts_ap_4_fbt","l":5318,"c":"0","s":[],"t":5707,"csm":"v6 onerror callee","pageURL":"http://www.amazon.com/Etekcity-Digital-Hanging-Postal-Luggage/dp/B00NW62PCA/ref=cts_ap_4_fbt","logLevel":"FATAL"} ({m:TypeError: Cannot find function hasFocus in object [object HTMLDocument]. (http://z-ecx.images-amazon.com/images/G/01/vap/video/airy2/prod/2.0.1283.0/js/airy.skin._V289604501_.js#5318), f:"http://www.amazon.com/Etekcity-Digital-Hanging-Postal-Luggage/dp/B00NW62PCA/ref=cts_ap_4_fbt", l:5318, c:0, s:[], t:5707.0, name:null, type:null, csm:v6 onerror callee, pageURL:"http://www.amazon.com/Etekcity-Digital-Hanging-Postal-Luggage/dp/B00NW62PCA/ref=cts_ap_4_fbt", logLevel:"FATAL"})
Is this functionality just missing from HTMLDocument? or is it non-standard?
Best,
Teryl |
|
From: tptaylor <ter...@gm...> - 2015-11-09 00:03:18
|
Hi Ahmed, Thanks, I dug further and it turns out the HTMLUnit proxy always sends an HTTP "CONNECT" message before it converts over to HTTPS.. so I just handle the CONNECT and switch to HTTPS on the same port in my custom proxy. Cheers, Teryl -- View this message in context: http://htmlunit.10904.n7.nabble.com/http-https-over-proxy-tp37655p37696.html Sent from the HtmlUnit - General mailing list archive at Nabble.com. |
|
From: Mn K. <ma...@gm...> - 2015-11-08 09:08:57
|
0 down vote favorite <http://stackoverflow.com/questions/33581831/unable-to-run-htmlunit-application-using-maven-dependency?noredirect=1#> I have added Htmlunit Maven dependency by adding the following to my pom.xml <dependency> <groupId>net.sourceforge.htmlunit</groupId> <artifactId>htmlunit</artifactId> <version>2.18</version></dependency> When I am trying to run the application, I am getting the following error: Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/http/conn/ssl/NoopHostnameVerifier at com.gargoylesoftware.htmlunit.httpclient.HtmlUnitSSLConnectionSocketFactory.buildSSLSocketFactory(HtmlUnitSSLConnectionSocketFactory.java:112) at com.gargoylesoftware.htmlunit.HttpWebConnection.configureHttpsScheme(HttpWebConnection.java:597) at com.gargoylesoftware.htmlunit.HttpWebConnection.createHttpClient(HttpWebConnection.java:532) at com.gargoylesoftware.htmlunit.HttpWebConnection.getHttpClientBuilder(HttpWebConnection.java:494) at com.gargoylesoftware.htmlunit.HttpWebConnection.getResponse(HttpWebConnection.java:158) at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseFromWebConnection(WebClient.java:1321) at com.gargoylesoftware.htmlunit.WebClient.loadWebResponse(WebClient.java:1238) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:346) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:415) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:400) The following is my complete pom.xml, <?xml version="1.0" encoding="UTF-8"?> <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi=" http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd"> <modelVersion>4.0.0</modelVersion> <parent> <artifactId>spring-boot-starter-parent</artifactId> <groupId>org.springframework.boot</groupId> <version>1.2.5.RELEASE</version> <relativePath /> </parent> <groupId>com.sample</groupId> <artifactId>sample</artifactId> <version>0.0.1-SNAPSHOT</version> <packaging>war</packaging> <name>sample</name> <prerequisites> <maven>3.0.0</maven> </prerequisites> <properties> <HikariCP.version>2.3.7</HikariCP.version> <assertj-core.version>3.1.0</assertj-core.version> <awaitility.version>1.4.0</awaitility.version> <commons-io.version>2.4</commons-io.version> <commons-lang.version>2.6</commons-lang.version> <gatling.version>2.1.6</gatling.version> <gatling-maven-plugin.version>2.1.6</gatling-maven-plugin.version> <hibernate.version>4.3.6.Final</hibernate.version> <java.version>1.8</java.version> <maven.compiler.source>${java.version}</maven.compiler.source> <maven.compiler.target>${java.version}</maven.compiler.target> <javax.inject.version>1</javax.inject.version> <joda-time-hibernate.version>1.3</joda-time-hibernate.version> <json-path.version>0.9.1</json-path.version> <liquibase.version>3.3.2</liquibase.version> <liquibase-slf4j.version>1.2.1</liquibase-slf4j.version> <liquibase-hibernate4.version>3.5</liquibase-hibernate4.version> <mapstruct.version>1.0.0.CR1</mapstruct.version> <maven.build.timestamp.format>yyyyMMddHHmmss</maven.build.timestamp.format> <maven-enforcer-plugin.version>1.3.1</maven-enforcer-plugin.version> <maven-sortpom-plugin.version>2.3.0</maven-sortpom-plugin.version> <metrics-spark-reporter.version>1.2</metrics-spark-reporter.version> <metrics-spring.version>3.0.4</metrics-spring.version> <run.addResources>false</run.addResources> <sonar-maven-plugin.version>2.3</sonar-maven-plugin.version> <spring-security.version>4.0.1.RELEASE</spring-security.version> <springfox.version>2.0.3</springfox.version> <usertype-core.version>4.0.0.GA</usertype-core.version> </properties> <repositories> <repository> <id>opencast-public</id> <url> http://repository.opencastproject.org/nexus/content/repositories/public/ </url> </repository> <repository> <id>pentaho-releases</id> <url>http://repository.pentaho.org/artifactory/repo/</url> </repository> </repositories> <dependencies> <dependency> <groupId>log4j</groupId> <artifactId>apache-log4j-extras</artifactId> <version>1.2.17</version> </dependency> <dependency> <groupId>io.dropwizard.metrics</groupId> <artifactId>metrics-core</artifactId> </dependency> <dependency> <groupId>io.dropwizard.metrics</groupId> <artifactId>metrics-annotation</artifactId> <version>${dropwizard-metrics.version}</version> </dependency> <dependency> <groupId>io.dropwizard.metrics</groupId> <artifactId>metrics-ehcache</artifactId> <version>${dropwizard-metrics.version}</version> </dependency> <dependency> <groupId>io.dropwizard.metrics</groupId> <artifactId>metrics-graphite</artifactId> </dependency> <dependency> <groupId>io.dropwizard.metrics</groupId> <artifactId>metrics-healthchecks</artifactId> <version>${dropwizard-metrics.version}</version> </dependency> <dependency> <groupId>io.dropwizard.metrics</groupId> <artifactId>metrics-json</artifactId> <version>${dropwizard-metrics.version}</version> </dependency> <dependency> <groupId>io.dropwizard.metrics</groupId> <artifactId>metrics-jvm</artifactId> <version>${dropwizard-metrics.version}</version> </dependency> <dependency> <groupId>io.dropwizard.metrics</groupId> <artifactId>metrics-servlet</artifactId> <version>${dropwizard-metrics.version}</version> </dependency> <dependency> <groupId>io.dropwizard.metrics</groupId> <artifactId>metrics-servlets</artifactId> <exclusions> <exclusion> <artifactId>metrics-healthchecks</artifactId> <groupId>io.dropwizard.metrics</groupId> </exclusion> </exclusions> </dependency> <dependency> <groupId>com.fasterxml.jackson.datatype</groupId> <artifactId>jackson-datatype-hibernate4</artifactId> <version>${jackson.version}</version> </dependency> <dependency> <groupId>com.fasterxml.jackson.datatype</groupId> <artifactId>jackson-datatype-hppc</artifactId> <version>${jackson.version}</version> </dependency> <dependency> <groupId>com.fasterxml.jackson.datatype</groupId> <artifactId>jackson-datatype-joda</artifactId> </dependency> <dependency> <groupId>com.fasterxml.jackson.datatype</groupId> <artifactId>jackson-datatype-json-org</artifactId> <version>${jackson.version}</version> </dependency> <dependency> <groupId>com.h2database</groupId> <artifactId>h2</artifactId> <scope>test</scope> </dependency> <dependency> <groupId>com.jayway.awaitility</groupId> <artifactId>awaitility</artifactId> <version>${awaitility.version}</version> <scope>test</scope> </dependency> <dependency> <groupId>com.jayway.jsonpath</groupId> <artifactId>json-path</artifactId> <scope>test</scope> </dependency> <dependency> <groupId>io.springfox</groupId> <artifactId>springfox-swagger-ui</artifactId> <version>${springfox.version}</version> </dependency> <dependency> <groupId>io.springfox</groupId> <artifactId>springfox-swagger2</artifactId> <version>${springfox.version}</version> <exclusions> <exclusion> <groupId>org.mapstruct</groupId> <artifactId>mapstruct</artifactId> </exclusion> </exclusions> </dependency> <dependency> <groupId>com.mattbertolini</groupId> <artifactId>liquibase-slf4j</artifactId> <version>${liquibase-slf4j.version}</version> </dependency> <dependency> <groupId>com.ryantenney.metrics</groupId> <artifactId>metrics-spring</artifactId> <version>${metrics-spring.version}</version> <exclusions> <exclusion> <groupId>com.codahale.metrics</groupId> <artifactId>metrics-annotation</artifactId> </exclusion> <exclusion> <groupId>com.codahale.metrics</groupId> <artifactId>metrics-core</artifactId> </exclusion> <exclusion> <groupId>com.codahale.metrics</groupId> <artifactId>metrics-healthchecks</artifactId> </exclusion> </exclusions> </dependency> <dependency> <groupId>com.zaxxer</groupId> <artifactId>HikariCP</artifactId> <exclusions> <exclusion> <artifactId>tools</artifactId> <groupId>com.sun</groupId> </exclusion> </exclusions> </dependency> <!-- The HikariCP Java Agent is disabled by default, as it is experimental <dependency> <groupId>com.zaxxer</groupId> <artifactId>HikariCP-agent</artifactId> <version>${HikariCP.version}</version> </dependency> --> <dependency> <groupId>commons-io</groupId> <artifactId>commons-io</artifactId> <version>${commons-io.version}</version> </dependency> <dependency> <groupId>commons-lang</groupId> <artifactId>commons-lang</artifactId> <version>${commons-lang.version}</version> </dependency> <dependency> <groupId>io.gatling.highcharts</groupId> <artifactId>gatling-charts-highcharts</artifactId> <version>${gatling.version}</version> <scope>test</scope> </dependency> <dependency> <groupId>javax.inject</groupId> <artifactId>javax.inject</artifactId> <version>${javax.inject.version}</version> </dependency> <dependency> <groupId>joda-time</groupId> <artifactId>joda-time</artifactId> </dependency> <dependency> <groupId>joda-time</groupId> <artifactId>joda-time-hibernate</artifactId> <version>${joda-time-hibernate.version}</version> </dependency> <dependency> <groupId>mysql</groupId> <artifactId>mysql-connector-java</artifactId> </dependency> <dependency> <groupId>org.assertj</groupId> <artifactId>assertj-core</artifactId> <version>${assertj-core.version}</version> <scope>test</scope> </dependency> <dependency> <groupId>org.hibernate</groupId> <artifactId>hibernate-ehcache</artifactId> <exclusions> <exclusion> <groupId>net.sf.ehcache</groupId> <artifactId>ehcache-core</artifactId> </exclusion> </exclusions> </dependency> <dependency> <groupId>org.hibernate</groupId> <artifactId>hibernate-envers</artifactId> </dependency> <dependency> <groupId>org.hibernate</groupId> <artifactId>hibernate-validator</artifactId> </dependency> <dependency> <groupId>org.jadira.usertype</groupId> <artifactId>usertype.core</artifactId> <version>${usertype-core.version}</version> </dependency> <dependency> <groupId>org.liquibase</groupId> <artifactId>liquibase-core</artifactId> <exclusions> <exclusion> <artifactId>jetty-servlet</artifactId> <groupId>org.eclipse.jetty</groupId> </exclusion> </exclusions> </dependency> <dependency> <groupId>org.mapstruct</groupId> <artifactId>mapstruct-jdk8</artifactId> <version>${mapstruct.version}</version> </dependency> <dependency> <groupId>org.springframework</groupId> <artifactId>spring-context-support</artifactId> </dependency> <dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-actuator</artifactId> </dependency> <dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-autoconfigure</artifactId> </dependency> <dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-loader-tools</artifactId> </dependency> <dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-starter-aop</artifactId> </dependency> <dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-starter-data-jpa</artifactId> </dependency> <dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-starter-logging</artifactId> </dependency> <dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-starter-mail</artifactId> </dependency> <dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-starter-security</artifactId> </dependency> <dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-starter-test</artifactId> <scope>test</scope> </dependency> <dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-starter-thymeleaf</artifactId> </dependency> <dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-starter-web</artifactId> <exclusions> <exclusion> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-starter-tomcat</artifactId> </exclusion> </exclusions> </dependency> <!-- Spring Cloud --> <dependency> <groupId>org.springframework.cloud</groupId> <artifactId>spring-cloud-cloudfoundry-connector</artifactId> </dependency> <dependency> <groupId>org.springframework.cloud</groupId> <artifactId>spring-cloud-spring-service-connector</artifactId> </dependency> <dependency> <groupId>org.springframework.cloud</groupId> <artifactId>spring-cloud-localconfig-connector</artifactId> </dependency> <!-- security --> <dependency> <groupId>org.springframework.security</groupId> <artifactId>spring-security-data</artifactId> </dependency> <!-- reporting --> <dependency> <groupId>fr.ippon.spark.metrics</groupId> <artifactId>metrics-spark-reporter</artifactId> <version>${metrics-spark-reporter.version}</version> </dependency> <dependency> <groupId>org.apache.activemq</groupId> <artifactId>activemq-all</artifactId> <version>5.12.0</version> </dependency> <dependency> <groupId>org.json</groupId> <artifactId>json</artifactId> <version>20141113</version> </dependency> <dependency> <groupId>commons-logging</groupId> <artifactId>commons-logging</artifactId> <version>1.2</version> </dependency> <dependency> <groupId>org.apache.poi</groupId> <artifactId>poi</artifactId> <version>3.12</version> </dependency> <dependency> <groupId>org.apache.poi</groupId> <artifactId>poi-ooxml</artifactId> <version>3.12</version> </dependency> <dependency> <groupId>org.apache.poi</groupId> <artifactId>ooxml-schemas</artifactId> <version>1.1</version> </dependency> <dependency> <groupId>org.apache.commons</groupId> <artifactId>commons-dbcp2</artifactId> </dependency> <dependency> <groupId>javax.mail</groupId> <artifactId>javax.mail-api</artifactId> </dependency> <dependency> <groupId>com.google.code.gson</groupId> <artifactId>gson</artifactId> </dependency> <dependency> <groupId>com.healthmarketscience.jackcess</groupId> <artifactId>jackcess</artifactId> <version>2.1.2</version> </dependency> <dependency> <groupId>commons-beanutils</groupId> <artifactId>commons-beanutils</artifactId> </dependency> <dependency> <groupId>org.apache.commons</groupId> <artifactId>commons-exec</artifactId> <version>1.3</version> </dependency> <dependency> <groupId>commons-net</groupId> <artifactId>commons-net</artifactId> <version>3.3</version> </dependency> <dependency> <groupId>org.codehaus.castor</groupId> <artifactId>castor</artifactId> <version>1.3.3</version> <type>pom</type> </dependency> <dependency> <groupId>org.apache.commons</groupId> <artifactId>commons-collections4</artifactId> <version>4.0</version> </dependency> <dependency> <groupId>org.apache.commons</groupId> <artifactId>commons-digester3</artifactId> <version>3.2</version> </dependency> <dependency> <groupId>com.fasterxml.jackson.core</groupId> <artifactId>jackson-core</artifactId> </dependency> <dependency> <groupId>com.fasterxml.jackson.core</groupId> <artifactId>jackson-databind</artifactId> </dependency> <dependency> <groupId>com.fasterxml.jackson.core</groupId> <artifactId>jackson-annotations</artifactId> </dependency> <dependency> <groupId>jakarta-regexp</groupId> <artifactId>jakarta-regexp</artifactId> <version>1.4</version> </dependency> <dependency> <groupId>net.sf.jasperreports</groupId> <artifactId>jasperreports</artifactId> <version>6.1.1</version> </dependency> <dependency> <groupId>org.eclipse.jdt.core.compiler</groupId> <artifactId>ecj</artifactId> <version>4.4.2</version> </dependency> <dependency> <groupId>net.sf.jasperreports</groupId> <artifactId>jasperreports-fonts</artifactId> <version>6.0.0</version> </dependency> <dependency> <groupId>org.olap4j</groupId> <artifactId>olap4j-xmla</artifactId> <version>1.2.0</version> </dependency> <dependency> <groupId>net.sf.jcommon</groupId> <artifactId>jcommon</artifactId> <version>1.3.1</version> </dependency> <dependency> <groupId>org.jfree</groupId> <artifactId>jfreechart</artifactId> <version>1.0.19</version> </dependency> <dependency> <groupId>org.apache.lucene</groupId> <artifactId>lucene-core</artifactId> <version>5.3.0</version> </dependency> <dependency> <groupId>org.apache.lucene</groupId> <artifactId>lucene-analyzers-common</artifactId> <version>5.3.0</version> </dependency> <dependency> <groupId>org.apache.lucene</groupId> <artifactId>lucene-queries</artifactId> <version>5.3.0</version> </dependency> <dependency> <groupId>org.apache.lucene</groupId> <artifactId>lucene-queryparser</artifactId> <version>5.3.0</version> </dependency> <dependency> <groupId>org.apache.lucene</groupId> <artifactId>lucene-sandbox</artifactId> <version>5.3.0</version> </dependency> <dependency> <groupId>xml-apis</groupId> <artifactId>xml-apis</artifactId> <version>1.4.01</version> </dependency> <dependency> <groupId>commons-vfs</groupId> <artifactId>commons-vfs</artifactId> <version>1.0</version> </dependency> <dependency> <groupId>commons-httpclient</groupId> <artifactId>commons-httpclient</artifactId> <version>3.1</version> </dependency> <dependency> <groupId>jsch</groupId> <artifactId>jsch</artifactId> <version>0.1.29</version> </dependency> <dependency> <groupId>org.apache.xmlbeans</groupId> <artifactId>xmlbeans</artifactId> <version>2.4.0</version> </dependency> <dependency> <groupId>dom4j</groupId> <artifactId>dom4j</artifactId> <version>1.6.1</version> </dependency> <dependency> <groupId>com.lowagie</groupId> <artifactId>itext</artifactId> <version>2.1.7</version> </dependency> <dependency> <groupId>org.hamcrest</groupId> <artifactId>hamcrest-core</artifactId> </dependency> <dependency> <groupId>commons-codec</groupId> <artifactId>commons-codec</artifactId> <version>1.2</version> </dependency> <dependency> <groupId>ar.com.fdvs</groupId> <artifactId>DynamicJasper</artifactId> <version>3.0.13</version> </dependency> <dependency> <groupId>net.sourceforge.dynamicreports</groupId> <artifactId>dynamicreports-core</artifactId> <version>4.0.1</version> </dependency> <dependency> <groupId>org.apache.commons</groupId> <artifactId>commons-lang3</artifactId> <version>3.0.1</version> </dependency> <dependency> <groupId>org.apache.tika</groupId> <artifactId>tika-parsers</artifactId> <version>1.5</version> </dependency> <dependency> <groupId>com.aspose</groupId> <artifactId>aspose-cells</artifactId> <version>8.2.1</version> </dependency> <dependency> <groupId>com.itextpdf</groupId> <artifactId>itextpdf</artifactId> <version>5.3.4</version> </dependency> <dependency> <groupId>net.sourceforge.htmlunit</groupId> <artifactId>htmlunit</artifactId> <version>2.18</version> </dependency> </dependencies> <build> <resources> <resource> <directory>src/main/resources</directory> <filtering>true</filtering> <includes> <include>**/*.xml</include> </includes> </resource> <resource> <directory>src/main/resources</directory> <filtering>false</filtering> <excludes> <exclude>**/*.xml</exclude> </excludes> </resource> </resources> <pluginManagement> <plugins> <!--This plugin's configuration is used to store Eclipse m2e settings only. It has no influence on the Maven build itself. --> <plugin> <groupId>org.eclipse.m2e</groupId> <artifactId>lifecycle-mapping</artifactId> <version>1.0.0</version> <configuration> <lifecycleMappingMetadata> <pluginExecutions> <pluginExecution> <pluginExecutionFilter> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-dependency-plugin</artifactId> <versionRange>[1.0,)</versionRange> <goals> <goal>copy</goal> </goals> </pluginExecutionFilter> <action> <execute /> </action> </pluginExecution> <pluginExecution> <pluginExecutionFilter> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-enforcer-plugin</artifactId> <versionRange>[1.0,)</versionRange> <goals> <goal>enforce</goal> </goals> </pluginExecutionFilter> <action> <execute /> </action> </pluginExecution> <pluginExecution> <pluginExecutionFilter> <groupId>org.codehaus.mojo</groupId> <artifactId>exec-maven-plugin</artifactId> <versionRange>[1.2.1,)</versionRange> <goals> <goal>java</goal> <goal>exec</goal> </goals> </pluginExecutionFilter> <action> <ignore /> </action> </pluginExecution> </pluginExecutions> </lifecycleMappingMetadata> </configuration> </plugin> </plugins> </pluginManagement> <plugins> <plugin> <groupId>com.google.code.sortpom</groupId> <artifactId>maven-sortpom-plugin</artifactId> <version>${maven-sortpom-plugin.version}</version> <executions> <execution> <phase>verify</phase> <goals> <goal>sort</goal> </goals> </execution> </executions> <configuration> <sortProperties>true</sortProperties> <nrOfIndentSpace>4</nrOfIndentSpace> <sortDependencies>groupId,artifactId</sortDependencies> <sortPlugins>groupId,artifactId</sortPlugins> <keepBlankLines>true</keepBlankLines> <expandEmptyElements>false</expandEmptyElements> </configuration> </plugin> <plugin> <groupId>io.gatling</groupId> <artifactId>gatling-maven-plugin</artifactId> <version>${gatling-maven-plugin.version}</version> <configuration> <configFolder>src/test/gatling/conf</configFolder> <dataFolder>src/test/gatling/data</dataFolder> <resultsFolder>target/gatling/results</resultsFolder> <bodiesFolder>src/test/gatling/bodies</bodiesFolder> <simulationsFolder>src/test/gatling/simulations</simulationsFolder> <!-- This will force Gatling to ask which simulation to run This is useful when you have multiple simulations --> <simulationClass>*</simulationClass> </configuration> </plugin> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-eclipse-plugin</artifactId> <configuration> <downloadSources>true</downloadSources> <downloadJavadocs>true</downloadJavadocs> </configuration> </plugin> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-enforcer-plugin</artifactId> <version>${maven-enforcer-plugin.version}</version> <executions> <execution> <id>enforce-versions</id> <goals> <goal>enforce</goal> </goals> </execution> </executions> <configuration> <rules> <requireMavenVersion> <message>You are running an older version of Maven. JHipster requires at least Maven 3.0</message> <version>[3.0.0,)</version> </requireMavenVersion> <requireJavaVersion> <message>You are running an older version of Java. JHipster requires at least JDK ${java.version}</message> <version>[${java.version}.0,)</version> </requireJavaVersion> </rules> </configuration> </plugin> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-surefire-plugin</artifactId> <configuration> <argLine>-Xmx256m</argLine> <!-- Force alphabetical order to have a reproducible build --> <runOrder>alphabetical</runOrder> </configuration> </plugin> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-war-plugin</artifactId> <configuration> <packagingExcludes>WEB-INF/lib/tomcat-*.jar</packagingExcludes> </configuration> </plugin> <plugin> <groupId>org.codehaus.mojo</groupId> <artifactId>sonar-maven-plugin</artifactId> <version>${sonar-maven-plugin.version}</version> </plugin> <plugin> <groupId>org.bsc.maven</groupId> <artifactId>maven-processor-plugin</artifactId> <version>2.2.4</version> <configuration> <defaultOutputDirectory> ${project.build.directory}/generated-sources </defaultOutputDirectory> <processors> <processor>org.mapstruct.ap.MappingProcessor</processor> </processors> <options> <mapstruct.suppressGeneratorTimestamp>true</mapstruct.suppressGeneratorTimestamp> <mapstruct.defaultComponentModel>spring</mapstruct.defaultComponentModel> </options> </configuration> <executions> <!-- <execution> <id>process</id> <phase>generate-sources</phase> <goals> <goal>process</goal> </goals> </execution> --> </executions> <dependencies> <dependency> <groupId>org.mapstruct</groupId> <artifactId>mapstruct-processor</artifactId> <version>${mapstruct.version}</version> </dependency> </dependencies> </plugin> <plugin> <groupId>org.liquibase</groupId> <artifactId>liquibase-maven-plugin</artifactId> <version>${liquibase.version}</version> <configuration> <changeLogFile>src/main/resources/config/liquibase/master.xml</changeLogFile> <diffChangeLogFile>src/main/resources/config/liquibase/changelog/${maven.build.timestamp}_changelog.xml</diffChangeLogFile> <driver>com.mysql.jdbc.Driver</driver> <url>jdbc:mysql://localhost:3306/sample</url> <defaultSchemaName>sample</defaultSchemaName> <username>root</username> <password></password> <referenceUrl>hibernate:spring:com.sample.domain?dialect=org.hibernate.dialect.MySQLInnoDBDialect</referenceUrl> <verbose>true</verbose> <logging>debug</logging> </configuration> <dependencies> <dependency> <groupId>org.javassist</groupId> <artifactId>javassist</artifactId> <version>3.18.2-GA</version> </dependency> <dependency> <groupId>org.liquibase.ext</groupId> <artifactId>liquibase-hibernate4</artifactId> <version>${liquibase-hibernate4.version}</version> </dependency> <dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-starter-data-jpa</artifactId> <version>${project.parent.version}</version> </dependency> </dependencies> </plugin> <plugin> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-maven-plugin</artifactId> <configuration> <jvmArguments>-agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=5005</jvmArguments> <arguments> <argument>--spring.profiles.active=dev</argument> </arguments> </configuration> </plugin> </plugins> </build> <profiles> <profile> <id>dev</id> <activation> <activeByDefault>true</activeByDefault> </activation> <properties> <!-- log configuration --> <logback.loglevel>DEBUG</logback.loglevel> </properties> <dependencies> <dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-starter-tomcat</artifactId> </dependency> </dependencies> </profile> <profile> <id>fast</id> <properties> <!-- log configuration --> <logback.loglevel>DEBUG</logback.loglevel> </properties> <dependencies> <dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-starter-undertow</artifactId> </dependency> </dependencies> <build> <plugins> <plugin> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-maven-plugin</artifactId> <configuration> <arguments> <argument>--spring.profiles.active=dev,fast</argument> </arguments> </configuration> </plugin> </plugins> </build> </profile> <profile> <id>prod</id> <dependencies> <dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-starter-tomcat</artifactId> </dependency> </dependencies> <build> <plugins> <plugin> <groupId>com.github.trecloux</groupId> <artifactId>yeoman-maven-plugin</artifactId> <version>0.4</version> <executions> <execution> <id>run-frontend-build</id> <phase>generate-resources</phase> <goals> <goal>build</goal> </goals> <configuration> <buildTool>grunt</buildTool> <buildArgs>build --force --no-color</buildArgs> </configuration> </execution> </executions> <configuration> <yeomanProjectDirectory>${project.basedir}</yeomanProjectDirectory> </configuration> </plugin> <plugin> <artifactId>maven-clean-plugin</artifactId> <version>2.5</version> <configuration> <filesets> <fileset> <directory>src/main/webapp/dist</directory> </fileset> <fileset> <directory>.tmp</directory> </fileset> <fileset> <directory>node_modules</directory> </fileset> </filesets> </configuration> </plugin> <plugin> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-maven-plugin</artifactId> <configuration> <arguments> <argument>--spring.profiles.active=prod</argument> </arguments> </configuration> </plugin> </plugins> </build> <properties> <!-- log configuration --> <logback.loglevel>INFO</logback.loglevel> </properties> </profile> </profiles> </project> |
|
From: Greg J. <gre...@sa...> - 2015-11-06 11:08:31
|
Hi Ahmed,
That is an amazingly generous response to what turns out to be a very dumb question!
Thank you for a wonderful product.
Best wishes, Greg.
> On 6 Nov 2015, at 20:34, Ahmed Ashour <asa...@ya...> wrote:
>
> Hi Greg,
>
> I was about to joke that this is a security feature :)
>
> Actually, HtmlUnit exactly matches real IE11 behavior (yes, a blank page).
>
> You need to change the BrowserVersion to CHROME, and send feedback to the bank about that.
>
> Ahmed
> From: Greg Johnson <gre...@sa...>
> To: htm...@li...
> Sent: Friday, November 6, 2015 6:03 AM
> Subject: [Htmlunit-user] IFrame and Javascript?
>
> Hi Guys, Logging into this banking site page with HtmlUnit used to work perfectly before the site added an Iframe.
>
> Now the following 2.18 code returns a blank (about:blank) page:
>
> public class HtmlUnitTest {
>
> private static final String NAB_INTERNET_BANKING = "https://ib.nab.com.au/nabib/index.jsp <https://ib.nab.com.au/nabib/index.jsp>";
>
> @Test
> public void testGetPageWithIFrame() throws Exception {
> WebClient webClient = new WebClient(BrowserVersion.INTERNET_EXPLORER_11);
> HtmlPage page = (HtmlPage) webClient.getPage(NAB_INTERNET_BANKING);
> }
> }
>
> I have tried to work through the HtmlUnit code but cannot see what is happening, any ideas or help would be much appreciated.
>
> Many thanks, Regards, Greg Johnson
> ------------------------------------------------------------------------------
> _______________________________________________
> Htmlunit-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
|
|
From: Ahmed A. <asa...@ya...> - 2015-11-06 09:34:19
|
Hi Greg,
I was about to joke that this is a security feature :)
Actually, HtmlUnit exactly matches real IE11 behavior (yes, a blank page).
You need to change the BrowserVersion to CHROME, and send feedback to the bank about that.
Ahmed From: Greg Johnson <gre...@sa...>
To: htm...@li...
Sent: Friday, November 6, 2015 6:03 AM
Subject: [Htmlunit-user] IFrame and Javascript?
Hi Guys, Logging into this banking site page with HtmlUnit used to work perfectly before the site added an Iframe.
Now the following 2.18 code returns a blank (about:blank) page:
public class HtmlUnitTest {
private static final String NAB_INTERNET_BANKING = "https://ib.nab.com.au/nabib/index.jsp";
@Test
public void testGetPageWithIFrame() throws Exception {
WebClient webClient = new WebClient(BrowserVersion.INTERNET_EXPLORER_11);
HtmlPage page = (HtmlPage) webClient.getPage(NAB_INTERNET_BANKING);
}
}
I have tried to work through the HtmlUnit code but cannot see what is happening, any ideas or help would be much appreciated.
Many thanks, Regards, Greg Johnson
|
|
From: Greg J. <gre...@sa...> - 2015-11-06 05:24:59
|
Hi Guys, Logging into this banking site page with HtmlUnit used to work perfectly before the site added an Iframe.
Now the following 2.18 code returns a blank (about:blank) page:
public class HtmlUnitTest {
private static final String NAB_INTERNET_BANKING = "https://ib.nab.com.au/nabib/index.jsp";
@Test
public void testGetPageWithIFrame() throws Exception {
WebClient webClient = new WebClient(BrowserVersion.INTERNET_EXPLORER_11);
HtmlPage page = (HtmlPage) webClient.getPage(NAB_INTERNET_BANKING);
}
}
I have tried to work through the HtmlUnit code but cannot see what is happening, any ideas or help would be much appreciated.
Many thanks, Regards, Greg Johnson
|
189 messages has been excluded from this view by a project administrator.
