Menu
▾
▴
Re: [Htmlunit-user] exception when trying to get page with htmlunit
|
From: Ahmed A. <asa...@ya...> - 2013-11-11 08:30:36
|
Hi David, Use w.getOptions().setUseInsecureSSL(true); Yours, Ahmed ________________________________ From: David Michael Gang <mic...@gm...> To: htm...@li... Sent: Monday, November 11, 2013 11:19 AM Subject: Re: [Htmlunit-user] exception when trying to get page with htmlunit On Mon, Nov 11, 2013 at 9:59 AM, David Michael Gang <mic...@gm...> wrote: Hi, > >I tried with the latest snapshot from >http://build.canoo.com/htmlunit/artifacts/ > >public static void main(String[] args) throws FailingHttpStatusCodeException, MalformedURLException, IOException { > WebClient w = new WebClient(); > HtmlPage p = w.getPage("https://www.sciencedirect.com/science/book/9780121346454"); > System.out.println(p.asText()); > } > > >and get the error messages (shortened exception stack): >11/11/2013 09:55:18 com.gargoylesoftware.htmlunit.IncorrectnessListenerImpl notify >WARNING: Obsolete content type encountered: 'text/javascript'. >11/11/2013 09:55:18 com.gargoylesoftware.htmlunit.IncorrectnessListenerImpl notify >WARNING: Obsolete content type encountered: 'application/x-javascript'. >11/11/2013 09:55:18 com.gargoylesoftware.htmlunit.javascript.StrictErrorReporter runtimeError >SEVERE: runtimeError: message=[The data necessary to complete this operation is not yet available.] sourceName=[https://cdn.optimizely.com/js/204774041.js] line=[31] lineSource=[null] lineOffset=[0] > >null [0:0] Error in expression. (Invalid token "<EOF>". Was expecting one of: <NUMBER>, "inherit", <IDENT>, <STRING>, <PLUS>, <HASH>, <EMS>, <EXS>, <LENGTH_PX>, <LENGTH_CM>, <LENGTH_MM>, <LENGTH_IN>, <LENGTH_PT>, <LENGTH_PC>, <ANGLE_DEG>, <ANGLE_RAD>, <ANGLE_GRAD>, <TIME_MS>, <TIME_S>, <FREQ_HZ>, <FREQ_KHZ>, <PERCENTAGE>, <DIMENSION>, <URI>, <FUNCTION>, "-".) > 11/11/2013 09:55:21 com.gargoylesoftware.htmlunit.javascript.StrictErrorReporter runtimeError >SEVERE: runtimeError: message=[The data necessary to complete this operation is not yet available.] sourceName=[http://cdn.els-cdn.com/sd/js/sdX_133aR4.js] line=[2] lineSource=[null] lineOffset=[0] >11/11/2013 09:55:21 com.gargoylesoftware.htmlunit.DefaultCssErrorHandler error >WARNING: CSS error: 'http://cdn.els-cdn.com/sd/css/css_gen_v01_133aR4.css' [945:46] Error in style rule. (Invalid token "!important". Was expecting one of: <EOF>, <S>, <IDENT>, "}", ";".) >... WARNING: Automation server can't create object for 'ShockwaveFlash.ShockwaveFlash'. >11/11/2013 09:55:22 com.gargoylesoftware.htmlunit.javascript.StrictErrorReporter runtimeError >SEVERE: runtimeError: message=[Automation server can't create object for 'ShockwaveFlash.ShockwaveFlash'.] sourceName=[http://cdn.els-cdn.com/sd/js/sdX_133aR4.js] line=[24] lineSource=[null] lineOffset=[0] >11/11/2013 09:55:23 com.gargoylesoftware.htmlunit.html.BaseFrameElement loadInnerPageIfPossible >SEVERE: IOException when getting content for iframe: url=[https://acw.scopus.com/SSOCore/update?acw=61d5d88a1164241502b86549eb96594e1fe0521%7C%24%7CJaYnPDv2odsjkuRTDTxw4aRRMXBZiJ8Mr3nxjU06KnmV2KWzVYCF9l%2FJd6PrZZXDpLLlYpMRbbWjmt81zQFCVK2W%2F%2B9o4%2Fzy] >javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target > at com.sun.net.ssl.internal.ssl.Alerts.getSSLException(Alerts.java:174) > at com.sun.net.ssl.internal.ssl.SSLSocketImpl.fatal(SSLSocketImpl.java:1747) > ... > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:72) > at com.gargoylesoftware.htmlunit.HttpWebConnection.getResponse(HttpWebConnection.java:167) > at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseFromWebConnection(WebClient.java:1281) > at com.gargoylesoftware.htmlunit.WebClient.loadWebResponse(WebClient.java:1198) > at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:307) > at com.gargoylesoftware.htmlunit.html.BaseFrameElement.loadInnerPageIfPossible(BaseFrameElement.java:174) > at com.gargoylesoftware.htmlunit.html.BaseFrameElement.loadInnerPage(BaseFrameElement.java:112) > at com.gargoylesoftware.htmlunit.html.HtmlPage.loadFrames(HtmlPage.java:1880) > at com.gargoylesoftware.htmlunit.html.HtmlPage.initialize(HtmlPage.java:232) > at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseInto(WebClient.java:444) > at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:311) > at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:376) > at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:361) > at test.Test.main(Test.java:15) >Caused by: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target > at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:323) > at sun.security.validator.PKIXValidator.engineValidate(PKIXValidator.java:217) > at sun.security.validator.Validator.validate(Validator.java:218) > at com.sun.net.ssl.internal.ssl.X509TrustManagerImpl.validate(X509TrustManagerImpl.java:126) > at com.sun.net.ssl.internal.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:209) > at com.sun.net.ssl.internal.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:249) > at com.sun.net.ssl.internal.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1188) > ... 29 more >Caused by: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target > at sun.security.provider.certpath.SunCertPathBuilder.engineBuild(SunCertPathBuilder.java:174) > at java.security.cert.CertPathBuilder.build(CertPathBuilder.java:238) > at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:318) > ... 35 more >11/11/2013 09:55:23 com.gargoylesoftware.htmlunit.html.BaseFrameElement loadInnerPageIfPossible >SEVERE: IOException when getting content for iframe: url=[https://acw.sciverse.com/SSOCore/update?acw=61d5d88a1164241502b86549eb96594e1fe0521%7C%24%7CJaYnPDv2odsjkuRTDTxw4aRRMXBZiJ8Mr3nxjU06KnmV2KWzVYCF9l%2FJd6PrZZXDpLLlYpMRbbWjmt81zQFCVK2W%2F%2B9o4%2Fzy] >javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target > at com.sun.net.ssl.internal.ssl.Alerts.getSSLException(Alerts.java:174) > at com.sun.net.ssl.internal.ssl.SSLSocketImpl.fatal(SSLSocketImpl.java:1747) > .... > at com.gargoylesoftware.htmlunit.HttpWebConnection.getResponse(HttpWebConnection.java:167) > at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseFromWebConnection(WebClient.java:1281) > at com.gargoylesoftware.htmlunit.WebClient.loadWebResponse(WebClient.java:1198) > at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:307) > at com.gargoylesoftware.htmlunit.html.BaseFrameElement.loadInnerPageIfPossible(BaseFrameElement.java:174) > at com.gargoylesoftware.htmlunit.html.BaseFrameElement.loadInnerPage(BaseFrameElement.java:112) > at com.gargoylesoftware.htmlunit.html.HtmlPage.loadFrames(HtmlPage.java:1880) > at com.gargoylesoftware.htmlunit.html.HtmlPage.initialize(HtmlPage.java:232) > at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseInto(WebClient.java:444) > at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:311) > at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:376) > at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:361) > at test.Test.main(Test.java:15) >Caused by: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target > at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:323) > at sun.security.validator.PKIXValidator.engineValidate(PKIXValidator.java:217) > at sun.security.validator.Validator.validate(Validator.java:218) > at com.sun.net.ssl.internal.ssl.X509TrustManagerImpl.validate(X509TrustManagerImpl.java:126) > at com.sun.net.ssl.internal.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:209) > at com.sun.net.ssl.internal.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:249) > at com.sun.net.ssl.internal.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1188) > ... 29 more >Caused by: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target > at sun.security.provider.certpath.SunCertPathBuilder.engineBuild(SunCertPathBuilder.java:174) > at java.security.cert.CertPathBuilder.build(CertPathBuilder.java:238) > at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:318) > ... 35 more >11/11/2013 09:55:24 com.gargoylesoftware.htmlunit.html.BaseFrameElement loadInnerPageIfPossible >SEVERE: IOException when getting content for iframe: url=[https://acw.elsevier.com/SSOCore/update?acw=61d5d88a1164241502b86549eb96594e1fe0521%7C%24%7CJaYnPDv2odsjkuRTDTxw4aRRMXBZiJ8Mr3nxjU06KnmV2KWzVYCF9l%2FJd6PrZZXDpLLlYpMRbbWjmt81zQFCVK2W%2F%2B9o4%2Fzy] >javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target > at com.sun.net.ssl.internal.ssl.Alerts.getSSLException(Alerts.java:174) > ... > at com.gargoylesoftware.htmlunit.HtmlUnitSSLSocketFactory.connectSocket(HtmlUnitSSLSocketFactory.java:153) > at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:178) > at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304) > at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:610) > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:445) > at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863) > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:72) > at com.gargoylesoftware.htmlunit.HttpWebConnection.getResponse(HttpWebConnection.java:167) > at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseFromWebConnection(WebClient.java:1281) > at com.gargoylesoftware.htmlunit.WebClient.loadWebResponse(WebClient.java:1198) > at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:307) > at com.gargoylesoftware.htmlunit.html.BaseFrameElement.loadInnerPageIfPossible(BaseFrameElement.java:174) > at com.gargoylesoftware.htmlunit.html.BaseFrameElement.loadInnerPage(BaseFrameElement.java:112) > at com.gargoylesoftware.htmlunit.html.HtmlPage.loadFrames(HtmlPage.java:1880) > at com.gargoylesoftware.htmlunit.html.HtmlPage.initialize(HtmlPage.java:232) > at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseInto(WebClient.java:444) > at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:311) > at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:376) > at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:361) > at test.Test.main(Test.java:15) >Caused by: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target > at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:323) > at sun.security.validator.PKIXValidator.engineValidate(PKIXValidator.java:217) > at sun.security.validator.Validator.validate(Validator.java:218) > at com.sun.net.ssl.internal.ssl.X509TrustManagerImpl.validate(X509TrustManagerImpl.java:126) > at com.sun.net.ssl.internal.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:209) > at com.sun.net.ssl.internal.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:249) > at com.sun.net.ssl.internal.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1188) > ... 29 more >Caused by: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target > at sun.security.provider.certpath.SunCertPathBuilder.engineBuild(SunCertPathBuilder.java:174) > at java.security.cert.CertPathBuilder.build(CertPathBuilder.java:238) > at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:318) > ... 35 more >11/11/2013 09:55:24 com.gargoylesoftware.htmlunit.DefaultCssErrorHandler error >... 11/11/2013 09:55:24 com.gargoylesoftware.htmlunit.javascript.StrictErrorReporter runtimeError >SEVERE: runtimeError: message=[An invalid or illegal selector was specified (selector: '[id='ui-id-1'] ul:not(.ui-menu)' error: Invalid selector: *[id="ui-id-1"] ul:not(*.ui-menu)).] sourceName=[http://cdn.els-cdn.com/sd/js/sdX_133aR4.js] line=[10] lineSource=[null] lineOffset=[0] >11/11/2013 09:55:24 com.gargoylesoftware.htmlunit.html.HtmlPage loadExternalJavaScriptFile >SEVERE: Error loading JavaScript from [https://cdn.els-cdn.com/sd/js/adobe/s_code_131.js]. >javax.net.ssl.SSLException: hostname in certificate didn't match: <cdn.els-cdn.com> != <a248.e.akamai.net> OR <*.akamaihd.net> OR <*.akamaihd-staging.net> OR <a248.e.akamai.net> > at org.apache.http.conn.ssl.AbstractVerifier.verify(AbstractVerifier.java:231) > at org.apache.http.conn.ssl.BrowserCompatHostnameVerifier.verify(BrowserCompatHostnameVerifier.java:54) > ... > at com.gargoylesoftware.htmlunit.html.HtmlPage.initialize(HtmlPage.java:265) > at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseInto(WebClient.java:444) > at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:311) > at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:376) > at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:361) > at test.Test.main(Test.java:15) > >Exception in thread "main" java.lang.NullPointerException > at com.steadystate.css.dom.CSSStyleDeclarationImpl.getPropertyValue(CSSStyleDeclarationImpl.java:109) > at com.gargoylesoftware.htmlunit.javascript.host.css.ComputedCSSStyleDeclaration.applyStyleFromSelector(ComputedCSSStyleDeclaration.java:225) > at com.gargoylesoftware.htmlunit.javascript.host.css.CSSStyleSheet.modifyIfNecessary(CSSStyleSheet.java:242) > at com.gargoylesoftware.htmlunit.javascript.host.css.CSSStyleSheet.modifyIfNecessary(CSSStyleSheet.java:218) > at com.gargoylesoftware.htmlunit.javascript.host.Window.getComputedStyle(Window.java:1607) ,,, > > at com.gargoylesoftware.htmlunit.html.DomNode.asText(DomNode.java:760) > at test.Test.main(Test.java:16) > > ------------------------------------------------------------------------------ November Webinars for C, C++, Fortran Developers Accelerate application performance with scalable programming models. Explore techniques for threading, error checking, porting, and tuning. Get the most from the latest Intel processors and coprocessors. See abstracts and register http://pubads.g.doubleclick.net/gampad/clk?id=60136231&iu=/4140/ostg.clktrk _______________________________________________ Htmlunit-user mailing list Htm...@li... https://lists.sourceforge.net/lists/listinfo/htmlunit-user |
