Hello,
We are using HtmlUnit 2.33 for dealing with Javascripted web pages and get the text on the pages, this works very well! There are, however, a set of web pages (links below) that i cannot get the text from. HtmlUnit logs a bunch of errors and throws a NPE in EventHandler constructor line 50.
Being new to HtmlUnit, i, of course, have absolutely no idea what the root of the problem is, but i'm filing a bug instead of a mailing list message due to the NPE i got.
How can we get the final recipe text which i loaded via AJAX?
Thanks!
Example pages:
https://www.aarstiderne.com/find-din-maaltidskasse/10-minutterskassen
https://www.aarstiderne.com/find-din-maaltidskasse/kvikkassen
Code:
BrowserVersion version = new BrowserVersion.BrowserVersionBuilder(BrowserVersion.CHROME).build(); WebClient client = new WebClient(version); client.getOptions().setThrowExceptionOnScriptError(false); client.getOptions().setCssEnabled(false); client.getOptions().setJavaScriptEnabled(true); client.getOptions().setDownloadImages(false); client.getOptions().setThrowExceptionOnFailingStatusCode(false); client.getOptions().setPrintContentOnFailingStatusCode(false); client.getOptions().setUseInsecureSSL(true); client.getOptions().setRedirectEnabled(false); client.setJavaScriptTimeout(20000); page = client.getPage(url); synchronized(page) { try { page.wait(20000); } catch (Exception e) {} } client.waitForBackgroundJavaScript(10000);
Log + stack trace:
2019-01-15 12:08:20,689 WARN css.CSSStyleSheet - Unhandled CSS condition type 'PREFIX_ATTRIBUTE_CONDITION'. Accepting it silently. 2019-01-15 12:08:20,696 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: '*,:x' error: Invalid selector: *:x).] sourceName=[https://www.aarstiderne.com:443/assets/build/js/libs/jquery-3.3.1.min.js] line=[2] lineSource=[null] lineOffset=[0] 2019-01-15 12:08:22,479 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'. 2019-01-15 12:08:22,537 INFO javascript.JavaScriptEngine - Caught script exception ======= EXCEPTION START ======== Exception class=[java.lang.RuntimeException] com.gargoylesoftware.htmlunit.ScriptException: Exception invoking setInnerHTML at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$HtmlUnitContextAction.run(JavaScriptEngine.java:892) at net.sourceforge.htmlunit.corejs.javascript.Context.call(Context.java:616) at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.call(ContextFactory.java:534) at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:821) at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:793) at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2518) at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2511) at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptFunctionJob.runJavaScript(JavaScriptFunctionJob.java:57) at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptExecutionJob.run(JavaScriptExecutionJob.java:102) at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptJobManagerImpl.runSingleJob(JavaScriptJobManagerImpl.java:424) at com.gargoylesoftware.htmlunit.javascript.background.DefaultJavaScriptExecutor.run(DefaultJavaScriptExecutor.java:144) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.RuntimeException: Exception invoking setInnerHTML at net.sourceforge.htmlunit.corejs.javascript.MemberBox.invoke(MemberBox.java:184) at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject$GetterSlot.setValue(ScriptableObject.java:328) at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject.putImpl(ScriptableObject.java:2853) at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject.put(ScriptableObject.java:538) at com.gargoylesoftware.htmlunit.javascript.HtmlUnitScriptable.put(HtmlUnitScriptable.java:151) at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject.putProperty(ScriptableObject.java:2532) at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.setObjectProp(ScriptRuntime.java:1736) at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.setObjectProp(ScriptRuntime.java:1730) at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpretLoop(Interpreter.java:1447) at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpret(Interpreter.java:1009) at net.sourceforge.htmlunit.corejs.javascript.InterpretedFunction.call(InterpretedFunction.java:111) at net.sourceforge.htmlunit.corejs.javascript.BaseFunction.construct(BaseFunction.java:361) at net.sourceforge.htmlunit.corejs.javascript.BoundFunction.construct(BoundFunction.java:59) at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpretLoop(Interpreter.java:1718) at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpret(Interpreter.java:1009) at net.sourceforge.htmlunit.corejs.javascript.InterpretedFunction.call(InterpretedFunction.java:111) at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.doTopCall(ContextFactory.java:424) at com.gargoylesoftware.htmlunit.javascript.HtmlUnitContextFactory.doTopCall(HtmlUnitContextFactory.java:330) at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3557) at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$3.doRun(JavaScriptEngine.java:814) at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$HtmlUnitContextAction.run(JavaScriptEngine.java:877) ... 11 more Caused by: java.lang.NullPointerException at com.gargoylesoftware.htmlunit.javascript.host.event.EventHandler.<init>(EventHandler.java:50) at com.gargoylesoftware.htmlunit.javascript.host.Element.createEventHandler(Element.java:149) at com.gargoylesoftware.htmlunit.javascript.host.Element.setDomNode(Element.java:136) at com.gargoylesoftware.htmlunit.javascript.SimpleScriptable.makeScriptableFor(SimpleScriptable.java:238) at com.gargoylesoftware.htmlunit.html.DomNode.getScriptableObject(DomNode.java:942) at com.gargoylesoftware.htmlunit.html.HtmlPage.getAttributeValue(HtmlPage.java:1796) at com.gargoylesoftware.htmlunit.html.HtmlPage.addElement(HtmlPage.java:1767) at com.gargoylesoftware.htmlunit.html.HtmlPage.addMappedElement(HtmlPage.java:1760) at com.gargoylesoftware.htmlunit.html.HtmlPage.notifyNodeAdded(HtmlPage.java:1703) at com.gargoylesoftware.htmlunit.html.DomNode.fireAddition(DomNode.java:1082) at com.gargoylesoftware.htmlunit.html.DomNode.appendChild(DomNode.java:976) at com.gargoylesoftware.htmlunit.html.HTMLParser$HtmlUnitDOMBuilder.addNodeToRightParent(HTMLParser.java:722) at com.gargoylesoftware.htmlunit.html.HTMLParser$HtmlUnitDOMBuilder.startElement(HTMLParser.java:601) at org.apache.xerces.parsers.AbstractSAXParser.startElement(Unknown Source) at com.gargoylesoftware.htmlunit.html.HTMLParser$HtmlUnitDOMBuilder.startElement(HTMLParser.java:530) at net.sourceforge.htmlunit.cyberneko.HTMLTagBalancer.callStartElement(HTMLTagBalancer.java:1188) at net.sourceforge.htmlunit.cyberneko.HTMLTagBalancer.startElement(HTMLTagBalancer.java:791) at net.sourceforge.htmlunit.cyberneko.filters.DefaultFilter.startElement(DefaultFilter.java:142) at net.sourceforge.htmlunit.cyberneko.filters.NamespaceBinder.startElement(NamespaceBinder.java:280) at net.sourceforge.htmlunit.cyberneko.HTMLScanner$ContentScanner.scanStartElement(HTMLScanner.java:2814) at net.sourceforge.htmlunit.cyberneko.HTMLScanner$ContentScanner.scan(HTMLScanner.java:2149) at net.sourceforge.htmlunit.cyberneko.HTMLScanner.scanDocument(HTMLScanner.java:939) at net.sourceforge.htmlunit.cyberneko.HTMLConfiguration.parse(HTMLConfiguration.java:452) at net.sourceforge.htmlunit.cyberneko.HTMLConfiguration.parse(HTMLConfiguration.java:403) at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) at com.gargoylesoftware.htmlunit.html.HTMLParser$HtmlUnitDOMBuilder.parse(HTMLParser.java:1001) at com.gargoylesoftware.htmlunit.html.HTMLParser.parseFragment(HTMLParser.java:178) at com.gargoylesoftware.htmlunit.html.HTMLParser.parseFragment(HTMLParser.java:133) at com.gargoylesoftware.htmlunit.javascript.host.Element.parseHtmlSnippet(Element.java:869) at com.gargoylesoftware.htmlunit.javascript.host.Element.setInnerHTML(Element.java:921) at com.gargoylesoftware.htmlunit.javascript.host.html.HTMLElement.setInnerHTML(HTMLElement.java:653) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at net.sourceforge.htmlunit.corejs.javascript.MemberBox.invoke(MemberBox.java:158) ... 31 more Enclosed exception: java.lang.RuntimeException: Exception invoking setInnerHTML at net.sourceforge.htmlunit.corejs.javascript.MemberBox.invoke(MemberBox.java:184) at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject$GetterSlot.setValue(ScriptableObject.java:328) at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject.putImpl(ScriptableObject.java:2853) at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject.put(ScriptableObject.java:538) at com.gargoylesoftware.htmlunit.javascript.HtmlUnitScriptable.put(HtmlUnitScriptable.java:151) at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject.putProperty(ScriptableObject.java:2532) at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.setObjectProp(ScriptRuntime.java:1736) at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.setObjectProp(ScriptRuntime.java:1730) at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpretLoop(Interpreter.java:1447) at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpret(Interpreter.java:1009) at net.sourceforge.htmlunit.corejs.javascript.InterpretedFunction.call(InterpretedFunction.java:111) at net.sourceforge.htmlunit.corejs.javascript.BaseFunction.construct(BaseFunction.java:361) at net.sourceforge.htmlunit.corejs.javascript.BoundFunction.construct(BoundFunction.java:59) at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpretLoop(Interpreter.java:1718) at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpret(Interpreter.java:1009) at net.sourceforge.htmlunit.corejs.javascript.InterpretedFunction.call(InterpretedFunction.java:111) at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.doTopCall(ContextFactory.java:424) at com.gargoylesoftware.htmlunit.javascript.HtmlUnitContextFactory.doTopCall(HtmlUnitContextFactory.java:330) at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3557) at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$3.doRun(JavaScriptEngine.java:814) at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$HtmlUnitContextAction.run(JavaScriptEngine.java:877) at net.sourceforge.htmlunit.corejs.javascript.Context.call(Context.java:616) at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.call(ContextFactory.java:534) at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:821) at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:793) at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2518) at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2511) at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptFunctionJob.runJavaScript(JavaScriptFunctionJob.java:57) at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptExecutionJob.run(JavaScriptExecutionJob.java:102) at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptJobManagerImpl.runSingleJob(JavaScriptJobManagerImpl.java:424) at com.gargoylesoftware.htmlunit.javascript.background.DefaultJavaScriptExecutor.run(DefaultJavaScriptExecutor.java:144) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.NullPointerException at com.gargoylesoftware.htmlunit.javascript.host.event.EventHandler.<init>(EventHandler.java:50) at com.gargoylesoftware.htmlunit.javascript.host.Element.createEventHandler(Element.java:149) at com.gargoylesoftware.htmlunit.javascript.host.Element.setDomNode(Element.java:136) at com.gargoylesoftware.htmlunit.javascript.SimpleScriptable.makeScriptableFor(SimpleScriptable.java:238) at com.gargoylesoftware.htmlunit.html.DomNode.getScriptableObject(DomNode.java:942) at com.gargoylesoftware.htmlunit.html.HtmlPage.getAttributeValue(HtmlPage.java:1796) at com.gargoylesoftware.htmlunit.html.HtmlPage.addElement(HtmlPage.java:1767) at com.gargoylesoftware.htmlunit.html.HtmlPage.addMappedElement(HtmlPage.java:1760) at com.gargoylesoftware.htmlunit.html.HtmlPage.notifyNodeAdded(HtmlPage.java:1703) at com.gargoylesoftware.htmlunit.html.DomNode.fireAddition(DomNode.java:1082) at com.gargoylesoftware.htmlunit.html.DomNode.appendChild(DomNode.java:976) at com.gargoylesoftware.htmlunit.html.HTMLParser$HtmlUnitDOMBuilder.addNodeToRightParent(HTMLParser.java:722) at com.gargoylesoftware.htmlunit.html.HTMLParser$HtmlUnitDOMBuilder.startElement(HTMLParser.java:601) at org.apache.xerces.parsers.AbstractSAXParser.startElement(Unknown Source) at com.gargoylesoftware.htmlunit.html.HTMLParser$HtmlUnitDOMBuilder.startElement(HTMLParser.java:530) at net.sourceforge.htmlunit.cyberneko.HTMLTagBalancer.callStartElement(HTMLTagBalancer.java:1188) at net.sourceforge.htmlunit.cyberneko.HTMLTagBalancer.startElement(HTMLTagBalancer.java:791) at net.sourceforge.htmlunit.cyberneko.filters.DefaultFilter.startElement(DefaultFilter.java:142) at net.sourceforge.htmlunit.cyberneko.filters.NamespaceBinder.startElement(NamespaceBinder.java:280) at net.sourceforge.htmlunit.cyberneko.HTMLScanner$ContentScanner.scanStartElement(HTMLScanner.java:2814) at net.sourceforge.htmlunit.cyberneko.HTMLScanner$ContentScanner.scan(HTMLScanner.java:2149) at net.sourceforge.htmlunit.cyberneko.HTMLScanner.scanDocument(HTMLScanner.java:939) at net.sourceforge.htmlunit.cyberneko.HTMLConfiguration.parse(HTMLConfiguration.java:452) at net.sourceforge.htmlunit.cyberneko.HTMLConfiguration.parse(HTMLConfiguration.java:403) at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) at com.gargoylesoftware.htmlunit.html.HTMLParser$HtmlUnitDOMBuilder.parse(HTMLParser.java:1001) at com.gargoylesoftware.htmlunit.html.HTMLParser.parseFragment(HTMLParser.java:178) at com.gargoylesoftware.htmlunit.html.HTMLParser.parseFragment(HTMLParser.java:133) at com.gargoylesoftware.htmlunit.javascript.host.Element.parseHtmlSnippet(Element.java:869) at com.gargoylesoftware.htmlunit.javascript.host.Element.setInnerHTML(Element.java:921) at com.gargoylesoftware.htmlunit.javascript.host.html.HTMLElement.setInnerHTML(HTMLElement.java:653) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at net.sourceforge.htmlunit.corejs.javascript.MemberBox.invoke(MemberBox.java:158) ... 31 more == CALLING JAVASCRIPT == function () { try { l(); } catch (e) { w.Deferred.exceptionHook && w.Deferred.exceptionHook(e, c.stackTrace), t + 1 >= o && (r !== W && (s = void 0, u = [e]), n.rejectWith(s, u)); } } ======= EXCEPTION END ======== 2019-01-15 12:08:22,898 WARN javascript.JavaScriptEngine - Error during JavaScriptEngine.init(WebWindow, Context) TypeError: Cannot modify readonly property: constructor. (https://www.aarstiderne.com:443/assets/build/js/libs/jquery-3.3.1.min.js#2) prototype: HTMLOptionElement 2019-01-15 12:08:22,898 WARN javascript.JavaScriptEngine - Error during JavaScriptEngine.init(WebWindow, Context) TypeError: Cannot modify readonly property: constructor. (https://www.aarstiderne.com:443/assets/build/js/libs/jquery-3.3.1.min.js#2) prototype: MutationObserver 2019-01-15 12:08:22,899 WARN javascript.JavaScriptEngine - Error during JavaScriptEngine.init(WebWindow, Context) TypeError: Cannot modify readonly property: constructor. (https://www.aarstiderne.com:443/assets/build/js/libs/jquery-3.3.1.min.js#2) prototype: URL 2019-01-15 12:08:22,899 WARN javascript.JavaScriptEngine - Error during JavaScriptEngine.init(WebWindow, Context) TypeError: Cannot modify readonly property: constructor. (https://www.aarstiderne.com:443/assets/build/js/libs/jquery-3.3.1.min.js#2) prototype: TransitionEvent 2019-01-15 12:08:22,899 WARN javascript.JavaScriptEngine - Error during JavaScriptEngine.init(WebWindow, Context) TypeError: Cannot modify readonly property: constructor. (https://www.aarstiderne.com:443/assets/build/js/libs/jquery-3.3.1.min.js#2) prototype: AnimationEvent 2019-01-15 12:08:23,101 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'. 2019-01-15 12:08:23,148 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'. 2019-01-15 12:08:23,174 WARN css.CSSStyleSheet - Unhandled CSS condition type 'PREFIX_ATTRIBUTE_CONDITION'. Accepting it silently. 2019-01-15 12:08:23,174 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: '*,:x' error: Invalid selector: *:x).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0] 2019-01-15 12:08:23,218 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'. 2019-01-15 12:08:23,260 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'. 2019-01-15 12:08:23,329 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'. 2019-01-15 12:08:23,473 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'. 2019-01-15 12:08:23,641 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'. 2019-01-15 12:08:23,676 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'. 2019-01-15 12:08:23,756 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'. 2019-01-15 12:08:23,812 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'. 2019-01-15 12:08:23,871 INFO htmlunit.WebConsole - [iFrameSizer][Host page: etrack1floaterframe] IFrame scrolling disabled for etrack1floaterframe 2019-01-15 12:08:23,871 INFO htmlunit.WebConsole - [iFrameSizer][Host page: etrack1floaterframe] [init] Sending msg to iframe[etrack1floaterframe] (etrack1floaterframe:8:false:true:32:true:true:null:bodyOffset:null:null:0:false:parent:scroll) targetOrigin: * 2019-01-15 12:08:23,873 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Initialising iFrame (https://system.etrack1.com/FormBuilder/ContactForm.aspx?fid=f59ee0e0-c898-4750-864c-c4374a92322f&dc=65746&custdc=65746) 2019-01-15 12:08:23,873 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Reading data from page: {"targetOrigin":"*"} 2019-01-15 12:08:23,873 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] TargetOrigin for parent set to: * 2019-01-15 12:08:23,873 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] HTML & body height set to "auto" 2019-01-15 12:08:23,873 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Enable public methods 2019-01-15 12:08:23,874 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Animation Start 2019-01-15 12:08:23,874 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Animation Iteration 2019-01-15 12:08:23,874 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Animation End 2019-01-15 12:08:23,874 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Input 2019-01-15 12:08:23,874 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Mouse Up 2019-01-15 12:08:23,875 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Mouse Down 2019-01-15 12:08:23,875 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Orientation Change 2019-01-15 12:08:23,875 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Print 2019-01-15 12:08:23,875 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Ready State Change 2019-01-15 12:08:23,875 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Touch Start 2019-01-15 12:08:23,876 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Touch End 2019-01-15 12:08:23,876 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Touch Cancel 2019-01-15 12:08:23,876 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Transition Start 2019-01-15 12:08:23,876 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Transition Iteration 2019-01-15 12:08:23,877 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Transition End 2019-01-15 12:08:23,877 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Create body MutationObserver 2019-01-15 12:08:23,877 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] In page linking not enabled 2019-01-15 12:08:23,878 WARN htmlunit.WebConsole - Search config not found 2019-01-15 12:08:23,937 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.dongchatpopup:visible' error: Invalid selector: div.dongchatpopup:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0] 2019-01-15 12:08:23,942 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.chatwait:visible' error: Invalid selector: div.chatwait:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0] 2019-01-15 12:08:23,948 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes 2019-01-15 12:08:23,957 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event lock on 2019-01-15 12:08:23,958 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Sending message to host page (etrack1floaterframe:196:1256:mutationObserver) 2019-01-15 12:08:23,958 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes 2019-01-15 12:08:23,958 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes 2019-01-15 12:08:23,958 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes 2019-01-15 12:08:23,959 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes 2019-01-15 12:08:23,959 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes 2019-01-15 12:08:23,959 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLSpanElement] attributes 2019-01-15 12:08:24,091 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event lock off 2019-01-15 12:08:24,092 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] -- 2019-01-15 12:08:25,067 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.aartpopup:visible' error: Invalid selector: div.aartpopup:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0] 2019-01-15 12:08:26,563 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.aartpopup:visible' error: Invalid selector: div.aartpopup:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0] 2019-01-15 12:08:28,065 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.aartpopup:visible' error: Invalid selector: div.aartpopup:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0] 2019-01-15 12:08:29,005 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.dongchatpopup:visible' error: Invalid selector: div.dongchatpopup:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0] 2019-01-15 12:08:29,006 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.chatwait:visible' error: Invalid selector: div.chatwait:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0] 2019-01-15 12:08:29,009 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes 2019-01-15 12:08:29,009 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] No change in size detected 2019-01-15 12:08:29,010 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes 2019-01-15 12:08:29,010 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes 2019-01-15 12:08:29,010 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes 2019-01-15 12:08:29,010 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes 2019-01-15 12:08:29,010 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes 2019-01-15 12:08:29,010 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes 2019-01-15 12:08:29,010 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes 2019-01-15 12:08:29,011 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes 2019-01-15 12:08:29,011 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes 2019-01-15 12:08:29,011 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes 2019-01-15 12:08:29,011 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes 2019-01-15 12:08:29,011 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLSpanElement] attributes 2019-01-15 12:08:29,569 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.aartpopup:visible' error: Invalid selector: div.aartpopup:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0] 2019-01-15 12:08:31,061 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.aartpopup:visible' error: Invalid selector: div.aartpopup:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0] 2019-01-15 12:08:32,180 WARN parse.ParserFactory - ParserFactory: Plugin: org.apache.nutch.parse.html.HtmlParser mapped to contentType text/html via parse-plugins.xml, but not enabled via plugin.includes in nutch-default.xml 2019-01-15 12:08:32,560 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.aartpopup:visible' error: Invalid selector: div.aartpopup:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0]
Looks reproducible to me but will require some analyis.
BTW there is no benefit from calling the BrowserVersionBuilder in your case, simply use new WebClient(BrowserVersion.CHROME) instead.
Still trying to build a simple test case that reproduces this problem.
Hello RBRi, i don't know if it is of any use but this is the most mininmal HTML that still reproduces the NPE:
Looks like i have a simple case that reproduces this problem (together with ore problems). Now i can work on this.
Hello RBRi, that sounds great. If you need to, i can test patches.
The NPE exception is gone (with one of the latest snapshot builds). But i fear there are still problems with this page.
Please check....
Hello RBRi, this fixes the immediate problem of this ticket, the NPE in the EventHandler is now gone.
I'll head to the mailing list for the other problem
Thank you very much!
Ok, will close this; feel free to open new issues (on github preferred) if you have more problems.
Last edit: RBRi 2019-08-01