Hello,
We are using HtmlUnit 2.33 for dealing with Javascripted web pages and get the text on the pages, this works very well! There are, however, a set of web pages (links below) that i cannot get the text from. HtmlUnit logs a bunch of errors and throws a NPE in EventHandler constructor line 50.
Being new to HtmlUnit, i, of course, have absolutely no idea what the root of the problem is, but i'm filing a bug instead of a mailing list message due to the NPE i got.
How can we get the final recipe text which i loaded via AJAX?
Thanks!
Example pages:
https://www.aarstiderne.com/find-din-maaltidskasse/10-minutterskassen
https://www.aarstiderne.com/find-din-maaltidskasse/kvikkassen
Code:
BrowserVersion version = new BrowserVersion.BrowserVersionBuilder(BrowserVersion.CHROME).build();
WebClient client = new WebClient(version);
client.getOptions().setThrowExceptionOnScriptError(false);
client.getOptions().setCssEnabled(false);
client.getOptions().setJavaScriptEnabled(true);
client.getOptions().setDownloadImages(false);
client.getOptions().setThrowExceptionOnFailingStatusCode(false);
client.getOptions().setPrintContentOnFailingStatusCode(false);
client.getOptions().setUseInsecureSSL(true);
client.getOptions().setRedirectEnabled(false);
client.setJavaScriptTimeout(20000);
page = client.getPage(url);
synchronized(page) {
try {
page.wait(20000);
} catch (Exception e) {}
}
client.waitForBackgroundJavaScript(10000);
Log + stack trace:
2019-01-15 12:08:20,689 WARN css.CSSStyleSheet - Unhandled CSS condition type 'PREFIX_ATTRIBUTE_CONDITION'. Accepting it silently.
2019-01-15 12:08:20,696 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: '*,:x' error: Invalid selector: *:x).] sourceName=[https://www.aarstiderne.com:443/assets/build/js/libs/jquery-3.3.1.min.js] line=[2] lineSource=[null] lineOffset=[0]
2019-01-15 12:08:22,479 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'.
2019-01-15 12:08:22,537 INFO javascript.JavaScriptEngine - Caught script exception
======= EXCEPTION START ========
Exception class=[java.lang.RuntimeException]
com.gargoylesoftware.htmlunit.ScriptException: Exception invoking setInnerHTML
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$HtmlUnitContextAction.run(JavaScriptEngine.java:892)
at net.sourceforge.htmlunit.corejs.javascript.Context.call(Context.java:616)
at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.call(ContextFactory.java:534)
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:821)
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:793)
at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2518)
at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2511)
at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptFunctionJob.runJavaScript(JavaScriptFunctionJob.java:57)
at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptExecutionJob.run(JavaScriptExecutionJob.java:102)
at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptJobManagerImpl.runSingleJob(JavaScriptJobManagerImpl.java:424)
at com.gargoylesoftware.htmlunit.javascript.background.DefaultJavaScriptExecutor.run(DefaultJavaScriptExecutor.java:144)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: Exception invoking setInnerHTML
at net.sourceforge.htmlunit.corejs.javascript.MemberBox.invoke(MemberBox.java:184)
at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject$GetterSlot.setValue(ScriptableObject.java:328)
at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject.putImpl(ScriptableObject.java:2853)
at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject.put(ScriptableObject.java:538)
at com.gargoylesoftware.htmlunit.javascript.HtmlUnitScriptable.put(HtmlUnitScriptable.java:151)
at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject.putProperty(ScriptableObject.java:2532)
at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.setObjectProp(ScriptRuntime.java:1736)
at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.setObjectProp(ScriptRuntime.java:1730)
at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpretLoop(Interpreter.java:1447)
at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpret(Interpreter.java:1009)
at net.sourceforge.htmlunit.corejs.javascript.InterpretedFunction.call(InterpretedFunction.java:111)
at net.sourceforge.htmlunit.corejs.javascript.BaseFunction.construct(BaseFunction.java:361)
at net.sourceforge.htmlunit.corejs.javascript.BoundFunction.construct(BoundFunction.java:59)
at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpretLoop(Interpreter.java:1718)
at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpret(Interpreter.java:1009)
at net.sourceforge.htmlunit.corejs.javascript.InterpretedFunction.call(InterpretedFunction.java:111)
at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.doTopCall(ContextFactory.java:424)
at com.gargoylesoftware.htmlunit.javascript.HtmlUnitContextFactory.doTopCall(HtmlUnitContextFactory.java:330)
at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3557)
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$3.doRun(JavaScriptEngine.java:814)
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$HtmlUnitContextAction.run(JavaScriptEngine.java:877)
... 11 more
Caused by: java.lang.NullPointerException
at com.gargoylesoftware.htmlunit.javascript.host.event.EventHandler.<init>(EventHandler.java:50)
at com.gargoylesoftware.htmlunit.javascript.host.Element.createEventHandler(Element.java:149)
at com.gargoylesoftware.htmlunit.javascript.host.Element.setDomNode(Element.java:136)
at com.gargoylesoftware.htmlunit.javascript.SimpleScriptable.makeScriptableFor(SimpleScriptable.java:238)
at com.gargoylesoftware.htmlunit.html.DomNode.getScriptableObject(DomNode.java:942)
at com.gargoylesoftware.htmlunit.html.HtmlPage.getAttributeValue(HtmlPage.java:1796)
at com.gargoylesoftware.htmlunit.html.HtmlPage.addElement(HtmlPage.java:1767)
at com.gargoylesoftware.htmlunit.html.HtmlPage.addMappedElement(HtmlPage.java:1760)
at com.gargoylesoftware.htmlunit.html.HtmlPage.notifyNodeAdded(HtmlPage.java:1703)
at com.gargoylesoftware.htmlunit.html.DomNode.fireAddition(DomNode.java:1082)
at com.gargoylesoftware.htmlunit.html.DomNode.appendChild(DomNode.java:976)
at com.gargoylesoftware.htmlunit.html.HTMLParser$HtmlUnitDOMBuilder.addNodeToRightParent(HTMLParser.java:722)
at com.gargoylesoftware.htmlunit.html.HTMLParser$HtmlUnitDOMBuilder.startElement(HTMLParser.java:601)
at org.apache.xerces.parsers.AbstractSAXParser.startElement(Unknown Source)
at com.gargoylesoftware.htmlunit.html.HTMLParser$HtmlUnitDOMBuilder.startElement(HTMLParser.java:530)
at net.sourceforge.htmlunit.cyberneko.HTMLTagBalancer.callStartElement(HTMLTagBalancer.java:1188)
at net.sourceforge.htmlunit.cyberneko.HTMLTagBalancer.startElement(HTMLTagBalancer.java:791)
at net.sourceforge.htmlunit.cyberneko.filters.DefaultFilter.startElement(DefaultFilter.java:142)
at net.sourceforge.htmlunit.cyberneko.filters.NamespaceBinder.startElement(NamespaceBinder.java:280)
at net.sourceforge.htmlunit.cyberneko.HTMLScanner$ContentScanner.scanStartElement(HTMLScanner.java:2814)
at net.sourceforge.htmlunit.cyberneko.HTMLScanner$ContentScanner.scan(HTMLScanner.java:2149)
at net.sourceforge.htmlunit.cyberneko.HTMLScanner.scanDocument(HTMLScanner.java:939)
at net.sourceforge.htmlunit.cyberneko.HTMLConfiguration.parse(HTMLConfiguration.java:452)
at net.sourceforge.htmlunit.cyberneko.HTMLConfiguration.parse(HTMLConfiguration.java:403)
at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
at com.gargoylesoftware.htmlunit.html.HTMLParser$HtmlUnitDOMBuilder.parse(HTMLParser.java:1001)
at com.gargoylesoftware.htmlunit.html.HTMLParser.parseFragment(HTMLParser.java:178)
at com.gargoylesoftware.htmlunit.html.HTMLParser.parseFragment(HTMLParser.java:133)
at com.gargoylesoftware.htmlunit.javascript.host.Element.parseHtmlSnippet(Element.java:869)
at com.gargoylesoftware.htmlunit.javascript.host.Element.setInnerHTML(Element.java:921)
at com.gargoylesoftware.htmlunit.javascript.host.html.HTMLElement.setInnerHTML(HTMLElement.java:653)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at net.sourceforge.htmlunit.corejs.javascript.MemberBox.invoke(MemberBox.java:158)
... 31 more
Enclosed exception:
java.lang.RuntimeException: Exception invoking setInnerHTML
at net.sourceforge.htmlunit.corejs.javascript.MemberBox.invoke(MemberBox.java:184)
at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject$GetterSlot.setValue(ScriptableObject.java:328)
at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject.putImpl(ScriptableObject.java:2853)
at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject.put(ScriptableObject.java:538)
at com.gargoylesoftware.htmlunit.javascript.HtmlUnitScriptable.put(HtmlUnitScriptable.java:151)
at net.sourceforge.htmlunit.corejs.javascript.ScriptableObject.putProperty(ScriptableObject.java:2532)
at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.setObjectProp(ScriptRuntime.java:1736)
at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.setObjectProp(ScriptRuntime.java:1730)
at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpretLoop(Interpreter.java:1447)
at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpret(Interpreter.java:1009)
at net.sourceforge.htmlunit.corejs.javascript.InterpretedFunction.call(InterpretedFunction.java:111)
at net.sourceforge.htmlunit.corejs.javascript.BaseFunction.construct(BaseFunction.java:361)
at net.sourceforge.htmlunit.corejs.javascript.BoundFunction.construct(BoundFunction.java:59)
at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpretLoop(Interpreter.java:1718)
at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpret(Interpreter.java:1009)
at net.sourceforge.htmlunit.corejs.javascript.InterpretedFunction.call(InterpretedFunction.java:111)
at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.doTopCall(ContextFactory.java:424)
at com.gargoylesoftware.htmlunit.javascript.HtmlUnitContextFactory.doTopCall(HtmlUnitContextFactory.java:330)
at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3557)
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$3.doRun(JavaScriptEngine.java:814)
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$HtmlUnitContextAction.run(JavaScriptEngine.java:877)
at net.sourceforge.htmlunit.corejs.javascript.Context.call(Context.java:616)
at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.call(ContextFactory.java:534)
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:821)
at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:793)
at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2518)
at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2511)
at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptFunctionJob.runJavaScript(JavaScriptFunctionJob.java:57)
at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptExecutionJob.run(JavaScriptExecutionJob.java:102)
at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptJobManagerImpl.runSingleJob(JavaScriptJobManagerImpl.java:424)
at com.gargoylesoftware.htmlunit.javascript.background.DefaultJavaScriptExecutor.run(DefaultJavaScriptExecutor.java:144)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
at com.gargoylesoftware.htmlunit.javascript.host.event.EventHandler.<init>(EventHandler.java:50)
at com.gargoylesoftware.htmlunit.javascript.host.Element.createEventHandler(Element.java:149)
at com.gargoylesoftware.htmlunit.javascript.host.Element.setDomNode(Element.java:136)
at com.gargoylesoftware.htmlunit.javascript.SimpleScriptable.makeScriptableFor(SimpleScriptable.java:238)
at com.gargoylesoftware.htmlunit.html.DomNode.getScriptableObject(DomNode.java:942)
at com.gargoylesoftware.htmlunit.html.HtmlPage.getAttributeValue(HtmlPage.java:1796)
at com.gargoylesoftware.htmlunit.html.HtmlPage.addElement(HtmlPage.java:1767)
at com.gargoylesoftware.htmlunit.html.HtmlPage.addMappedElement(HtmlPage.java:1760)
at com.gargoylesoftware.htmlunit.html.HtmlPage.notifyNodeAdded(HtmlPage.java:1703)
at com.gargoylesoftware.htmlunit.html.DomNode.fireAddition(DomNode.java:1082)
at com.gargoylesoftware.htmlunit.html.DomNode.appendChild(DomNode.java:976)
at com.gargoylesoftware.htmlunit.html.HTMLParser$HtmlUnitDOMBuilder.addNodeToRightParent(HTMLParser.java:722)
at com.gargoylesoftware.htmlunit.html.HTMLParser$HtmlUnitDOMBuilder.startElement(HTMLParser.java:601)
at org.apache.xerces.parsers.AbstractSAXParser.startElement(Unknown Source)
at com.gargoylesoftware.htmlunit.html.HTMLParser$HtmlUnitDOMBuilder.startElement(HTMLParser.java:530)
at net.sourceforge.htmlunit.cyberneko.HTMLTagBalancer.callStartElement(HTMLTagBalancer.java:1188)
at net.sourceforge.htmlunit.cyberneko.HTMLTagBalancer.startElement(HTMLTagBalancer.java:791)
at net.sourceforge.htmlunit.cyberneko.filters.DefaultFilter.startElement(DefaultFilter.java:142)
at net.sourceforge.htmlunit.cyberneko.filters.NamespaceBinder.startElement(NamespaceBinder.java:280)
at net.sourceforge.htmlunit.cyberneko.HTMLScanner$ContentScanner.scanStartElement(HTMLScanner.java:2814)
at net.sourceforge.htmlunit.cyberneko.HTMLScanner$ContentScanner.scan(HTMLScanner.java:2149)
at net.sourceforge.htmlunit.cyberneko.HTMLScanner.scanDocument(HTMLScanner.java:939)
at net.sourceforge.htmlunit.cyberneko.HTMLConfiguration.parse(HTMLConfiguration.java:452)
at net.sourceforge.htmlunit.cyberneko.HTMLConfiguration.parse(HTMLConfiguration.java:403)
at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
at com.gargoylesoftware.htmlunit.html.HTMLParser$HtmlUnitDOMBuilder.parse(HTMLParser.java:1001)
at com.gargoylesoftware.htmlunit.html.HTMLParser.parseFragment(HTMLParser.java:178)
at com.gargoylesoftware.htmlunit.html.HTMLParser.parseFragment(HTMLParser.java:133)
at com.gargoylesoftware.htmlunit.javascript.host.Element.parseHtmlSnippet(Element.java:869)
at com.gargoylesoftware.htmlunit.javascript.host.Element.setInnerHTML(Element.java:921)
at com.gargoylesoftware.htmlunit.javascript.host.html.HTMLElement.setInnerHTML(HTMLElement.java:653)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at net.sourceforge.htmlunit.corejs.javascript.MemberBox.invoke(MemberBox.java:158)
... 31 more
== CALLING JAVASCRIPT ==
function () {
try {
l();
}
catch (e) {
w.Deferred.exceptionHook && w.Deferred.exceptionHook(e, c.stackTrace), t + 1 >= o && (r !== W && (s = void 0, u = [e]), n.rejectWith(s, u));
}
}
======= EXCEPTION END ========
2019-01-15 12:08:22,898 WARN javascript.JavaScriptEngine - Error during JavaScriptEngine.init(WebWindow, Context)
TypeError: Cannot modify readonly property: constructor. (https://www.aarstiderne.com:443/assets/build/js/libs/jquery-3.3.1.min.js#2)
prototype: HTMLOptionElement
2019-01-15 12:08:22,898 WARN javascript.JavaScriptEngine - Error during JavaScriptEngine.init(WebWindow, Context)
TypeError: Cannot modify readonly property: constructor. (https://www.aarstiderne.com:443/assets/build/js/libs/jquery-3.3.1.min.js#2)
prototype: MutationObserver
2019-01-15 12:08:22,899 WARN javascript.JavaScriptEngine - Error during JavaScriptEngine.init(WebWindow, Context)
TypeError: Cannot modify readonly property: constructor. (https://www.aarstiderne.com:443/assets/build/js/libs/jquery-3.3.1.min.js#2)
prototype: URL
2019-01-15 12:08:22,899 WARN javascript.JavaScriptEngine - Error during JavaScriptEngine.init(WebWindow, Context)
TypeError: Cannot modify readonly property: constructor. (https://www.aarstiderne.com:443/assets/build/js/libs/jquery-3.3.1.min.js#2)
prototype: TransitionEvent
2019-01-15 12:08:22,899 WARN javascript.JavaScriptEngine - Error during JavaScriptEngine.init(WebWindow, Context)
TypeError: Cannot modify readonly property: constructor. (https://www.aarstiderne.com:443/assets/build/js/libs/jquery-3.3.1.min.js#2)
prototype: AnimationEvent
2019-01-15 12:08:23,101 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'.
2019-01-15 12:08:23,148 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'.
2019-01-15 12:08:23,174 WARN css.CSSStyleSheet - Unhandled CSS condition type 'PREFIX_ATTRIBUTE_CONDITION'. Accepting it silently.
2019-01-15 12:08:23,174 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: '*,:x' error: Invalid selector: *:x).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0]
2019-01-15 12:08:23,218 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'.
2019-01-15 12:08:23,260 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'.
2019-01-15 12:08:23,329 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'.
2019-01-15 12:08:23,473 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'.
2019-01-15 12:08:23,641 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'.
2019-01-15 12:08:23,676 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'.
2019-01-15 12:08:23,756 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'.
2019-01-15 12:08:23,812 WARN htmlunit.IncorrectnessListenerImpl - Obsolete content type encountered: 'application/x-javascript'.
2019-01-15 12:08:23,871 INFO htmlunit.WebConsole - [iFrameSizer][Host page: etrack1floaterframe] IFrame scrolling disabled for etrack1floaterframe
2019-01-15 12:08:23,871 INFO htmlunit.WebConsole - [iFrameSizer][Host page: etrack1floaterframe] [init] Sending msg to iframe[etrack1floaterframe] (etrack1floaterframe:8:false:true:32:true:true:null:bodyOffset:null:null:0:false:parent:scroll) targetOrigin: *
2019-01-15 12:08:23,873 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Initialising iFrame (https://system.etrack1.com/FormBuilder/ContactForm.aspx?fid=f59ee0e0-c898-4750-864c-c4374a92322f&dc=65746&custdc=65746)
2019-01-15 12:08:23,873 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Reading data from page: {"targetOrigin":"*"}
2019-01-15 12:08:23,873 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] TargetOrigin for parent set to: *
2019-01-15 12:08:23,873 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] HTML & body height set to "auto"
2019-01-15 12:08:23,873 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Enable public methods
2019-01-15 12:08:23,874 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Animation Start
2019-01-15 12:08:23,874 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Animation Iteration
2019-01-15 12:08:23,874 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Animation End
2019-01-15 12:08:23,874 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Input
2019-01-15 12:08:23,874 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Mouse Up
2019-01-15 12:08:23,875 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Mouse Down
2019-01-15 12:08:23,875 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Orientation Change
2019-01-15 12:08:23,875 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Print
2019-01-15 12:08:23,875 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Ready State Change
2019-01-15 12:08:23,875 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Touch Start
2019-01-15 12:08:23,876 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Touch End
2019-01-15 12:08:23,876 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Touch Cancel
2019-01-15 12:08:23,876 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Transition Start
2019-01-15 12:08:23,876 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Transition Iteration
2019-01-15 12:08:23,877 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Add event listener: Transition End
2019-01-15 12:08:23,877 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Create body MutationObserver
2019-01-15 12:08:23,877 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] In page linking not enabled
2019-01-15 12:08:23,878 WARN htmlunit.WebConsole - Search config not found
2019-01-15 12:08:23,937 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.dongchatpopup:visible' error: Invalid selector: div.dongchatpopup:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0]
2019-01-15 12:08:23,942 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.chatwait:visible' error: Invalid selector: div.chatwait:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0]
2019-01-15 12:08:23,948 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes
2019-01-15 12:08:23,957 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event lock on
2019-01-15 12:08:23,958 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Sending message to host page (etrack1floaterframe:196:1256:mutationObserver)
2019-01-15 12:08:23,958 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes
2019-01-15 12:08:23,958 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes
2019-01-15 12:08:23,958 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes
2019-01-15 12:08:23,959 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes
2019-01-15 12:08:23,959 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes
2019-01-15 12:08:23,959 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLSpanElement] attributes
2019-01-15 12:08:24,091 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event lock off
2019-01-15 12:08:24,092 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] --
2019-01-15 12:08:25,067 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.aartpopup:visible' error: Invalid selector: div.aartpopup:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0]
2019-01-15 12:08:26,563 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.aartpopup:visible' error: Invalid selector: div.aartpopup:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0]
2019-01-15 12:08:28,065 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.aartpopup:visible' error: Invalid selector: div.aartpopup:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0]
2019-01-15 12:08:29,005 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.dongchatpopup:visible' error: Invalid selector: div.dongchatpopup:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0]
2019-01-15 12:08:29,006 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.chatwait:visible' error: Invalid selector: div.chatwait:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0]
2019-01-15 12:08:29,009 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes
2019-01-15 12:08:29,009 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] No change in size detected
2019-01-15 12:08:29,010 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes
2019-01-15 12:08:29,010 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes
2019-01-15 12:08:29,010 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes
2019-01-15 12:08:29,010 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes
2019-01-15 12:08:29,010 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes
2019-01-15 12:08:29,010 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes
2019-01-15 12:08:29,010 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes
2019-01-15 12:08:29,011 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes
2019-01-15 12:08:29,011 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes
2019-01-15 12:08:29,011 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes
2019-01-15 12:08:29,011 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLDivElement] attributes
2019-01-15 12:08:29,011 INFO htmlunit.WebConsole - [iFrameSizer][etrack1floaterframe] Trigger event: mutationObserver: [object HTMLSpanElement] attributes
2019-01-15 12:08:29,569 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.aartpopup:visible' error: Invalid selector: div.aartpopup:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0]
2019-01-15 12:08:31,061 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.aartpopup:visible' error: Invalid selector: div.aartpopup:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0]
2019-01-15 12:08:32,180 WARN parse.ParserFactory - ParserFactory: Plugin: org.apache.nutch.parse.html.HtmlParser mapped to contentType text/html via parse-plugins.xml, but not enabled via plugin.includes in nutch-default.xml
2019-01-15 12:08:32,560 ERROR javascript.StrictErrorReporter - runtimeError: message=[An invalid or illegal selector was specified (selector: 'div.aartpopup:visible' error: Invalid selector: div.aartpopup:visible).] sourceName=[https://system.etrack1.com/Support/jQuery/jquery-1.9.1.min.js] line=[4] lineSource=[null] lineOffset=[0]
Looks reproducible to me but will require some analyis.
BTW there is no benefit from calling the BrowserVersionBuilder in your case, simply use new WebClient(BrowserVersion.CHROME) instead.
Still trying to build a simple test case that reproduces this problem.
Hello RBRi, i don't know if it is of any use but this is the most mininmal HTML that still reproduces the NPE:
Looks like i have a simple case that reproduces this problem (together with ore problems). Now i can work on this.
Hello RBRi, that sounds great. If you need to, i can test patches.
The NPE exception is gone (with one of the latest snapshot builds). But i fear there are still problems with this page.
Please check....
Hello RBRi, this fixes the immediate problem of this ticket, the NPE in the EventHandler is now gone.
I'll head to the mailing list for the other problem
Thank you very much!
Ok, will close this; feel free to open new issues (on github preferred) if you have more problems.
Last edit: RBRi 2019-08-01