htmlunit-user Mailing List for HtmlUnit (Page 5)

Java GUI-Less browser, supporting JavaScript, to run against web pages

Brought to you by: asashour, bradclarke, mbowler, mguillem, and 2 others

htmlunit-user — Discussion of the use of HtmlUnit

You can subscribe to this list here.

2003	Jan	Feb	Mar	Apr	May	Jun (6)	Jul (17)	Aug (18)	Sep (22)	Oct (16)	Nov (6)	Dec (11)
2004	Jan (11)	Feb (10)	Mar (34)	Apr (26)	May (6)	Jun (22)	Jul (14)	Aug (4)	Sep (47)	Oct (69)	Nov (23)	Dec (21)
2005	Jan (53)	Feb (33)	Mar (92)	Apr (65)	May (63)	Jun (57)	Jul (43)	Aug (132)	Sep (61)	Oct (75)	Nov (60)	Dec (130)
2006	Jan (74)	Feb (87)	Mar (101)	Apr (58)	May (54)	Jun (42)	Jul (31)	Aug (67)	Sep (61)	Oct (71)	Nov (28)	Dec (58)
2007	Jan (53)	Feb (50)	Mar (96)	Apr (66)	May (55)	Jun (130)	Jul (99)	Aug (115)	Sep (37)	Oct (78)	Nov (24)	Dec (70)
2008	Jan (94)	Feb (85)	Mar (197)	Apr (274)	May (119)	Jun (143)	Jul (193)	Aug (99)	Sep (160)	Oct (120)	Nov (178)	Dec (109)
2009	Jan (238)	Feb (169)	Mar (115)	Apr (109)	May (131)	Jun (167)	Jul (144)	Aug (193)	Sep (155)	Oct (154)	Nov (97)	Dec (127)
2010	Jan (108)	Feb (127)	Mar (176)	Apr (113)	May (130)	Jun (200)	Jul (115)	Aug (80)	Sep (92)	Oct (101)	Nov (124)	Dec (53)
2011	Jan (67)	Feb (144)	Mar (88)	Apr (60)	May (89)	Jun (54)	Jul (68)	Aug (81)	Sep (48)	Oct (40)	Nov (10)	Dec (20)
2012	Jan (21)	Feb (28)	Mar (17)	Apr (35)	May (41)	Jun (44)	Jul (68)	Aug (67)	Sep (89)	Oct (58)	Nov (47)	Dec (56)
2013	Jan (49)	Feb (28)	Mar (46)	Apr (31)	May (28)	Jun (37)	Jul (34)	Aug (52)	Sep (42)	Oct (108)	Nov (59)	Dec (56)
2014	Jan (41)	Feb (72)	Mar (46)	Apr (21)	May (19)	Jun (17)	Jul (15)	Aug (40)	Sep (11)	Oct (3)	Nov (5)	Dec (31)
2015	Jan (11)	Feb (12)	Mar (19)	Apr (19)	May (38)	Jun (54)	Jul (14)	Aug (42)	Sep (14)	Oct (16)	Nov (26)	Dec (14)
2016	Jan (3)	Feb (1)	Mar (24)	Apr (5)	May (15)	Jun (14)	Jul (33)	Aug (19)	Sep (8)	Oct (10)	Nov	Dec (2)
2017	Jan (16)	Feb (12)	Mar (23)	Apr (8)	May (11)	Jun (20)	Jul (21)	Aug (20)	Sep	Oct (6)	Nov (9)	Dec (2)
2018	Jan (7)	Feb (5)	Mar (6)	Apr (5)	May (1)	Jun (2)	Jul (2)	Aug	Sep (4)	Oct (3)	Nov	Dec (4)
2019	Jan (2)	Feb (2)	Mar (3)	Apr (4)	May	Jun (4)	Jul (9)	Aug (2)	Sep	Oct (4)	Nov (1)	Dec (7)
2020	Jan (2)	Feb (6)	Mar (9)	Apr (1)	May (1)	Jun (15)	Jul (1)	Aug (1)	Sep (2)	Oct (6)	Nov (3)	Dec (5)
2021	Jan (3)	Feb (1)	Mar (2)	Apr (1)	May	Jun (1)	Jul (1)	Aug (3)	Sep (1)	Oct	Nov (1)	Dec
2022	Jan	Feb	Mar	Apr	May (2)	Jun (1)	Jul (4)	Aug	Sep	Oct	Nov (1)	Dec (6)
2025	Jan	Feb	Mar	Apr	May	Jun (1)	Jul	Aug	Sep	Oct	Nov	Dec

Flat | Threaded

<< < 1 .. 3 4 5 6 7 .. 425 > >> (Page 5 of 425)

Re: [Htmlunit-user] ClassCastException, unable to obtain hyperlinks added to the DOM by Javascript

From: Ronald B. <rb...@rb...> - 2019-07-21 12:24:58

On Mon, 15 Jul 2019 16:21:57 +0000 Markus Jelsma wrote:
>
>Caused by: java.lang.ClassCastException: org.apache.xerces.jaxp.DocumentBuilderFactoryImpl cannot be cast to javax.xml.parsers.DocumentBuilderFactory
>

This usuall point to a classpath problem (or some other module instanziating a different XMLParser as the one (Xerxes) HtmlUnit requires.



    RBRi
    --------------------------
    WETATOR
    Smart web application testing
    http://www.wetator.org

Re: [Htmlunit-user] Does HTMLUnit support Content-Encoding to br in HTTP Response

From: Ronald B. <rb...@rb...> - 2019-07-21 12:16:39

>   Does HTMLUnit support Content-Encoding set to br?. If so, which version
>of
>   HTMLUnit has the feature.

Of course ;-) you need the latest snapshot i made available 10 mins ago.


    RBRi
    --------------------------
    WETATOR
    Smart web application testing
    http://www.wetator.org

[Htmlunit-user] Does HTMLUnit support Content-Encoding to br in HTTP Response

From: Vasudevan C. <vco...@gm...> - 2019-07-19 17:18:30

All,

   Does HTMLUnit support Content-Encoding set to br?. If so, which version
of
   HTMLUnit has the feature.

   Looking forward to hearing from you.

Regards
 Vasu

[Htmlunit-user] ClassCastException, unable to obtain hyperlinks added to the DOM by Javascript

From: Markus J. <mar...@op...> - 2019-07-15 16:37:59

Hello,

I am using HtmlUnit 2.35.0 and need to find the hyperlinks that are added to the DOM by some Javascript code. I am not sure if the exception (see blow) is also the reason i can't get the webpage's outlinks. We have no problem getting dynamically generated links on other websites.

Should i open an issue? Do something else?

Thanks,
Markus

======= EXCEPTION START ========
Exception class=[java.lang.RuntimeException]
com.gargoylesoftware.htmlunit.ScriptException: Exception invoking parseFromString
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$HtmlUnitContextAction.run(JavaScriptEngine.java:885)
        at net.sourceforge.htmlunit.corejs.javascript.Context.call(Context.java:617)
        at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.call(ContextFactory.java:534)
        at com.gargoylesoftware.htmlunit.javascript.HtmlUnitContextFactory.callSecured(HtmlUnitContextFactory.java:336)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:814)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:786)
        at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2534)
        at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2527)
        at com.gargoylesoftware.htmlunit.javascript.host.event.EventListenersContainer.executeEventListeners(EventListenersContainer.java:342)
        at com.gargoylesoftware.htmlunit.javascript.host.event.EventListenersContainer.executeAtTargetListeners(EventListenersContainer.java:379)
        at com.gargoylesoftware.htmlunit.javascript.host.event.EventTarget.executeEventLocally(EventTarget.java:100)
        at com.gargoylesoftware.htmlunit.html.HtmlScript.executeEvent(HtmlScript.java:414)
        at com.gargoylesoftware.htmlunit.html.HtmlScript.executeScriptIfNeeded(HtmlScript.java:380)
        at com.gargoylesoftware.htmlunit.html.HtmlScript$2.execute(HtmlScript.java:247)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.doProcessPostponedActions(JavaScriptEngine.java:936)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.access$200(JavaScriptEngine.java:104)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$HtmlUnitContextAction.run(JavaScriptEngine.java:880)
        at net.sourceforge.htmlunit.corejs.javascript.Context.call(Context.java:617)
        at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.call(ContextFactory.java:534)
        at com.gargoylesoftware.htmlunit.javascript.HtmlUnitContextFactory.callSecured(HtmlUnitContextFactory.java:336)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:814)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:786)
        at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2534)
        at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2527)
        at com.gargoylesoftware.htmlunit.javascript.host.event.EventListenersContainer.executeEventListeners(EventListenersContainer.java:342)
        at com.gargoylesoftware.htmlunit.javascript.host.event.EventListenersContainer.executeAtTargetListeners(EventListenersContainer.java:379)
        at com.gargoylesoftware.htmlunit.javascript.host.event.EventTarget.executeEventLocally(EventTarget.java:100)
        at com.gargoylesoftware.htmlunit.html.HtmlScript.executeEvent(HtmlScript.java:414)
        at com.gargoylesoftware.htmlunit.html.HtmlScript.executeScriptIfNeeded(HtmlScript.java:380)
        at com.gargoylesoftware.htmlunit.html.HtmlScript$2.execute(HtmlScript.java:247)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.doProcessPostponedActions(JavaScriptEngine.java:936)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.access$200(JavaScriptEngine.java:104)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$HtmlUnitContextAction.run(JavaScriptEngine.java:880)
        at net.sourceforge.htmlunit.corejs.javascript.Context.call(Context.java:617)
        at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.call(ContextFactory.java:534)
        at com.gargoylesoftware.htmlunit.javascript.HtmlUnitContextFactory.callSecured(HtmlUnitContextFactory.java:336)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:814)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:786)
        at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2534)
        at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2527)
        at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptFunctionJob.runJavaScript(JavaScriptFunctionJob.java:57)
        at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptExecutionJob.run(JavaScriptExecutionJob.java:102)
        at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptJobManagerImpl.runSingleJob(JavaScriptJobManagerImpl.java:424)
        at com.gargoylesoftware.htmlunit.javascript.background.DefaultJavaScriptExecutor.run(DefaultJavaScriptExecutor.java:148)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: Exception invoking parseFromString
        at net.sourceforge.htmlunit.corejs.javascript.MemberBox.invoke(MemberBox.java:200)
        at net.sourceforge.htmlunit.corejs.javascript.FunctionObject.call(FunctionObject.java:453)
        at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpretLoop(Interpreter.java:1675)
        at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpret(Interpreter.java:1010)
        at net.sourceforge.htmlunit.corejs.javascript.InterpretedFunction.call(InterpretedFunction.java:111)
        at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.doTopCall(ContextFactory.java:424)
        at com.gargoylesoftware.htmlunit.javascript.HtmlUnitContextFactory.doTopCall(HtmlUnitContextFactory.java:322)
        at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3628)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$3.doRun(JavaScriptEngine.java:807)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$HtmlUnitContextAction.run(JavaScriptEngine.java:870)
        ... 44 more
Caused by: java.lang.ClassCastException: org.apache.xerces.jaxp.DocumentBuilderFactoryImpl cannot be cast to javax.xml.parsers.DocumentBuilderFactory
        at javax.xml.parsers.DocumentBuilderFactory.newInstance(Unknown Source)
        at com.gargoylesoftware.htmlunit.xml.XmlUtil.buildDocument(XmlUtil.java:139)
        at com.gargoylesoftware.htmlunit.xml.XmlPage.<init>(XmlPage.java:123)
        at com.gargoylesoftware.htmlunit.xml.XmlPage.<init>(XmlPage.java:102)
        at com.gargoylesoftware.htmlunit.javascript.host.xml.XMLDocument.createParserErrorXmlPage(XMLDocument.java:202)
        at com.gargoylesoftware.htmlunit.javascript.host.xml.XMLDocument.loadXML(XMLDocument.java:181)
        at com.gargoylesoftware.htmlunit.javascript.host.dom.DOMParser.parseFromString(DOMParser.java:70)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at net.sourceforge.htmlunit.corejs.javascript.MemberBox.invoke(MemberBox.java:174)
        ... 53 more
Enclosed exception: 
java.lang.RuntimeException: Exception invoking parseFromString
        at net.sourceforge.htmlunit.corejs.javascript.MemberBox.invoke(MemberBox.java:200)
        at net.sourceforge.htmlunit.corejs.javascript.FunctionObject.call(FunctionObject.java:453)
        at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpretLoop(Interpreter.java:1675)
        at net.sourceforge.htmlunit.corejs.javascript.Interpreter.interpret(Interpreter.java:1010)
        at net.sourceforge.htmlunit.corejs.javascript.InterpretedFunction.call(InterpretedFunction.java:111)
        at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.doTopCall(ContextFactory.java:424)
        at com.gargoylesoftware.htmlunit.javascript.HtmlUnitContextFactory.doTopCall(HtmlUnitContextFactory.java:322)
        at net.sourceforge.htmlunit.corejs.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3628)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$3.doRun(JavaScriptEngine.java:807)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$HtmlUnitContextAction.run(JavaScriptEngine.java:870)
        at net.sourceforge.htmlunit.corejs.javascript.Context.call(Context.java:617)
        at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.call(ContextFactory.java:534)
        at com.gargoylesoftware.htmlunit.javascript.HtmlUnitContextFactory.callSecured(HtmlUnitContextFactory.java:336)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:814)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:786)
        at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2534)
        at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2527)
        at com.gargoylesoftware.htmlunit.javascript.host.event.EventListenersContainer.executeEventListeners(EventListenersContainer.java:342)
        at com.gargoylesoftware.htmlunit.javascript.host.event.EventListenersContainer.executeAtTargetListeners(EventListenersContainer.java:379)
        at com.gargoylesoftware.htmlunit.javascript.host.event.EventTarget.executeEventLocally(EventTarget.java:100)
        at com.gargoylesoftware.htmlunit.html.HtmlScript.executeEvent(HtmlScript.java:414)
        at com.gargoylesoftware.htmlunit.html.HtmlScript.executeScriptIfNeeded(HtmlScript.java:380)
        at com.gargoylesoftware.htmlunit.html.HtmlScript$2.execute(HtmlScript.java:247)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.doProcessPostponedActions(JavaScriptEngine.java:936)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.access$200(JavaScriptEngine.java:104)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$HtmlUnitContextAction.run(JavaScriptEngine.java:880)
        at net.sourceforge.htmlunit.corejs.javascript.Context.call(Context.java:617)
        at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.call(ContextFactory.java:534)
        at com.gargoylesoftware.htmlunit.javascript.HtmlUnitContextFactory.callSecured(HtmlUnitContextFactory.java:336)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:814)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:786)
        at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2534)
        at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2527)
        at com.gargoylesoftware.htmlunit.javascript.host.event.EventListenersContainer.executeEventListeners(EventListenersContainer.java:342)
        at com.gargoylesoftware.htmlunit.javascript.host.event.EventListenersContainer.executeAtTargetListeners(EventListenersContainer.java:379)
        at com.gargoylesoftware.htmlunit.javascript.host.event.EventTarget.executeEventLocally(EventTarget.java:100)
        at com.gargoylesoftware.htmlunit.html.HtmlScript.executeEvent(HtmlScript.java:414)
        at com.gargoylesoftware.htmlunit.html.HtmlScript.executeScriptIfNeeded(HtmlScript.java:380)
        at com.gargoylesoftware.htmlunit.html.HtmlScript$2.execute(HtmlScript.java:247)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.doProcessPostponedActions(JavaScriptEngine.java:936)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.access$200(JavaScriptEngine.java:104)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine$HtmlUnitContextAction.run(JavaScriptEngine.java:880)
        at net.sourceforge.htmlunit.corejs.javascript.Context.call(Context.java:617)
        at net.sourceforge.htmlunit.corejs.javascript.ContextFactory.call(ContextFactory.java:534)
        at com.gargoylesoftware.htmlunit.javascript.HtmlUnitContextFactory.callSecured(HtmlUnitContextFactory.java:336)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:814)
        at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:786)
        at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2534)
        at com.gargoylesoftware.htmlunit.html.HtmlPage.executeJavaScriptFunction(HtmlPage.java:2527)
        at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptFunctionJob.runJavaScript(JavaScriptFunctionJob.java:57)
        at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptExecutionJob.run(JavaScriptExecutionJob.java:102)
        at com.gargoylesoftware.htmlunit.javascript.background.JavaScriptJobManagerImpl.runSingleJob(JavaScriptJobManagerImpl.java:424)
        at com.gargoylesoftware.htmlunit.javascript.background.DefaultJavaScriptExecutor.run(DefaultJavaScriptExecutor.java:148)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassCastException: org.apache.xerces.jaxp.DocumentBuilderFactoryImpl cannot be cast to javax.xml.parsers.DocumentBuilderFactory
        at javax.xml.parsers.DocumentBuilderFactory.newInstance(Unknown Source)
        at com.gargoylesoftware.htmlunit.xml.XmlUtil.buildDocument(XmlUtil.java:139)
        at com.gargoylesoftware.htmlunit.xml.XmlPage.<init>(XmlPage.java:123)
        at com.gargoylesoftware.htmlunit.xml.XmlPage.<init>(XmlPage.java:102)
        at com.gargoylesoftware.htmlunit.javascript.host.xml.XMLDocument.createParserErrorXmlPage(XMLDocument.java:202)
        at com.gargoylesoftware.htmlunit.javascript.host.xml.XMLDocument.loadXML(XMLDocument.java:181)
        at com.gargoylesoftware.htmlunit.javascript.host.dom.DOMParser.parseFromString(DOMParser.java:70)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at net.sourceforge.htmlunit.corejs.javascript.MemberBox.invoke(MemberBox.java:174)
        ... 53 more
== CALLING JAVASCRIPT ==
  function (e) {
      if ("load" === e.type || readyRegExp.test((e.currentTarget || e.srcElement).readyState)) {
          interactiveScript = null;
          var t = s(e);
          l.completeLoad(t.id);
      }
  }
======= EXCEPTION END ========

[Htmlunit-user] Fwd: HTMLUNIT 2.33 version throwing error for application/pdf content-type and content-encoding is gzip-only-text/html

From: Vasudevan C. <vco...@gm...> - 2019-06-06 13:08:23

KIndly Ignore the below mail. The problem is solved in HTMLUnit 2.35
version.

Thanks in advance for solving this issue.

Regards
 Vasu
---------- Forwarded message ---------
From: Vasudevan Comandur <vco...@gm...>
Date: Thu, 6 Jun 2019 at 17:13
Subject: HTMLUNIT 2.33 version throwing error for application/pdf
content-type and content-encoding is gzip-only-text/html
To: <htm...@li...>


All,

    Received a PDF file with content-encoding is gzip-only-text/html and
HTML
    unit treats this as GZIP stream.
    Copied below is the error trace.
     Looking forward to your response

Regards
 Vasu

2019-06-06 17:04:20,171 [Actor Thread 1] ERROR htmlunit.WebResponseData  -
Reading gzip encodec content failed
.
Message: Not in GZIP format
    Line | Method
->>  165 | readHeader                    in java.util.zip.GZIPInputStream
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
|     79 | <init>                        in     ''
|     91 | <init> . . . . . . . . . . .  in     ''
|    104 | getStream                     in
com.gargoylesoftware.htmlunit.WebResponseData
|    171 | getInputStream . . . . . . .  in     ''
|    272 | getContentAsStream            in
com.gargoylesoftware.htmlunit.WebResponse

[Htmlunit-user] HTMLUNIT 2.33 version throwing error for application/pdf content-type and content-encoding is gzip-only-text/html

From: Vasudevan C. <vco...@gm...> - 2019-06-06 11:44:06

All,

    Received a PDF file with content-encoding is gzip-only-text/html and
HTML
    unit treats this as GZIP stream.
    Copied below is the error trace.
     Looking forward to your response

Regards
 Vasu

2019-06-06 17:04:20,171 [Actor Thread 1] ERROR htmlunit.WebResponseData  -
Reading gzip encodec content failed
.
Message: Not in GZIP format
    Line | Method
->>  165 | readHeader                    in java.util.zip.GZIPInputStream
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
|     79 | <init>                        in     ''
|     91 | <init> . . . . . . . . . . .  in     ''
|    104 | getStream                     in
com.gargoylesoftware.htmlunit.WebResponseData
|    171 | getInputStream . . . . . . .  in     ''
|    272 | getContentAsStream            in
com.gargoylesoftware.htmlunit.WebResponse

Re: [Htmlunit-user] Getting NoSuchMethodError exception in HTMLUnit 2.33

From: <rb...@rb...> - 2019-06-05 16:29:51

Am 5. Juni 2019 15:16:15 MESZ schrieb Vasudevan Comandur <vco...@gm...>:
>Hi,
>
>   I was migrating my web application from HTMLUnit 2.23 to 2.33.
> The project was built and while executing getContentAsString method on
>   WebResponse, I am getting the Error mentioned in the subject line.
>
>    Below is the error copied from the console
>
>   Caused by NoSuchMethodError:
>org.apache.commons.io.IOUtils.toString(Ljava/io/InputStream;Ljava/nio/charset/Cha
>rset;)Ljava/lang/String;
>->>  244 | getContentAsString in
>com.gargoylesoftware.htmlunit.WebResponse
>
>Am I doing something wrong?. All the dependent libraries are there in
>the
>project.
>
>  I appreciate your help in advance.
>
>Regards
> Vasu

Looks like a wrong version or duplicate commons io jar in the classpath

[Htmlunit-user] Getting NoSuchMethodError exception in HTMLUnit 2.33

From: Vasudevan C. <vco...@gm...> - 2019-06-05 13:16:37

Hi,

   I was migrating my web application from HTMLUnit 2.23 to 2.33.
   The project was built and while executing getContentAsString method on
   WebResponse, I am getting the Error mentioned in the subject line.

    Below is the error copied from the console

   Caused by NoSuchMethodError:
org.apache.commons.io.IOUtils.toString(Ljava/io/InputStream;Ljava/nio/charset/Cha
rset;)Ljava/lang/String;
->>  244 | getContentAsString in com.gargoylesoftware.htmlunit.WebResponse

 Am I doing something wrong?. All the dependent libraries are there in the
project.

  I appreciate your help in advance.

Regards
 Vasu

[Htmlunit-user] [ANN] HtmlUnit 2.35.0 released

From: Ronald B. <rb...@rb...> - 2019-04-16 18:51:11

Hi all,

it is a pleasure to announce the availability of HtmlUnit 2.35.0.
The main enhancements are:
  - again resync with Rhino and various Javascript improvements
  - Neko and CssParser improvments
  - as always various fixes, specially with JavaScript

The full list of changes can be found in [1]
Thanks to all the contributors.

Happy Testing/Scraping!
   The HtmlUnit team

[1] http://htmlunit.sourceforge.net/changes-report.html#a2.35.0

[Htmlunit-user] Does HTMLUnit support application/hal+json Content-Type?

From: Vasudevan C. <vco...@gm...> - 2019-04-15 19:57:04

Hi,

   Does HTMLUnit support application/hal+json content-type in Response
header?

Regards
 Vasu

[Htmlunit-user] Getting text from AngularJS site

From: Markus J. <mar...@op...> - 2019-04-02 11:07:25

Hello,

We extract text from various websites, including a Danish site for recipies etc. Using HtmlUnit 2.34.1 we got stopped by NPE but this is now fixed [2].

However, we still cannot get text from the HTML. With debug logging on, we do see the recipe text of [1] being downloaded from some API [3]. But then it is up to Javascript to inject the text into the DOM, which doesn't appear to happen.

I tried many variations in the code, different waits, very long waits but nothing seems to be working here. There are exceptions but they seem unrelated.

    client = new WebClient(BrowserVersion.CHROME);
    client.getOptions().setThrowExceptionOnScriptError(false);
    client.getOptions().setCssEnabled(false);
    client.getOptions().setJavaScriptEnabled(true);
    client.getOptions().setDownloadImages(false);
    client.getOptions().setThrowExceptionOnFailingStatusCode(false); 
    client.getOptions().setPrintContentOnFailingStatusCode(false);
    client.getOptions().setUseInsecureSSL(true);
    client.getOptions().setRedirectEnabled(false);
    client.setJavaScriptTimeout(15000);
    client.waitForBackgroundJavaScript(10000l);
    client.waitForBackgroundJavaScriptStartingBefore(10000l);
    page = client.getPage(url);
    synchronized(page) {
      try {
        page.wait(conf.getInt("htmlunit.javascript.timeout", 15000));
      } catch (Exception e) {}
    }
    client.waitForBackgroundJavaScript(10000l);
    client.waitForBackgroundJavaScriptStartingBefore(10000l);
    webResponse = page.getWebResponse();

The text i am interested in is in element <section id="sectionDetailsMain"> but it is never created/added to the DOM. Can anyone help me get the HTML properly filled by Javascript?

Many thanks,
Markus

[1] https://www.aarstiderne.com/find-din-maaltidskasse/kvikkassen
[2] https://sourceforge.net/p/htmlunit/bugs/2008/
[3] https://www.aarstiderne.com/umbraco/api/productapi/Products?url=maaltidskasser

[Htmlunit-user] Getting text from AngularJS site

From: Markus J. <mar...@op...> - 2019-04-02 11:03:36

Hello,

We extract text from various websites, including a Danish site for recipies etc. Using HtmlUnit 2.34.1 we got stopped by NPE but this is now fixed [2].

However, we still cannot get text from the HTML. With debug logging on, we do see the recipe text of [1] being downloaded from some API [3]. But then it is up to Javascript to inject the text into the DOM, which doesn't appear to happen.

I tried many variations in the code, different waits, very long waits but nothing seems to be working here. There are exceptions but they seem unrelated.

    client = new WebClient(BrowserVersion.CHROME);
    client.getOptions().setThrowExceptionOnScriptError(false);
    client.getOptions().setCssEnabled(false);
    client.getOptions().setJavaScriptEnabled(true);
    client.getOptions().setDownloadImages(false);
    client.getOptions().setThrowExceptionOnFailingStatusCode(false); 
    client.getOptions().setPrintContentOnFailingStatusCode(false);
    client.getOptions().setUseInsecureSSL(true);
    client.getOptions().setRedirectEnabled(false);
    client.setJavaScriptTimeout(15000);
    client.waitForBackgroundJavaScript(10000l);
    client.waitForBackgroundJavaScriptStartingBefore(10000l);
    page = client.getPage(url);
    synchronized(page) {
      try {
        page.wait(conf.getInt("htmlunit.javascript.timeout", 15000));
      } catch (Exception e) {}
    }
    client.waitForBackgroundJavaScript(10000l);
    client.waitForBackgroundJavaScriptStartingBefore(10000l);
    webResponse = page.getWebResponse();

The text i am interested in is in element <section id="sectionDetailsMain"> but it is never created/added to the DOM. Can anyone help me get the HTML properly filled by Javascript?

Many thanks,
Markus

[1] https://www.aarstiderne.com/find-din-maaltidskasse/kvikkassen
[2] https://sourceforge.net/p/htmlunit/bugs/2008/
[3] https://www.aarstiderne.com/umbraco/api/productapi/Products?url=maaltidskasser

Re: [Htmlunit-user] [ANN] HtmlUnit 2.34.0 released

From: beshoo <be...@gm...> - 2019-03-01 13:02:23

I already used phantom and it works great. and chromium as well. but
HtmlUnit  can not understand instagram AJAX. that is it !
Why i want to use HtmlUnit? it is more light than phantom and chromium.

Thank you



On Fri, Mar 1, 2019 at 2:58 PM Yves <yv...@gm...> wrote:

> Hi,
>
> for me, HtmlUnit is a great help to automate all kind of web-things. It
> may have its limitations, but concerning your
> objective, the instagram login problem... don´t blame it on HtmlUnit... it
> is a fact that instagram and go do not want
> phantom-users and bots that manipulate likes and other things. They make
> it very hard for bots these times and I
> like it... of course, it is annoying, just think of google "robot-captcha"
> and others... i hate them, but this kind of
> race will always exist and one time the bot is in front, sometimes the
> supplier of the webservice. Most services
> like instagram, facebook and co. offer an API to make automated
> requests... of course only those functions are
> available, that do not break their rules... so.. if you want to achieve
> what your describe here, don´t argue about
> HtmlUnit if you don´t see the huge bunch of benefit it brings... take your
> brain and solve the login-problem yourself.
>
> regards,
> yves
>
> p.s.
> thanks for the update and the efforts to all contributors of HtmlUnit. I
> highly appreciate your work.
>
>
> Am 01.03.2019 um 01:29 schrieb beshoo:
>
> Hello list
> Thank you for this update, but what the benefits from using this lib while
> i can not even login to instagram. To like one photo..
>
> This kind of lib created in order to give more background usability.
>
> Otherwise user may will use chrome, ok i known how chrome kill memory.
>
> But at least it solve the problem.
>
> Kindly may you tell us what is the main goal from this lib?
>
> On Thu, Feb 28, 2019, 9:28 PM Ronald Brill <rb...@rb... wrote:
>
>> Hi all,
>>
>> it is a pleasure to announce the availability of HtmlUnit 2.34.0.
>> The main enhancements are:
>>   - again resync with Rhino and various Javascript improvements
>>   - Neko and CssParser improvments
>>   - as always various fixes, specially with JavaScript
>>
>> The full list of changes can be found in [1]
>> Thanks to all the contributors.
>>
>> Happy Testing/Scraping!
>>    The HtmlUnit team
>>
>> [1] http://htmlunit.sourceforge.net/changes-report.html#a2.34.0
>>
>>
>>
>> _______________________________________________
>> Htmlunit-user mailing list
>> Htm...@li...
>> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>>
>
>
> _______________________________________________
> Htmlunit-user mailing lis...@li...https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>
>
>

Re: [Htmlunit-user] [ANN] HtmlUnit 2.34.0 released

From: Yves <yv...@gm...> - 2019-03-01 12:58:34

Hi,

for me, HtmlUnit is a great help to automate all kind of web-things. It 
may have its limitations, but concerning your
objective, the instagram login problem... don´t blame it on HtmlUnit... 
it is a fact that instagram and go do not want
phantom-users and bots that manipulate likes and other things. They make 
it very hard for bots these times and I
like it... of course, it is annoying, just think of google 
"robot-captcha" and others... i hate them, but this kind of
race will always exist and one time the bot is in front, sometimes the 
supplier of the webservice. Most services
like instagram, facebook and co. offer an API to make automated 
requests... of course only those functions are
available, that do not break their rules... so.. if you want to achieve 
what your describe here, don´t argue about
HtmlUnit if you don´t see the huge bunch of benefit it brings... take 
your brain and solve the login-problem yourself.

regards,
yves

p.s.
thanks for the update and the efforts to all contributors of HtmlUnit. I 
highly appreciate your work.

Am 01.03.2019 um 01:29 schrieb beshoo:
> Hello list
> Thank you for this update, but what the benefits from using this lib 
> while i can not even login to instagram. To like one photo..
>
> This kind of lib created in order to give more background usability.
>
> Otherwise user may will use chrome, ok i known how chrome kill memory.
>
> But at least it solve the problem.
>
> Kindly may you tell us what is the main goal from this lib?
>
> On Thu, Feb 28, 2019, 9:28 PM Ronald Brill <rb...@rb... 
> <mailto:rb...@rb...> wrote:
>
>     Hi all,
>
>     it is a pleasure to announce the availability of HtmlUnit 2.34.0.
>     The main enhancements are:
>       - again resync with Rhino and various Javascript improvements
>       - Neko and CssParser improvments
>       - as always various fixes, specially with JavaScript
>
>     The full list of changes can be found in [1]
>     Thanks to all the contributors.
>
>     Happy Testing/Scraping!
>        The HtmlUnit team
>
>     [1] http://htmlunit.sourceforge.net/changes-report.html#a2.34.0
>
>
>
>     _______________________________________________
>     Htmlunit-user mailing list
>     Htm...@li...
>     <mailto:Htm...@li...>
>     https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>
>
>
> _______________________________________________
> Htmlunit-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlunit-user

Re: [Htmlunit-user] [ANN] HtmlUnit 2.34.0 released

From: beshoo <be...@gm...> - 2019-03-01 00:29:38

Hello list
Thank you for this update, but what the benefits from using this lib while
i can not even login to instagram. To like one photo..

This kind of lib created in order to give more background usability.

Otherwise user may will use chrome, ok i known how chrome kill memory.

But at least it solve the problem.

Kindly may you tell us what is the main goal from this lib?

On Thu, Feb 28, 2019, 9:28 PM Ronald Brill <rb...@rb... wrote:

> Hi all,
>
> it is a pleasure to announce the availability of HtmlUnit 2.34.0.
> The main enhancements are:
>   - again resync with Rhino and various Javascript improvements
>   - Neko and CssParser improvments
>   - as always various fixes, specially with JavaScript
>
> The full list of changes can be found in [1]
> Thanks to all the contributors.
>
> Happy Testing/Scraping!
>    The HtmlUnit team
>
> [1] http://htmlunit.sourceforge.net/changes-report.html#a2.34.0
>
>
>
> _______________________________________________
> Htmlunit-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>

[Htmlunit-user] [ANN] HtmlUnit 2.34.0 released

From: Ronald B. <rb...@rb...> - 2019-02-28 19:27:58

Hi all,

it is a pleasure to announce the availability of HtmlUnit 2.34.0.
The main enhancements are:
  - again resync with Rhino and various Javascript improvements
  - Neko and CssParser improvments
  - as always various fixes, specially with JavaScript

The full list of changes can be found in [1]
Thanks to all the contributors.

Happy Testing/Scraping!
   The HtmlUnit team

[1] http://htmlunit.sourceforge.net/changes-report.html#a2.34.0

[Htmlunit-user] Handling pop up form

From: Emmanuel M. <nue...@gm...> - 2019-02-03 14:21:32

Hi,

My username is rich25

I've used HtmlUnit for my other program and it working perfectly.

I have this problem now with this program.

I'm accessing this website https://www.betexplorer.com and I want to click
the top right login link written "login". After I click the link, the pop
up login form appears and I want to enter the login credentials and click
the login button, but I can't seem to find this JavaScript pop up login
form with HtmlUnit.

Here is my code snipets below:

import com.gargoylesoftware.htmlunit.BrowserVersion;
import com.gargoylesoftware.htmlunit.WebClient;import
com.gargoylesoftware.htmlunit.WebWindowEvent;
import com.gargoylesoftware.htmlunit.html.DomElement;
import com.gargoylesoftware.htmlunit.WebWindowListener;
import com.gargoylesoftware.htmlunit.html.HtmlButton;
import com.gargoylesoftware.htmlunit.html.HtmlElement;
import com.gargoylesoftware.htmlunit.html.HtmlForm;
import com.gargoylesoftware.htmlunit.html.HtmlPage;
import com.gargoylesoftware.htmlunit.html.HtmlPasswordInput;
import com.gargoylesoftware.htmlunit.html.HtmlTextInput;

public class ExplorerHtmlUnit { public static void main(String[] args)
throws Throwable {

WebClient webClient;

webClient = new WebClient();

webClient = new WebClient(BrowserVersion.CHROME);

webClient.getOptions().setThrowExceptionOnScriptError(false);

webClient.getOptions().setJavaScriptEnabled(true);

java.util.logging.Logger.getLogger("com.gargoylesoftware").setLevel(java.util.logging.Level.OFF);


HtmlPage explorerPage = webClient.getPage("https://www.betexplorer.com");

System.out.println("Explorer Website Found");

      //I'm not sure if the login button on top is clicked at this point
until the "following code works"  List<DomElement> spans =
explorerPage.getByXPath("//a[@class='clientmenu__item__in
js-window-trigger'][contains(text(),'Login')]");

 for (DomElement ele : spans) {
 if(ele.getAttribute("class").equals("login")) {    //ele.click();   }  }

System.out.println("login icon found and clicked");

//sleep for 5 seconds for javascript form to load  Thread.sleep(5000);

//the following code mentioned above
webClient.addWebWindowListener(new WebWindowListener()  {

 public void webWindowOpened(WebWindowEvent event) {

windows.add(event.getWebWindow());  }

@Override
public void webWindowClosed(WebWindowEvent arg0) {   // TODO Auto-generated
method stub     }

@Override
public void webWindowContentChanged(WebWindowEvent arg0) {
// TODO Auto-generated method stub     }  });

 WebWindow latestWindow = windows.getLast();

 HtmlPage urPage = (HtmlPage) latestWindow.getEnclosedPage();

   HtmlTextInput submitUsername = (HtmlTextInput)
explorerPage.getByXPath("//input[@id='login_nick']");

submitUsername.setValueAttribute("username");

System.out.println("UserName Found And Entered");

HtmlPasswordInput submitPassword = (HtmlPasswordInput)
explorerPage.getByXPath("//input[@id='login_nick']");

submitPassword.setValueAttribute("password");

 System.out.println("Password Found And Entered");

HtmlButton loginButton = (HtmlButton)
explorerPage.getByXPath("//html[1]/body[1]/div[6]/div[1]/div[1]/div[1]/div[1]/form[1]/div[1]/div[3]/button[1]");


loginButton.click();        System.out.println("Login Button Found And
Clicked");

webClient.close(); }}

What should I do with the pop up window to enter the login information and
click the login button.

[Htmlunit-user] HtmlUnit - undeterministic behaviour

From: Ing. J. N. <ji...@se...> - 2019-01-06 16:45:53

Hello, 




I used HtmlUnit several times, especially for automatic collecting of data 
from various web pages. So far so good.


Now I encountered some problems and I am not able to tell when they started.
The main problem seems to be, that page loading is not deterministic.


Here is my very simple code.





import com.gargoylesoftware.htmlunit.BrowserVersion;


import com.gargoylesoftware.htmlunit.NicelyResynchronizingAjaxController;


import com.gargoylesoftware.htmlunit.WebClient;


import com.gargoylesoftware.htmlunit.html.HtmlPage;


import java.io.IOException;





public class HtmlUnitExample {


    public static void main (String argv[]) {


        WebClient webClient = new WebClient(BrowserVersion.FIREFOX_52);  // 
doesn't matter


        webClient.getOptions().setJavaScriptEnabled(true);


        webClient.getOptions().setThrowExceptionOnScriptError(false);


        webClient.getOptions().setThrowExceptionOnFailingStatusCode(false);


        webClient.getOptions().setRedirectEnabled(true);


        webClient.setAjaxController(new NicelyResynchronizingAjaxController(
));


        webClient.getOptions().setCssEnabled(false);


        webClient.getOptions().setUseInsecureSSL(true);


        try {


            HtmlPage page = webClient.getPage("http://myzuka.club");


            String asXml = page.asXml();


        }


        catch (IOException e) {


            System.out.println(e.getMessage());


        }


    }


}





When I run it in my PC at work, everyhing is ok. Some warnings and some 
javascript exceptions and the page loads in less than two seconds.      


But when I run the same code in my PC at home, the results vary:





- About 20% attempts ends whith Java heap out of space !

- About 40% attempts ends stuck at getPage line, debug listing stopped, but 
code don't stop. Hitting pause does nothing.


- Rest of attempts returns page after all, but after many many tens of 
seconds, maybe even minutes.





As far as operating system, memory, speed are concerned, the two PCs are 
similar. Windows 7, 16GB. The code is run in Oracle's JDeveloper (java 1.8),

latest HtmlUnit (2.33). The page from example (http://myzuka.club) loads 
well in all browsers, both at work and at home. As far I know, I have no 
restriction in


internet connection of my home provider. One thing caught my eye - when I 
run it at home, I see this logged line 






INFO: statusCode=[403] contentType=[text/html]




I've never seen it at work.






Does somebody have any ideas what can cause my home problems?





Thanks,





JN, Czech rep.

[Htmlunit-user] The cookie Value is not getting overwritten in my use case. What is the mistake?

From: Vasudevan C. <vco...@gm...> - 2019-01-01 08:33:47

All,

   First of all wishing every one a Very Happy and Prosperous New Year.

   I am using HTMLUnit in the following scenario and I did not see the
cookie
   value getting overwritten.

   1. I initiate a webclient and send the URL to a website based on a
client
       request..
    2. I process the response.
   3. Get list of all the cookies stored in the Cookie Manager on that
Webclient
        instance.
    4. I store all the cookie object in Memory.
    5. Return the response data to the client
    6. I close the WebClient using close method

   6. I Initiate a new WebClient Instance based on a client request to the
same
       site as in step-1.
   7. Get the CookieManager for that WebClient Instance.
   8. Adding all the Cookie Object that I had in my memory using AddCookie
       method available in CookieManager Class
  9. Send the request to the same website as in step 1 and received the
      response.
 10. The response header has a new value for a cookie key set using Set-
       Cookie Header.        .
 11. I called getCookies Method of CookieManager thinking that HTMLUnit
       would have updated the New Cookie Value. But unfortunately, the
      cookieManager had returned the same list of cookies as in step-8.

  How to get the cookie Value updated by HTMLUnit as per the above
  scenario?.

   Looking forward to your advise on the correct approach.

Regards
 Vasu

Re: [Htmlunit-user] Setting Accept in HTTP Header does not seems to work in 2.33 version

From: Vasudevan C. <vco...@gm...> - 2018-12-04 15:11:52

Hi Ronald,

    Did some comparison between 2.23 codebase & 2.33 codebase.

     I modified the 2.33 codebase in WebClient.java and the method
addDefaultheaders which is copied below. I saw the Accept header value was
getting
    set with what I gave.  The fix I put may not be the right one. Let me
know your thoughts.

Regards
 Vasu

**************************************************
    private void addDefaultHeaders(final WebRequest wrs) {
        // Add standard HtmlUnit headers.
        if (!wrs.isAdditionalHeader(HttpHeader.ACCEPT_LANGUAGE)) {
            wrs.setAdditionalHeader(HttpHeader.ACCEPT_LANGUAGE,
getBrowserVersion().getBrowserLanguage());
        }
        if
(getBrowserVersion().hasFeature(HTTP_HEADER_UPGRADE_INSECURE_REQUEST)
                &&
!wrs.isAdditionalHeader(HttpHeader.UPGRADE_INSECURE_REQUESTS)) {
            wrs.setAdditionalHeader(HttpHeader.UPGRADE_INSECURE_REQUESTS,
"1");
        }

        // Add user-specified headers last so that they can override
HtmlUnit defaults.
     //   requestHeaders_.forEach((name, value) -> {
     //       if (!wrs.isAdditionalHeader(name)) {
     //           wrs.setAdditionalHeader(name, value);
     //       }
     //   });
        wrs.getAdditionalHeaders().putAll(requestHeaders_);
    }
*******************************************************

On Mon, 3 Dec 2018 at 22:51, Ronald Brill <rb...@rb...> wrote:

> Hi Vasu,
>
> do you have some sample code for me. Will then try to reproduce (and fix)
>
>         RBRi
>
> On Mon, 3 Dec 2018 20:14:50 +0530 Vasudevan Comandur wrote:
> >
> >All,
> >
> >  I was trying to migrate my app from htmlunit 2.23 to htmlunit 2.33.
> >
> >  As part of the app, I was setting the "Accept" using addRequestHeader
> >method
> >   to "application/pdf". The header was not getting set.
> >
> >   I am setting the Browser_Version to FIREFOX_60.
> >
> >   The same call was working fine in 2.23. Am I missing something?.
> >
> >  Looking forward to hearing from you.
> >
> >Regards
> > Vasu
> >
> >
> >
> >----< Inline text [text-plain-04.txt] >------------------
> >
> >
> >
> >
> >----< Inline text [text-plain-05.txt] >------------------
> >
> >_______________________________________________
> >Htmlunit-user mailing list
> >Htm...@li...
> >https://lists.sourceforge.net/lists/listinfo/htmlunit-user
> >
> >
>
>

Re: [Htmlunit-user] Setting Accept in HTTP Header does not seems to work in 2.33 version

From: Vasudevan C. <vco...@gm...> - 2018-12-03 17:55:02

Hi Ronald,
   Thanks for your reply. Unfortunately, I have only Clojure Code. I am
copying the snippet of the code for your reference.

   (start-page (do
                   (enable-javascript false)
                   (enable-httpexception false) ; Disable the HTTP and
script exceptions
                   (enable-scriptexception false) ; Disable the script
exceptions
                   (.setUseInsecureSSL (.getOptions *wc*) true) ;
   (let [a-token (nth @dchannel_authtoken index)
         st1-data (.addRequestHeader *wc* "Authorization" (str "bearer "
a-token))
         st2-data (.addRequestHeader *wc* "Referer" ref-url)
         st3-data (.addRequestHeader *wc* "Accept" "application/pdf")
        ]
                   )
                   pdf-url)

Explanation: Start-page creates a Web Client Instance with BrowserVersion
Set to FIREFOX_60.

Rest of the code self-explanatory. I watched the Charles Trace and found
that Authorization & Referer are set but not Accept.
Accept was having the default value I presume
"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8".

Thanks for your quick reply.

Regards
 Vasu

On Mon, 3 Dec 2018 at 22:51, Ronald Brill <rb...@rb...> wrote:

> Hi Vasu,
>
> do you have some sample code for me. Will then try to reproduce (and fix)
>
>         RBRi
>
> On Mon, 3 Dec 2018 20:14:50 +0530 Vasudevan Comandur wrote:
> >
> >All,
> >
> >  I was trying to migrate my app from htmlunit 2.23 to htmlunit 2.33.
> >
> >  As part of the app, I was setting the "Accept" using addRequestHeader
> >method
> >   to "application/pdf". The header was not getting set.
> >
> >   I am setting the Browser_Version to FIREFOX_60.
> >
> >   The same call was working fine in 2.23. Am I missing something?.
> >
> >  Looking forward to hearing from you.
> >
> >Regards
> > Vasu
> >
> >
> >
> >----< Inline text [text-plain-04.txt] >------------------
> >
> >
> >
> >
> >----< Inline text [text-plain-05.txt] >------------------
> >
> >_______________________________________________
> >Htmlunit-user mailing list
> >Htm...@li...
> >https://lists.sourceforge.net/lists/listinfo/htmlunit-user
> >
> >
>
>

Re: [Htmlunit-user] Setting Accept in HTTP Header does not seems to work in 2.33 version

From: Ronald B. <rb...@rb...> - 2018-12-03 17:39:56

Hi Vasu,

do you have some sample code for me. Will then try to reproduce (and fix)

	RBRi

On Mon, 3 Dec 2018 20:14:50 +0530 Vasudevan Comandur wrote:
>
>All,
>
>  I was trying to migrate my app from htmlunit 2.23 to htmlunit 2.33.
>
>  As part of the app, I was setting the "Accept" using addRequestHeader
>method
>   to "application/pdf". The header was not getting set.
>
>   I am setting the Browser_Version to FIREFOX_60.
>
>   The same call was working fine in 2.23. Am I missing something?.
>
>  Looking forward to hearing from you.
>
>Regards
> Vasu
>
>
>
>----< Inline text [text-plain-04.txt] >------------------
>
>
>
>
>----< Inline text [text-plain-05.txt] >------------------
>
>_______________________________________________
>Htmlunit-user mailing list
>Htm...@li...
>https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>
>

[Htmlunit-user] Setting Accept in HTTP Header does not seems to work in 2.33 version

From: Vasudevan C. <vco...@gm...> - 2018-12-03 14:45:28

All,

  I was trying to migrate my app from htmlunit 2.23 to htmlunit 2.33.

  As part of the app, I was setting the "Accept" using addRequestHeader
method
   to "application/pdf". The header was not getting set.

   I am setting the Browser_Version to FIREFOX_60.

   The same call was working fine in 2.23. Am I missing something?.

  Looking forward to hearing from you.

Regards
 Vasu

[Htmlunit-user] Newby: How do I report a bug of HtmlUnit?

From: Scharpf, R. <rob...@hp...> - 2018-10-16 12:54:48

Hi,

I hit a severe issue with HtmlUnit and want to report this. Although I read http://htmlunit.sourceforge.net/submittingBugs.html , I have not found a way to report this.

Thanks,
Robert

Re: [Htmlunit-user] runtimeError: message=[Exceeded maximum stack depth]

From: Ronald B. <rb...@rb...> - 2018-10-05 15:51:31

Hi Filip,

did a short test with this code

   public static void main(String[] args) throws Exception {
        String uri = "https://www.t-mobile.cz/sms/closed.jsp";

        try (final WebClient webClient = new WebClient(BrowserVersion.FIREFOX_60)) {
          webClient.getOptions().setThrowExceptionOnScriptError(false);

          HtmlPage page = webClient.getPage(uri);
          webClient.waitForBackgroundJavaScriptStartingBefore(1 * 1000);

          System.out.println("----------------");
          System.out.println(page.asText());
          System.out.println("----------------");
      }

and the output looks good so far for me.
You are right there are some log output complaining about problems with the web site. 

>WARNING: Obsolete content type encountered: 'text/javascript'.
The author of the site seems to follow an old web standard :-)

> An invalid or ill....
This is the usual output you get if the site uses e.g. jquery. This kind of libs trying different selectors not (yet) supported by real browsers also (but real browsers are not logging the error info) and using some fallback code if the browser does not support 
the css sel.

>SEVERE: runtimeError: message=[Exceeded maximum stack depth]
I have seen this in the past as result of a real strange IE detection code.

And there is the real js error reported in the browser also 'missin }' - shame on T-Mobile or at least the testers there. Using tools like HtmlUnit / Wetator will help :-)

To sum it up, you can ignor the rest of the messages as long as your page content (dom tree) is the right one.

	RBRi


On Wed, 3 Oct 2018 09:02:08 +0200 Filip Pekarek wrote:
>
>Hello, I am new to htmlunit.
>I need to load page "https://www.t-mobile.cz/sms/closed.jsp" which has new
>JS.
>I cant load full page. Get result with <noscript> tag.
>I tried all BrowserVersion and I am using last htmlunit 2.33.
>
>My code is:
>========
>WebClient webClient = new WebClient(BrowserVersion.FIREFOX_60);
>
>CookieManager cookieMan = new CookieManager();
>cookieMan = webClient.getCookieManager();
>cookieMan.setCookiesEnabled(true);
>
>webClient.getOptions().setJavaScriptEnabled(true);
>webClient.getOptions().setRedirectEnabled(true);
>webClient.getOptions().setCssEnabled(true);
>webClient.getOptions().setThrowExceptionOnScriptError(false);
>webClient.getOptions().setCssEnabled(true);
>
>HtmlPage page = webClient.getPage("https://www.t-mobile.cz/sms/closed.jsp");
>webClient.waitForBackgroundJavaScript(30 * 1000);
>String pageAsXml = page.asXml();
>========
>
>I get debug:
>com.gargoylesoftware.htmlunit.IncorrectnessListenerImpl notify
>WARNING: Obsolete content type encountered: 'text/javascript'.
>
>Sometimes I get debug:
>SEVERE: runtimeError: message=[Exceeded maximum stack depth]
>
>
>Is it wrong JS on a page? When I load page via Firefox, debugger gets some
>errors too, but the page loads fine.
>Any suggestions?
>
>Thank you for very much your reply.
>
>Best regards
>
>Filip
>
>
>
>----< Inline text [text-plain-04.txt] >------------------
>
>
>
>
>----< Inline text [text-plain-05.txt] >------------------
>
>_______________________________________________
>Htmlunit-user mailing list
>Htm...@li...
>https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>
>

189 messages has been excluded from this view by a project administrator.

Flat | Threaded

<< < 1 .. 3 4 5 6 7 .. 425 > >> (Page 5 of 425)