Menu
▾
▴
htmlunit-user — Discussion of the use of HtmlUnit
You can subscribe to this list here.
| 2003 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
(6) |
Jul
(17) |
Aug
(18) |
Sep
(22) |
Oct
(16) |
Nov
(6) |
Dec
(11) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2004 |
Jan
(11) |
Feb
(10) |
Mar
(34) |
Apr
(26) |
May
(6) |
Jun
(22) |
Jul
(14) |
Aug
(4) |
Sep
(47) |
Oct
(69) |
Nov
(23) |
Dec
(21) |
| 2005 |
Jan
(53) |
Feb
(33) |
Mar
(92) |
Apr
(65) |
May
(63) |
Jun
(57) |
Jul
(43) |
Aug
(132) |
Sep
(61) |
Oct
(75) |
Nov
(60) |
Dec
(130) |
| 2006 |
Jan
(74) |
Feb
(87) |
Mar
(101) |
Apr
(58) |
May
(54) |
Jun
(42) |
Jul
(31) |
Aug
(67) |
Sep
(61) |
Oct
(71) |
Nov
(28) |
Dec
(58) |
| 2007 |
Jan
(53) |
Feb
(50) |
Mar
(96) |
Apr
(66) |
May
(55) |
Jun
(130) |
Jul
(99) |
Aug
(115) |
Sep
(37) |
Oct
(78) |
Nov
(24) |
Dec
(70) |
| 2008 |
Jan
(94) |
Feb
(85) |
Mar
(197) |
Apr
(274) |
May
(119) |
Jun
(143) |
Jul
(193) |
Aug
(99) |
Sep
(160) |
Oct
(120) |
Nov
(178) |
Dec
(109) |
| 2009 |
Jan
(238) |
Feb
(169) |
Mar
(115) |
Apr
(109) |
May
(131) |
Jun
(167) |
Jul
(144) |
Aug
(193) |
Sep
(155) |
Oct
(154) |
Nov
(97) |
Dec
(127) |
| 2010 |
Jan
(108) |
Feb
(127) |
Mar
(176) |
Apr
(113) |
May
(130) |
Jun
(200) |
Jul
(115) |
Aug
(80) |
Sep
(92) |
Oct
(101) |
Nov
(124) |
Dec
(53) |
| 2011 |
Jan
(67) |
Feb
(144) |
Mar
(88) |
Apr
(60) |
May
(89) |
Jun
(54) |
Jul
(68) |
Aug
(81) |
Sep
(48) |
Oct
(40) |
Nov
(10) |
Dec
(20) |
| 2012 |
Jan
(21) |
Feb
(28) |
Mar
(17) |
Apr
(35) |
May
(41) |
Jun
(44) |
Jul
(68) |
Aug
(67) |
Sep
(89) |
Oct
(58) |
Nov
(47) |
Dec
(56) |
| 2013 |
Jan
(49) |
Feb
(28) |
Mar
(46) |
Apr
(31) |
May
(28) |
Jun
(37) |
Jul
(34) |
Aug
(52) |
Sep
(42) |
Oct
(108) |
Nov
(59) |
Dec
(56) |
| 2014 |
Jan
(41) |
Feb
(72) |
Mar
(46) |
Apr
(21) |
May
(19) |
Jun
(17) |
Jul
(15) |
Aug
(40) |
Sep
(11) |
Oct
(3) |
Nov
(5) |
Dec
(31) |
| 2015 |
Jan
(11) |
Feb
(12) |
Mar
(19) |
Apr
(19) |
May
(38) |
Jun
(54) |
Jul
(14) |
Aug
(42) |
Sep
(14) |
Oct
(16) |
Nov
(26) |
Dec
(14) |
| 2016 |
Jan
(3) |
Feb
(1) |
Mar
(24) |
Apr
(5) |
May
(15) |
Jun
(14) |
Jul
(33) |
Aug
(19) |
Sep
(8) |
Oct
(10) |
Nov
|
Dec
(2) |
| 2017 |
Jan
(16) |
Feb
(12) |
Mar
(23) |
Apr
(8) |
May
(11) |
Jun
(20) |
Jul
(21) |
Aug
(20) |
Sep
|
Oct
(6) |
Nov
(9) |
Dec
(2) |
| 2018 |
Jan
(7) |
Feb
(5) |
Mar
(6) |
Apr
(5) |
May
(1) |
Jun
(2) |
Jul
(2) |
Aug
|
Sep
(4) |
Oct
(3) |
Nov
|
Dec
(4) |
| 2019 |
Jan
(2) |
Feb
(2) |
Mar
(3) |
Apr
(4) |
May
|
Jun
(4) |
Jul
(9) |
Aug
(2) |
Sep
|
Oct
(4) |
Nov
(1) |
Dec
(7) |
| 2020 |
Jan
(2) |
Feb
(6) |
Mar
(9) |
Apr
(1) |
May
(1) |
Jun
(15) |
Jul
(1) |
Aug
(1) |
Sep
(2) |
Oct
(6) |
Nov
(3) |
Dec
(5) |
| 2021 |
Jan
(3) |
Feb
(1) |
Mar
(2) |
Apr
(1) |
May
|
Jun
(1) |
Jul
(1) |
Aug
(3) |
Sep
(1) |
Oct
|
Nov
(1) |
Dec
|
| 2022 |
Jan
|
Feb
|
Mar
|
Apr
|
May
(2) |
Jun
(1) |
Jul
(4) |
Aug
|
Sep
|
Oct
|
Nov
(1) |
Dec
(6) |
| 2025 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
(1) |
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
|
From: Ronald B. <rb...@rb...> - 2016-08-25 18:01:18
|
On Thu, 25 Aug 2016 18:16:36 +0800 Rural Hunter wrote: Line number should be not a real problem, i'm sure you able to calculate the line number if you have access to the whole response. Regarding the element you are right. But you sample does not use the element at all and if you are looking for bad js code, i thing the element will be of minor help. Having the request url at hand is from my point of view a benefit here. If you still miss something, please open an enhancement request, we can discuss this with all developers than. RBRi > >Hi Ronald, > >Yes, it can solve our problem in some cases(We actually use that in some >cases). But it lacks the feature provided in ScriptPreProcessor such as the >calling line number, and the element it bounds to etc. I think they serve >different purposes. > >2016-08-25 17:13 GMT+08:00 Ronald Brill <rb...@rb...>: > >> Hi Rural, >> >> have a look at http://htmlunit.sourceforge.net/faq.html# >> HowToModifyRequestOrResponse >> I think this approach can solve your problem. >> >> RBRi >> >> On Thu, 25 Aug 2016 17:02:38 +0800 Rural Hunter wrote: >> > >> >Hi Ronald, >> > >> >We do need a similar solution. We usually supply a overridden >> pre-processor >> >to WebClient and do things like this in the pre-processor: >> > @Override >> > public String preProcess(HtmlPage hp, String sourceCode, String >> >sourceName, int lineNumber, HtmlElement he) >> > { >> > //qq zone temp fix >> > if(sourceName.indexOf("/qzone/")>0&&sourceCode.indexOf("if( >> >QZFL.userAgent.ie)")>0) >> > { >> > //System.out.println("Found ua code at >> >"+sourceName+"#"+lineNumber); >> > return sourceCode.replace("if(QZFL.userAgent.ie)", >> "if(false)"); >> > } >> > **/ >> > >> > return sourceCode; >> > } >> > >> >Sometimes it's not a bug and sometimes it's not practicable to wait for a >> >fix. >> > >> >2016-08-25 14:07 GMT+08:00 Ronald Brill <rb...@rb...>: >> > >> >> >We usually use this to diagnose js errors and filter/replace >> problematic >> >> js if we can not fix it. >> >> >> >> But this was not done by the original ScriptPreProcessor? How have you >> >> done this. >> >> Do you need a similar solution? >> >> >> >> Regarding problematic js - if HtmlUnit differs from real browsers this >> is >> >> a bug. Please report all this situations and we will try (sooner or >> later >> >> ;-) to fix this. >> >> >> >> RBRi >> >> >> >> On Thu, 25 Aug 2016 10:00:14 +0800 Rural Hunter wrote: >> >> > >> >> >Hi Ronald, >> >> > >> >> >We don't use a customized version. We were using 2.14 and I just try to >> >> >upgraded to 2.23. We usually use this to diagnose js errors and >> >> >filter/replace problematic js if we can not fix it. >> >> > >> >> >2016-08-24 23:20 GMT+08:00 Ronald Brill <rb...@rb...>: >> >> > >> >> >> On Wed, 24 Aug 2016 11:01:48 +0800 Rural Hunter wrote: >> >> >> > >> >> >> >I just tried to upgrade my htmlunit dependency from 2.14 to 2.23 and >> >> found >> >> >> >the ScriptPreProcessor is removed. I searched the javadoc and change >> >> >> >history but didn't find anything about the function deprecation. Why >> >> is it >> >> >> >removed and anything else I can use to replace it? >> >> >> > >> >> >> >> >> >> ScriptPreProcessor was removed as part of the removal of IE8 support. >> >> >> Do you have a customized version in use and if yes what problem do >> you >> >> >> solve with this? >> >> >> >> >> >> RBRI >> >> >> >> >> > >> >> > >> >> >> >> >> > >> > >> >> > > |
|
From: Rural H. <rur...@gm...> - 2016-08-25 10:16:43
|
Hi Ronald, Yes, it can solve our problem in some cases(We actually use that in some cases). But it lacks the feature provided in ScriptPreProcessor such as the calling line number, and the element it bounds to etc. I think they serve different purposes. 2016-08-25 17:13 GMT+08:00 Ronald Brill <rb...@rb...>: > Hi Rural, > > have a look at http://htmlunit.sourceforge.net/faq.html# > HowToModifyRequestOrResponse > I think this approach can solve your problem. > > RBRi > > On Thu, 25 Aug 2016 17:02:38 +0800 Rural Hunter wrote: > > > >Hi Ronald, > > > >We do need a similar solution. We usually supply a overridden > pre-processor > >to WebClient and do things like this in the pre-processor: > > @Override > > public String preProcess(HtmlPage hp, String sourceCode, String > >sourceName, int lineNumber, HtmlElement he) > > { > > //qq zone temp fix > > if(sourceName.indexOf("/qzone/")>0&&sourceCode.indexOf("if( > >QZFL.userAgent.ie)")>0) > > { > > //System.out.println("Found ua code at > >"+sourceName+"#"+lineNumber); > > return sourceCode.replace("if(QZFL.userAgent.ie)", > "if(false)"); > > } > > **/ > > > > return sourceCode; > > } > > > >Sometimes it's not a bug and sometimes it's not practicable to wait for a > >fix. > > > >2016-08-25 14:07 GMT+08:00 Ronald Brill <rb...@rb...>: > > > >> >We usually use this to diagnose js errors and filter/replace > problematic > >> js if we can not fix it. > >> > >> But this was not done by the original ScriptPreProcessor? How have you > >> done this. > >> Do you need a similar solution? > >> > >> Regarding problematic js - if HtmlUnit differs from real browsers this > is > >> a bug. Please report all this situations and we will try (sooner or > later > >> ;-) to fix this. > >> > >> RBRi > >> > >> On Thu, 25 Aug 2016 10:00:14 +0800 Rural Hunter wrote: > >> > > >> >Hi Ronald, > >> > > >> >We don't use a customized version. We were using 2.14 and I just try to > >> >upgraded to 2.23. We usually use this to diagnose js errors and > >> >filter/replace problematic js if we can not fix it. > >> > > >> >2016-08-24 23:20 GMT+08:00 Ronald Brill <rb...@rb...>: > >> > > >> >> On Wed, 24 Aug 2016 11:01:48 +0800 Rural Hunter wrote: > >> >> > > >> >> >I just tried to upgrade my htmlunit dependency from 2.14 to 2.23 and > >> found > >> >> >the ScriptPreProcessor is removed. I searched the javadoc and change > >> >> >history but didn't find anything about the function deprecation. Why > >> is it > >> >> >removed and anything else I can use to replace it? > >> >> > > >> >> > >> >> ScriptPreProcessor was removed as part of the removal of IE8 support. > >> >> Do you have a customized version in use and if yes what problem do > you > >> >> solve with this? > >> >> > >> >> RBRI > >> >> > >> > > >> > > >> > >> > > > > > > |
|
From: Ronald B. <rb...@rb...> - 2016-08-25 09:13:21
|
Hi Rural, have a look at http://htmlunit.sourceforge.net/faq.html#HowToModifyRequestOrResponse I think this approach can solve your problem. RBRi On Thu, 25 Aug 2016 17:02:38 +0800 Rural Hunter wrote: > >Hi Ronald, > >We do need a similar solution. We usually supply a overridden pre-processor >to WebClient and do things like this in the pre-processor: > @Override > public String preProcess(HtmlPage hp, String sourceCode, String >sourceName, int lineNumber, HtmlElement he) > { > //qq zone temp fix > if(sourceName.indexOf("/qzone/")>0&&sourceCode.indexOf("if( >QZFL.userAgent.ie)")>0) > { > //System.out.println("Found ua code at >"+sourceName+"#"+lineNumber); > return sourceCode.replace("if(QZFL.userAgent.ie)", "if(false)"); > } > **/ > > return sourceCode; > } > >Sometimes it's not a bug and sometimes it's not practicable to wait for a >fix. > >2016-08-25 14:07 GMT+08:00 Ronald Brill <rb...@rb...>: > >> >We usually use this to diagnose js errors and filter/replace problematic >> js if we can not fix it. >> >> But this was not done by the original ScriptPreProcessor? How have you >> done this. >> Do you need a similar solution? >> >> Regarding problematic js - if HtmlUnit differs from real browsers this is >> a bug. Please report all this situations and we will try (sooner or later >> ;-) to fix this. >> >> RBRi >> >> On Thu, 25 Aug 2016 10:00:14 +0800 Rural Hunter wrote: >> > >> >Hi Ronald, >> > >> >We don't use a customized version. We were using 2.14 and I just try to >> >upgraded to 2.23. We usually use this to diagnose js errors and >> >filter/replace problematic js if we can not fix it. >> > >> >2016-08-24 23:20 GMT+08:00 Ronald Brill <rb...@rb...>: >> > >> >> On Wed, 24 Aug 2016 11:01:48 +0800 Rural Hunter wrote: >> >> > >> >> >I just tried to upgrade my htmlunit dependency from 2.14 to 2.23 and >> found >> >> >the ScriptPreProcessor is removed. I searched the javadoc and change >> >> >history but didn't find anything about the function deprecation. Why >> is it >> >> >removed and anything else I can use to replace it? >> >> > >> >> >> >> ScriptPreProcessor was removed as part of the removal of IE8 support. >> >> Do you have a customized version in use and if yes what problem do you >> >> solve with this? >> >> >> >> RBRI >> >> >> > >> > >> >> > > |
|
From: Rural H. <rur...@gm...> - 2016-08-25 09:02:48
|
Hi Ronald,
We do need a similar solution. We usually supply a overridden pre-processor
to WebClient and do things like this in the pre-processor:
@Override
public String preProcess(HtmlPage hp, String sourceCode, String
sourceName, int lineNumber, HtmlElement he)
{
//qq zone temp fix
if(sourceName.indexOf("/qzone/")>0&&sourceCode.indexOf("if(
QZFL.userAgent.ie)")>0)
{
//System.out.println("Found ua code at
"+sourceName+"#"+lineNumber);
return sourceCode.replace("if(QZFL.userAgent.ie)", "if(false)");
}
**/
return sourceCode;
}
Sometimes it's not a bug and sometimes it's not practicable to wait for a
fix.
2016-08-25 14:07 GMT+08:00 Ronald Brill <rb...@rb...>:
> >We usually use this to diagnose js errors and filter/replace problematic
> js if we can not fix it.
>
> But this was not done by the original ScriptPreProcessor? How have you
> done this.
> Do you need a similar solution?
>
> Regarding problematic js - if HtmlUnit differs from real browsers this is
> a bug. Please report all this situations and we will try (sooner or later
> ;-) to fix this.
>
> RBRi
>
> On Thu, 25 Aug 2016 10:00:14 +0800 Rural Hunter wrote:
> >
> >Hi Ronald,
> >
> >We don't use a customized version. We were using 2.14 and I just try to
> >upgraded to 2.23. We usually use this to diagnose js errors and
> >filter/replace problematic js if we can not fix it.
> >
> >2016-08-24 23:20 GMT+08:00 Ronald Brill <rb...@rb...>:
> >
> >> On Wed, 24 Aug 2016 11:01:48 +0800 Rural Hunter wrote:
> >> >
> >> >I just tried to upgrade my htmlunit dependency from 2.14 to 2.23 and
> found
> >> >the ScriptPreProcessor is removed. I searched the javadoc and change
> >> >history but didn't find anything about the function deprecation. Why
> is it
> >> >removed and anything else I can use to replace it?
> >> >
> >>
> >> ScriptPreProcessor was removed as part of the removal of IE8 support.
> >> Do you have a customized version in use and if yes what problem do you
> >> solve with this?
> >>
> >> RBRI
> >>
> >
> >
>
>
|
|
From: M. A. <ma...@ho...> - 2016-08-25 07:45:43
|
Please could you unsubscribe me from this list.. It's not working when trying to unsubscribe in the url : https://lists.sourceforge.net/lists/options/htmlunit-develop I never receive the confirmation email... Cheers, ________________________________ De : Ronald Brill <rb...@rb...> Envoyé : jeudi 25 août 2016 06:55 À : htm...@li...; Vasudevan Comandur Objet : Re: [Htmlunit-user] Clarification Needed on XPATH Hi Vasu > When I was using HTMLUNIT 2.10, I did not see xml-apis-1.x.x.jar in the > dependency JAR file list. Now, the current version has xmi-apis-1.4.01.jar > file bundled with dependency library list. Please note that I was not using the > XPATH API calls that comes with HTMLUnit. version 2.10 is now 4 years old, maybe something has changed inbetween :-) xml-apis-1.4.01.jar is a dependency required by xercesImpl 2.11.0. Xerces is used by our html parser; this has nothing to do with XPath handling. > The data extraction using XPATH which was working on earlier version of > HTMLUnit does not seem to work in current version of HTMLUnit. > > Is there any reason for this behaviour?. Am I doing anything wrong? Yes there is :-). But without more details i can only guess what might going wrong. Possible options are * we did some fixes for the html parser that results in a different (of course more correct) dom tree. In this case you might adjust your XPath. * we did some fixes for the XPath processing itself. In this case you might fix your XPath. * we have (unintentionally) added some new bugs. In this case you have to file an issue. Maybe there are more possible reasons. Outside of this, it will be easier for you and for us to nail down problems, if the version jumps are not that big. Keep in mind, that we usually support only the latest version. There is no time for us to do more. It might be a good tactic to be in sync with the latest release and update you software shortly after new release of HtmlUnit are available. > > Looking forward to some pointers on this issue. Hope that helps. > >Regards > Vasu > > > >----< Inline text [text-plain-04.txt] >------------------ > >------------------------------------------------------------------------------ > > > >----< Inline text [text-plain-05.txt] >------------------ > >_______________________________________________ >Htmlunit-user mailing list >Htm...@li... >https://lists.sourceforge.net/lists/listinfo/htmlunit-user Htmlunit-user Info Page - SourceForge<https://lists.sourceforge.net/lists/listinfo/htmlunit-user> lists.sourceforge.net To see the collection of prior postings to the list, visit the Htmlunit-user Archives. Using Htmlunit-user: To post a message to all the list members ... > > ------------------------------------------------------------------------------ _______________________________________________ Htmlunit-user mailing list Htm...@li... https://lists.sourceforge.net/lists/listinfo/htmlunit-user |
|
From: Ronald B. <rb...@rb...> - 2016-08-25 06:56:14
|
Hi Vasu > When I was using HTMLUNIT 2.10, I did not see xml-apis-1.x.x.jar in the > dependency JAR file list. Now, the current version has xmi-apis-1.4.01.jar > file bundled with dependency library list. Please note that I was not using the > XPATH API calls that comes with HTMLUnit. version 2.10 is now 4 years old, maybe something has changed inbetween :-) xml-apis-1.4.01.jar is a dependency required by xercesImpl 2.11.0. Xerces is used by our html parser; this has nothing to do with XPath handling. > The data extraction using XPATH which was working on earlier version of > HTMLUnit does not seem to work in current version of HTMLUnit. > > Is there any reason for this behaviour?. Am I doing anything wrong? Yes there is :-). But without more details i can only guess what might going wrong. Possible options are * we did some fixes for the html parser that results in a different (of course more correct) dom tree. In this case you might adjust your XPath. * we did some fixes for the XPath processing itself. In this case you might fix your XPath. * we have (unintentionally) added some new bugs. In this case you have to file an issue. Maybe there are more possible reasons. Outside of this, it will be easier for you and for us to nail down problems, if the version jumps are not that big. Keep in mind, that we usually support only the latest version. There is no time for us to do more. It might be a good tactic to be in sync with the latest release and update you software shortly after new release of HtmlUnit are available. > > Looking forward to some pointers on this issue. Hope that helps. > >Regards > Vasu > > > >----< Inline text [text-plain-04.txt] >------------------ > >------------------------------------------------------------------------------ > > > >----< Inline text [text-plain-05.txt] >------------------ > >_______________________________________________ >Htmlunit-user mailing list >Htm...@li... >https://lists.sourceforge.net/lists/listinfo/htmlunit-user > > |
|
From: Ronald B. <rb...@rb...> - 2016-08-25 06:07:56
|
>We usually use this to diagnose js errors and filter/replace problematic js if we can not fix it. But this was not done by the original ScriptPreProcessor? How have you done this. Do you need a similar solution? Regarding problematic js - if HtmlUnit differs from real browsers this is a bug. Please report all this situations and we will try (sooner or later ;-) to fix this. RBRi On Thu, 25 Aug 2016 10:00:14 +0800 Rural Hunter wrote: > >Hi Ronald, > >We don't use a customized version. We were using 2.14 and I just try to >upgraded to 2.23. We usually use this to diagnose js errors and >filter/replace problematic js if we can not fix it. > >2016-08-24 23:20 GMT+08:00 Ronald Brill <rb...@rb...>: > >> On Wed, 24 Aug 2016 11:01:48 +0800 Rural Hunter wrote: >> > >> >I just tried to upgrade my htmlunit dependency from 2.14 to 2.23 and found >> >the ScriptPreProcessor is removed. I searched the javadoc and change >> >history but didn't find anything about the function deprecation. Why is it >> >removed and anything else I can use to replace it? >> > >> >> ScriptPreProcessor was removed as part of the removal of IE8 support. >> Do you have a customized version in use and if yes what problem do you >> solve with this? >> >> RBRI >> > > |
|
From: Rural H. <rur...@gm...> - 2016-08-25 02:00:20
|
Hi Ronald, We don't use a customized version. We were using 2.14 and I just try to upgraded to 2.23. We usually use this to diagnose js errors and filter/replace problematic js if we can not fix it. 2016-08-24 23:20 GMT+08:00 Ronald Brill <rb...@rb...>: > On Wed, 24 Aug 2016 11:01:48 +0800 Rural Hunter wrote: > > > >I just tried to upgrade my htmlunit dependency from 2.14 to 2.23 and found > >the ScriptPreProcessor is removed. I searched the javadoc and change > >history but didn't find anything about the function deprecation. Why is it > >removed and anything else I can use to replace it? > > > > ScriptPreProcessor was removed as part of the removal of IE8 support. > Do you have a customized version in use and if yes what problem do you > solve with this? > > RBRI > |
|
From: Vasudevan C. <vco...@gm...> - 2016-08-24 21:38:18
|
Hi,
When I was using HTMLUNIT 2.10, I did not see xml-apis-1.x.x.jar in the
dependency JAR file list. Now, the current version has
xmi-apis-1.4.01.jar
file bundled with dependency library list. Please note that I was not
using the
XPATH API calls that comes with HTMLUnit.
The data extraction using XPATH which was working on earlier version of
HTMLUnit does not seem to work in current version of HTMLUnit.
Is there any reason for this behaviour?. Am I doing anything wrong?
Looking forward to some pointers on this issue.
Regards
Vasu
|
|
From: Ronald B. <rb...@rb...> - 2016-08-24 15:20:50
|
On Wed, 24 Aug 2016 11:01:48 +0800 Rural Hunter wrote: > >I just tried to upgrade my htmlunit dependency from 2.14 to 2.23 and found >the ScriptPreProcessor is removed. I searched the javadoc and change >history but didn't find anything about the function deprecation. Why is it >removed and anything else I can use to replace it? > ScriptPreProcessor was removed as part of the removal of IE8 support. Do you have a customized version in use and if yes what problem do you solve with this? RBRI |
|
From: Tristan J. <tt7...@gm...> - 2016-08-24 07:32:50
|
Very helpful thank you very much. In this case it seems absolute that I do not need to provide a client certificate (as PayPal has its own server side one and would not recognize mine anyways) On Aug 24, 2016 2:30 AM, "Ahmed Ashour" <asa...@ya...> wrote: > Hi, > > There are two things, server Certificate and (optional) client certificate. > > SSL ensures your password is secure. > > You need to trust the server certificate only if it not trusted by its > chain (in which case you would get an SSL exception). > > You don't provider your own certificate, except if the server needs client > certificate and yours is known to it. > > Hope that helps, > Ahmed > > > ------------------------------ > *From:* Tristan Janicki <tt7...@gm...> > *To:* "htm...@li..." <htmlunit-user@lists. > sourceforge.net> > *Sent:* Tuesday, August 23, 2016 7:33 AM > *Subject:* [Htmlunit-user] SSL Client Certificate > > I've been creating a program that will log into a given paypal account and > then navigate to the activities page to pull all the transactions on that > list to be displayed in a table. However, I'm wondering if the credentials > of the user that's logging in will be secure or not. Paypal of course uses > HTTPs/SSL etc. but my question is do I need to provide a certificate of my > own? If not then will the user name and password still be as safe as if I > was using my normal chrome browser? Would distributing this app make the > login credentials insecure (past the inherit ability to find them in the > source code). > > It says here that I don't need to have one on my side but I'd just like > to be absolutely sure. > > ~ Thank you in advance. > > ------------------------------------------------------------ > ------------------ > > _______________________________________________ > Htmlunit-user mailing list > Htm...@li... > https://lists.sourceforge.net/lists/listinfo/htmlunit-user > > > > ------------------------------------------------------------ > ------------------ > > _______________________________________________ > Htmlunit-user mailing list > Htm...@li... > https://lists.sourceforge.net/lists/listinfo/htmlunit-user > > |
|
From: Ahmed A. <asa...@ya...> - 2016-08-24 06:46:09
|
Hi, 'localAddress' has been added to WebClientOptions for such parameter, in SVN. Please get latest build from [1] (once green) and test. Ahmed [1] https://ci.canoo.com/teamcity/viewLog.html?buildTypeId=HtmlUnit_FastBuild&buildId=lastSuccessful&tab=artifacts From: xpro6000 <xpr...@gm...> To: htm...@li... Sent: Thursday, August 18, 2016 4:31 AM Subject: [Htmlunit-user] Forcing htmlunit to use a specific NIC (Network interface controller) Hello Everyone HTMLUnit uses httpclient for its http interactions and from what I understand it is possible to tell httpclient to use a specific NIC if the machine has more than one NIC. How can one achieve this with HTMLUnit? ------------------------------------------------------------------------------ _______________________________________________ Htmlunit-user mailing list Htm...@li... https://lists.sourceforge.net/lists/listinfo/htmlunit-user |
|
From: Ahmed A. <asa...@ya...> - 2016-08-24 06:29:37
|
Hi,
There are two things, server Certificate and (optional) client certificate.
SSL ensures your password is secure.
You need to trust the server certificate only if it not trusted by its chain (in which case you would get an SSL exception).
You don't provider your own certificate, except if the server needs client certificate and yours is known to it.
Hope that helps,
Ahmed
From: Tristan Janicki <tt7...@gm...>
To: "htm...@li..." <htm...@li...>
Sent: Tuesday, August 23, 2016 7:33 AM
Subject: [Htmlunit-user] SSL Client Certificate
I've been creating a program that will log into a given paypal account and then navigate to the activities page to pull all the transactions on that list to be displayed in a table. However, I'm wondering if the credentials of the user that's logging in will be secure or not. Paypal of course uses HTTPs/SSL etc. but my question is do I need to provide a certificate of my own? If not then will the user name and password still be as safe as if I was using my normal chrome browser? Would distributing this app make the login credentials insecure (past the inherit ability to find them in the source code).
It says here that I don't need to have one on my side but I'd just like to be absolutely sure.
~ Thank you in advance.
------------------------------------------------------------------------------
_______________________________________________
Htmlunit-user mailing list
Htm...@li...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user
|
|
From: Rural H. <rur...@gm...> - 2016-08-24 03:01:55
|
I just tried to upgrade my htmlunit dependency from 2.14 to 2.23 and found the ScriptPreProcessor is removed. I searched the javadoc and change history but didn't find anything about the function deprecation. Why is it removed and anything else I can use to replace it? |
|
From: Tristan J. <tt7...@gm...> - 2016-08-23 05:33:21
|
I've been creating a program that will log into a given paypal account and then navigate to the activities page to pull all the transactions on that list to be displayed in a table. However, I'm wondering if the credentials of the user that's logging in will be secure or not. Paypal of course uses HTTPs/SSL etc. but my question is do I need to provide a certificate of my own? If not then will the user name and password still be as safe as if I was using my normal chrome browser? Would distributing this app make the login credentials insecure (past the inherit ability to find them in the source code). It says here <http://security.stackexchange.com/questions/110621/ssl-newbie-does-https-client-also-need-a-certificate> that I don't need to have one on my side but I'd just like to be absolutely sure. ~ Thank you in advance. |
|
From: Lucas V. C. <use...@gm...> - 2016-08-19 06:13:54
|
We have automated tests using Selenium[1] and HtmlUnitDriver[2] to verify a web-application product. It delegates sometimes to external services which are not under our control, in example Facebook. Since a few weeks ago, this delegation to Facebook seems to fail only when using the HtmlUnit, as other browsers works fine. What I see is that after posting credentials in the Facebook page, seems that HtmlUnit is not POSTing them and stays in the same page. When doing by hand the same process and analyzing traffic using Chrome tools, the credentials POST is originated by "Other". Would help if I add an example using HtmlUnitDriver API? I don't know If I'd be able to create an example using plain HtmlUnit API. Thanks! [1]: https://github.com/SeleniumHQ/selenium [2]: https://github.com/SeleniumHQ/htmlunit-driver -- Lucas |
|
From: xpro6000 <xpr...@gm...> - 2016-08-18 02:31:46
|
Hello Everyone HTMLUnit uses httpclient for its http interactions and from what I understand it is possible to tell httpclient to use a specific NIC if the machine has more than one NIC. How can one achieve this with HTMLUnit? |
|
From: nonSonoPaola <non...@gm...> - 2016-08-09 18:11:10
|
<?xml version="1.0" encoding="UTF-8"?>
<html>
<head>
<meta charset="utf-8" />
<script src="resources/jquery-1.12.3-ver-1462804975000.js"
type="text/javascript">
</script>
<script src="resources/wicket-event-jquery-ver-1462804975000.js"
type="text/javascript">
</script>
<script src="resources/jquery-1.10.2.min.js" type="text/javascript">
</script>
<script src="resources/shieldui-all.min.js" type="text/javascript">
</script>
<link rel="stylesheet" type="text/css" href="resources//all.min.css" />
<script type="text/javascript">
//<![CDATA[
/*<![CDATA[*/
Wicket.Event.add(window, "domready", function(event) {
jQuery(function($) {
$('#chart1')
.shieldChart(
{
"axisX" : {
"axisTickText" : {
"textAngle" : 90
},
"categoricalValues" : [ "03:00", "04:00",
"05:00", "06:00", "07:00", "08:00",
"09:00", "10:00", "11:00", "12:00",
"13:00", "14:00", "15:00", "16:00",
"17:00", "18:00", "19:00", "20:00",
"21:00", "22:00", "23:00" ]
},
"dataSeries" : [
{
"seriesType" : "rangebar",
"data" : [ [ 99.71, 99.84 ],
[ 99.71, 99.85 ],
[ 99.71, 99.85 ],
[ 99.71, 99.85 ],
[ 99.71, 99.85 ],
[ 99.71, 99.85 ],
[ 99.7, 99.83 ],
[ 99.71, 99.84 ],
[ 99.71, 99.84 ],
[ 99.71, 99.83 ],
[ 99.68, 99.84 ],
[ 99.71, 99.85 ],
[ 99.69, 99.84 ],
[ 99.7, 99.84 ],
[ 99.7, 99.84 ],
[ 99.67, 99.85 ],
[ 99.71, 99.84 ],
[ 99.7, 99.84 ],
[ 99.69, 99.82 ],
[ 99.7, 99.84 ],
[ 99.71, 99.85 ] ],
"collectionAlias" : "STAT 1"
},
{
"seriesType" : "spline",
"data" : [ 99.78, 99.78, 99.78,
99.78, 99.78, 99.78, 99.77,
99.78, 99.78, 99.77, 99.76,
99.78, 99.77, 99.77, 99.77,
99.76, 99.78, 99.77, 99.75,
99.77, 99.78 ],
"collectionAlias" : "STAT 2"
},
{
"seriesType" : "spline",
"data" : [ 99.8, 99.81, 99.81,
99.82, 99.81, 99.81, 99.81,
99.81, 99.81, 99.8, 99.78,
99.8, 99.79, 99.8, 99.8,
99.78, 99.8, 99.8, 99.78,
99.8, 99.8 ],
"collectionAlias" : "STAT 3"
} ],
"seriesSettings" : {
"rangebar" : {
"enablePointSelection" : false,
"barOffset" : 0.4
}
},
"primaryHeader" : {
"text" : "THE CHART TITLE"
},
"seriesPalette" : [ "#ADD8E6", "#FFD700",
"#FF0000" ],
"theme" : "default",
"exportOptions" : {
"image" : false,
"print" : false
},
"axisY" : {
"title" : {
"text" : "Statistics"
}
}
});
});
;
jQuery(function($) {
$('#data2').shieldGrid({
"altRows" : true,
"dataSource" : {
"data" : [ {
"MAX" : "99.84",
"STAT 3" : "99.8",
" " : "03:00",
"MIN" : "99.71",
"STAT 2" : "99.78"
}, {
"MAX" : "99.85",
"STAT 3" : "99.81",
" " : "04:00",
"MIN" : "99.71",
"STAT 2" : "99.78"
}, {
"MAX" : "99.85",
"STAT 3" : "99.81",
" " : "05:00",
"MIN" : "99.71",
"STAT 2" : "99.78"
}, {
"MAX" : "99.85",
"STAT 3" : "99.82",
" " : "06:00",
"MIN" : "99.71",
"STAT 2" : "99.78"
}, {
"MAX" : "99.85",
"STAT 3" : "99.81",
" " : "07:00",
"MIN" : "99.71",
"STAT 2" : "99.78"
}, {
"MAX" : "99.85",
"STAT 3" : "99.81",
" " : "08:00",
"MIN" : "99.71",
"STAT 2" : "99.78"
}, {
"MAX" : "99.83",
"STAT 3" : "99.81",
" " : "09:00",
"MIN" : "99.7",
"STAT 2" : "99.77"
}, {
"MAX" : "99.84",
"STAT 3" : "99.81",
" " : "10:00",
"MIN" : "99.71",
"STAT 2" : "99.78"
}, {
"MAX" : "99.84",
"STAT 3" : "99.81",
" " : "11:00",
"MIN" : "99.71",
"STAT 2" : "99.78"
}, {
"MAX" : "99.83",
"STAT 3" : "99.8",
" " : "12:00",
"MIN" : "99.71",
"STAT 2" : "99.77"
}, {
"MAX" : "99.84",
"STAT 3" : "99.78",
" " : "13:00",
"MIN" : "99.68",
"STAT 2" : "99.76"
}, {
"MAX" : "99.85",
"STAT 3" : "99.8",
" " : "14:00",
"MIN" : "99.71",
"STAT 2" : "99.78"
}, {
"MAX" : "99.84",
"STAT 3" : "99.79",
" " : "15:00",
"MIN" : "99.69",
"STAT 2" : "99.77"
}, {
"MAX" : "99.84",
"STAT 3" : "99.8",
" " : "16:00",
"MIN" : "99.7",
"STAT 2" : "99.77"
}, {
"MAX" : "99.84",
"STAT 3" : "99.8",
" " : "17:00",
"MIN" : "99.7",
"STAT 2" : "99.77"
}, {
"MAX" : "99.85",
"STAT 3" : "99.78",
" " : "18:00",
"MIN" : "99.67",
"STAT 2" : "99.76"
}, {
"MAX" : "99.84",
"STAT 3" : "99.8",
" " : "19:00",
"MIN" : "99.71",
"STAT 2" : "99.78"
}, {
"MAX" : "99.84",
"STAT 3" : "99.8",
" " : "20:00",
"MIN" : "99.7",
"STAT 2" : "99.77"
}, {
"MAX" : "99.82",
"STAT 3" : "99.78",
" " : "21:00",
"MIN" : "99.69",
"STAT 2" : "99.75"
}, {
"MAX" : "99.84",
"STAT 3" : "99.8",
" " : "22:00",
"MIN" : "99.7",
"STAT 2" : "99.77"
}, {
"MAX" : "99.85",
"STAT 3" : "99.8",
" " : "23:00",
"MIN" : "99.71",
"STAT 2" : "99.78"
} ]
},
"columnReorder" : false,
"columns" : [ {
"field" : " "
}, {
"field" : "MIN"
}, {
"field" : "MAX"
}, {
"field" : "STAT 2"
}, {
"field" : "STAT 3"
} ],
"resizing" : false
});
});
;
Wicket.Event.publish(Wicket.Event.Topic.AJAX_HANDLERS_BOUND);
;
});
/*]]>*/
//]]>
</script>
</head>
<body style="">
<ul id="default-report">
<li class="report-item">
<div class="shieldui-report-item">
<div class="item-chart shield-chart" id="chart1">
<div id="shielddw" class="shield-container"
style="position: relative; overflow: hidden; width: 1256px; height: 400px; line-height: normal; z-index: 0; font-family: Segoe UI, Tahoma, Verdana, sans-serif; font-size: 12px;">
<svg xmlns="http://www.w3.org/2000/svg" version="1.1" width="1256"
height="400">
<defs>
<clipPath id="shielddx">
<rect rx="0" ry="0" fill="none" x="0" y="0"
width="9999" height="400" stroke-width="0.000001" />
</clipPath>
<clipPath id="shielddy">
<rect fill="none" x="0" y="0" width="1224"
height="337" />
</clipPath>
<filter id="0223ab17-6a52-4664-966a-c2178d3fdb27"
height="120%">
<feGaussianBlur in="SourceAlpha" stdDeviation="3" />
<feComponentTransfer>
<feFuncA type="linear" slope="0.2" />
</feComponentTransfer>
<feMerge>
<feMergeNode />
<feMergeNode in="SourceGraphic" />
</feMerge>
</filter>
</defs>
<rect rx="0" ry="0" fill="#FFFFFF" x="0" y="0"
width="1256" height="400" stroke-width="0.000001" />
<g zIndex="1" />
<g zIndex="1">
<path fill="none" d="M 22 310.5 L 1246 310.5"
stroke="#C0C0C0" stroke-width="1" stroke-dasharray="none"
zIndex="1" />
<path fill="none" d="M 22 242.5 L 1246 242.5"
stroke="#C0C0C0" stroke-width="1" stroke-dasharray="none"
zIndex="1" />
<path fill="none" d="M 22 175.5 L 1246 175.5"
stroke="#C0C0C0" stroke-width="1" stroke-dasharray="none"
zIndex="1" />
<path fill="none" d="M 22 107.5 L 1246 107.5"
stroke="#C0C0C0" stroke-width="1" stroke-dasharray="none"
zIndex="1" />
<path fill="none" d="M 22 40.5 L 1246 40.5"
stroke="#C0C0C0" stroke-width="1" stroke-dasharray="none"
zIndex="1" />
<path fill="none" d="M 22 377.5 L 1246 377.5"
stroke="#C0C0C0" stroke-width="1" stroke-dasharray="none"
zIndex="1" />
</g>
<g zIndex="2">
<path fill="none" d="M 138.5 377 L 138.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 196.5 377 L 196.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 254.5 377 L 254.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 312.5 377 L 312.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 371.5 377 L 371.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 429.5 377 L 429.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 487.5 377 L 487.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 546.5 377 L 546.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 604.5 377 L 604.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 662.5 377 L 662.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 720.5 377 L 720.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 779.5 377 L 779.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 837.5 377 L 837.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 895.5 377 L 895.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 954.5 377 L 954.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 1012.5 377 L 1012.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 1070.5 377 L 1070.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 1128.5 377 L 1128.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 1187.5 377 L 1187.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 1245.5 377 L 1245.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 79.5 377 L 79.5 383"
stroke="#636363" stroke-width="1" />
<path fill="none" d="M 22 377.5 L 1246 377.5"
stroke="#636363" stroke-width="1" zIndex="7"
visibility="visible" />
</g>
<g zIndex="2">
<text x="10" y="208.5"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;font-weight:normal;fill:#636363;"
zIndex="7" transform="rotate(270 10 208)" text-anchor="middle"
visibility="visible">
<tspan x="10">
Statistics
</tspan>
</text>
</g>
<g zIndex="3">
<g visibility="visible" zIndex="0.1"
transform="translate(22,40)" clip-path="url(#shielddy)">
<rect fill="#ADD8E6" x="25" y="80.88000000000306"
width="8" height="175.21999999999696" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="83" y="67.40000000001532"
width="8" height="188.6999999999847" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="141" y="67.40000000001532"
width="8" height="188.6999999999847" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="200" y="67.40000000001532"
width="8" height="188.6999999999847" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="258" y="67.40000000001532"
width="8" height="188.6999999999847" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="316" y="67.40000000001532"
width="8" height="188.6999999999847" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="374" y="94.36000000000996"
width="8" height="175.23999999999006" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="433" y="80.88000000000306"
width="8" height="175.21999999999696" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="491" y="80.88000000000306"
width="8" height="175.21999999999696" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="549" y="94.36000000000996"
width="8" height="161.73999999999006" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="608" y="80.88000000000306"
width="8" height="215.71999999999696" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="666" y="67.40000000001532"
width="8" height="188.6999999999847" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="724" y="80.88000000000306"
width="8" height="202.21999999999696" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="782" y="80.88000000000306"
width="8" height="188.71999999999696" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="841" y="80.88000000000306"
width="8" height="188.71999999999696" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="899" y="67.40000000001532"
width="8" height="242.59999999998468" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="957" y="80.88000000000306"
width="8" height="175.21999999999696" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="1016" y="80.88000000000306"
width="8" height="188.71999999999696" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="1074" y="107.84000000001686"
width="8" height="175.25999999998317" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="1132" y="80.88000000000306"
width="8" height="188.71999999999696" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
<rect fill="#ADD8E6" x="1190" y="67.40000000001532"
width="8" height="188.6999999999847" stroke-width="0.000001"
stroke="#FFFFFF" rx="0" ry="0" />
</g>
<g visibility="visible" zIndex="0.1"
transform="translate(22,40)" />
<g visibility="visible" zIndex="0.1"
transform="translate(22,40)" clip-path="url(#shielddy)">
<path fill="none"
d="M 29.142857142857142 161.8 C 29.142857142857142 161.8 64.11428571428571 161.8 87.42857142857143 161.8 C 110.74285714285716 161.8 122.4 161.8 145.71428571428572 161.8 C 169.0285714285714 161.8 180.68571428571428 161.8 204 161.8 C 227.3142857142857 161.8 238.9714285714286 161.8 262.2857142857143 161.8 C 285.6 161.8 297.25714285714287 161.8 320.5714285714286 161.8 C 343.8857142857143 161.8 355.54285714285714 175.2 378.8571428571429 175.2 C 402.17142857142863 175.2 413.8285714285715 161.8 437.14285714285717 161.8 C 460.4571428571429 161.8 472.1142857142857 161.8 495.42857142857144 161.8 C 518.742857142857 161.8 530.4 169.82 553.7142857142857 175.2 C 577.0285714285714 180.57999999999998 588.6857142857143 188.7 612 188.7 C 635.3142857142857 188.7 646.9714285714285 161.8 670.2857142857142 161.8 C 693.6 161.8 705.2571428571429 175.2 728.5714285714286 175.2 C 751.8857142857144 175.2 763.5428571428571 175.2 786.8571428571428 175.2 C 810.1714285714286 175.2 821.8285714285714 175.2 845.1428571428571 175.2 C 868.4571428571428 175.2 880.1142857142855 188.7 903.4285714285713 188.7 C 926.742857142857 188.7 938.4 161.8 961.7142857142857 161.8 C 985.0285714285714 161.8 996.6857142857143 167.11999999999998 1020 175.2 C 1043.3142857142857 183.27999999999997 1054.9714285714285 202.2 1078.2857142857142 202.2 C 1101.6 202.2 1113.2571428571428 183.28 1136.5714285714284 175.2 C 1159.8857142857141 167.12 1194.857142857143 161.8 1194.857142857143 161.8"
stroke="#FFD700" stroke-width="3" zIndex="1" />
</g>
<g visibility="visible" zIndex="0.1"
transform="translate(22,40)" clip-path="none">
<path fill="#FFD700"
d="M 1194.857142857143 158.8 C 1198.853142857143 158.8 1198.853142857143 164.8 1194.857142857143 164.8 C 1190.8611428571428 164.8 1190.8611428571428 158.8 1194.857142857143 158.8 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 1136.5714285714284 172.2 C 1140.5674285714285 172.2 1140.5674285714285 178.2 1136.5714285714284 178.2 C 1132.5754285714283 178.2 1132.5754285714283 172.2 1136.5714285714284 172.2 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 1078.2857142857142 199.2 C 1082.2817142857143 199.2 1082.2817142857143 205.2 1078.2857142857142 205.2 C 1074.2897142857141 205.2 1074.2897142857141 199.2 1078.2857142857142 199.2 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 1020 172.2 C 1023.996 172.2 1023.996 178.2 1020 178.2 C 1016.004 178.2 1016.004 172.2 1020 172.2 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 961.7142857142857 158.8 C 965.7102857142856 158.8 965.7102857142856 164.8 961.7142857142857 164.8 C 957.7182857142857 164.8 957.7182857142857 158.8 961.7142857142857 158.8 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 903.4285714285713 185.7 C 907.4245714285713 185.7 907.4245714285713 191.7 903.4285714285713 191.7 C 899.4325714285714 191.7 899.4325714285714 185.7 903.4285714285713 185.7 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 845.1428571428571 172.2 C 849.1388571428571 172.2 849.1388571428571 178.2 845.1428571428571 178.2 C 841.1468571428571 178.2 841.1468571428571 172.2 845.1428571428571 172.2 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 786.8571428571428 172.2 C 790.8531428571428 172.2 790.8531428571428 178.2 786.8571428571428 178.2 C 782.8611428571428 178.2 782.8611428571428 172.2 786.8571428571428 172.2 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 728.5714285714286 172.2 C 732.5674285714285 172.2 732.5674285714285 178.2 728.5714285714286 178.2 C 724.5754285714286 178.2 724.5754285714286 172.2 728.5714285714286 172.2 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 670.2857142857142 158.8 C 674.2817142857142 158.8 674.2817142857142 164.8 670.2857142857142 164.8 C 666.2897142857142 164.8 666.2897142857142 158.8 670.2857142857142 158.8 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 612 185.7 C 615.996 185.7 615.996 191.7 612 191.7 C 608.004 191.7 608.004 185.7 612 185.7 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 553.7142857142857 172.2 C 557.7102857142856 172.2 557.7102857142856 178.2 553.7142857142857 178.2 C 549.7182857142857 178.2 549.7182857142857 172.2 553.7142857142857 172.2 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 495.42857142857144 158.8 C 499.4245714285714 158.8 499.4245714285714 164.8 495.42857142857144 164.8 C 491.43257142857146 164.8 491.43257142857146 158.8 495.42857142857144 158.8 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 437.14285714285717 158.8 C 441.13885714285715 158.8 441.13885714285715 164.8 437.14285714285717 164.8 C 433.1468571428572 164.8 433.1468571428572 158.8 437.14285714285717 158.8 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 378.8571428571429 172.2 C 382.85314285714287 172.2 382.85314285714287 178.2 378.8571428571429 178.2 C 374.8611428571429 178.2 374.8611428571429 172.2 378.8571428571429 172.2 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 320.5714285714286 158.8 C 324.5674285714286 158.8 324.5674285714286 164.8 320.5714285714286 164.8 C 316.57542857142863 164.8 316.57542857142863 158.8 320.5714285714286 158.8 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 262.2857142857143 158.8 C 266.28171428571426 158.8 266.28171428571426 164.8 262.2857142857143 164.8 C 258.2897142857143 164.8 258.2897142857143 158.8 262.2857142857143 158.8 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 204 158.8 C 207.996 158.8 207.996 164.8 204 164.8 C 200.004 164.8 200.004 158.8 204 158.8 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 145.71428571428572 158.8 C 149.71028571428573 158.8 149.71028571428573 164.8 145.71428571428572 164.8 C 141.7182857142857 164.8 141.7182857142857 158.8 145.71428571428572 158.8 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 87.42857142857143 158.8 C 91.42457142857143 158.8 91.42457142857143 164.8 87.42857142857143 164.8 C 83.43257142857144 164.8 83.43257142857144 158.8 87.42857142857143 158.8 Z"
stroke="#FFD700" stroke-width="2" />
<path fill="#FFD700"
d="M 29.142857142857142 158.8 C 33.13885714285714 158.8 33.13885714285714 164.8 29.142857142857142 164.8 C 25.146857142857144 164.8 25.146857142857144 158.8 29.142857142857142 158.8 Z"
stroke="#FFD700" stroke-width="2" />
</g>
<g visibility="visible" zIndex="0.1"
transform="translate(22,40)" clip-path="url(#shielddy)">
<path fill="none"
d="M 29.142857142857142 134.8 C 29.142857142857142 134.8 64.11428571428571 121.3 87.42857142857143 121.3 C 110.74285714285716 121.3 122.4 121.3 145.71428571428572 121.3 C 169.0285714285714 121.3 180.68571428571428 107.8 204 107.8 C 227.3142857142857 107.8 238.9714285714286 121.3 262.2857142857143 121.3 C 285.6 121.3 297.25714285714287 121.3 320.5714285714286 121.3 C 343.8857142857143 121.3 355.54285714285714 121.3 378.8571428571429 121.3 C 402.17142857142863 121.3 413.8285714285715 121.3 437.14285714285717 121.3 C 460.4571428571429 121.3 472.1142857142857 121.3 495.42857142857144 121.3 C 518.742857142857 121.3 530.4 126.70000000000002 553.7142857142857 134.8 C 577.0285714285714 142.9 588.6857142857143 161.8 612 161.8 C 635.3142857142857 161.8 646.9714285714285 134.8 670.2857142857142 134.8 C 693.6 134.8 705.2571428571429 148.3 728.5714285714286 148.3 C 751.8857142857144 148.3 763.5428571428571 134.8 786.8571428571428 134.8 C 810.1714285714286 134.8 821.8285714285714 134.8 845.1428571428571 134.8 C 868.4571428571428 134.8 880.1142857142855 161.8 903.4285714285713 161.8 C 926.742857142857 161.8 938.4 134.8 961.7142857142857 134.8 C 985.0285714285714 134.8 996.6857142857143 134.8 1020 134.8 C 1043.3142857142857 134.8 1054.9714285714285 161.8 1078.2857142857142 161.8 C 1101.6 161.8 1113.2571428571428 134.8 1136.5714285714284 134.8 C 1159.8857142857141 134.8 1194.857142857143 134.8 1194.857142857143 134.8"
stroke="#FF0000" stroke-width="3" zIndex="1" />
</g>
<g visibility="visible" zIndex="0.1"
transform="translate(22,40)" clip-path="none">
<path fill="#FF0000"
d="M 1194.857142857143 131.8 C 1198.853142857143 131.8 1198.853142857143 137.8 1194.857142857143 137.8 C 1190.8611428571428 137.8 1190.8611428571428 131.8 1194.857142857143 131.8 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 1136.5714285714284 131.8 C 1140.5674285714285 131.8 1140.5674285714285 137.8 1136.5714285714284 137.8 C 1132.5754285714283 137.8 1132.5754285714283 131.8 1136.5714285714284 131.8 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 1078.2857142857142 158.8 C 1082.2817142857143 158.8 1082.2817142857143 164.8 1078.2857142857142 164.8 C 1074.2897142857141 164.8 1074.2897142857141 158.8 1078.2857142857142 158.8 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 1020 131.8 C 1023.996 131.8 1023.996 137.8 1020 137.8 C 1016.004 137.8 1016.004 131.8 1020 131.8 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 961.7142857142857 131.8 C 965.7102857142856 131.8 965.7102857142856 137.8 961.7142857142857 137.8 C 957.7182857142857 137.8 957.7182857142857 131.8 961.7142857142857 131.8 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 903.4285714285713 158.8 C 907.4245714285713 158.8 907.4245714285713 164.8 903.4285714285713 164.8 C 899.4325714285714 164.8 899.4325714285714 158.8 903.4285714285713 158.8 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 845.1428571428571 131.8 C 849.1388571428571 131.8 849.1388571428571 137.8 845.1428571428571 137.8 C 841.1468571428571 137.8 841.1468571428571 131.8 845.1428571428571 131.8 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 786.8571428571428 131.8 C 790.8531428571428 131.8 790.8531428571428 137.8 786.8571428571428 137.8 C 782.8611428571428 137.8 782.8611428571428 131.8 786.8571428571428 131.8 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 728.5714285714286 145.3 C 732.5674285714285 145.3 732.5674285714285 151.3 728.5714285714286 151.3 C 724.5754285714286 151.3 724.5754285714286 145.3 728.5714285714286 145.3 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 670.2857142857142 131.8 C 674.2817142857142 131.8 674.2817142857142 137.8 670.2857142857142 137.8 C 666.2897142857142 137.8 666.2897142857142 131.8 670.2857142857142 131.8 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 612 158.8 C 615.996 158.8 615.996 164.8 612 164.8 C 608.004 164.8 608.004 158.8 612 158.8 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 553.7142857142857 131.8 C 557.7102857142856 131.8 557.7102857142856 137.8 553.7142857142857 137.8 C 549.7182857142857 137.8 549.7182857142857 131.8 553.7142857142857 131.8 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 495.42857142857144 118.3 C 499.4245714285714 118.3 499.4245714285714 124.3 495.42857142857144 124.3 C 491.43257142857146 124.3 491.43257142857146 118.3 495.42857142857144 118.3 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 437.14285714285717 118.3 C 441.13885714285715 118.3 441.13885714285715 124.3 437.14285714285717 124.3 C 433.1468571428572 124.3 433.1468571428572 118.3 437.14285714285717 118.3 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 378.8571428571429 118.3 C 382.85314285714287 118.3 382.85314285714287 124.3 378.8571428571429 124.3 C 374.8611428571429 124.3 374.8611428571429 118.3 378.8571428571429 118.3 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 320.5714285714286 118.3 C 324.5674285714286 118.3 324.5674285714286 124.3 320.5714285714286 124.3 C 316.57542857142863 124.3 316.57542857142863 118.3 320.5714285714286 118.3 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 262.2857142857143 118.3 C 266.28171428571426 118.3 266.28171428571426 124.3 262.2857142857143 124.3 C 258.2897142857143 124.3 258.2897142857143 118.3 262.2857142857143 118.3 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 204 104.8 C 207.996 104.8 207.996 110.8 204 110.8 C 200.004 110.8 200.004 104.8 204 104.8 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 145.71428571428572 118.3 C 149.71028571428573 118.3 149.71028571428573 124.3 145.71428571428572 124.3 C 141.7182857142857 124.3 141.7182857142857 118.3 145.71428571428572 118.3 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 87.42857142857143 118.3 C 91.42457142857143 118.3 91.42457142857143 124.3 87.42857142857143 124.3 C 83.43257142857144 124.3 83.43257142857144 118.3 87.42857142857143 118.3 Z"
stroke="#FF0000" stroke-width="2" />
<path fill="#FF0000"
d="M 29.142857142857142 131.8 C 33.13885714285714 131.8 33.13885714285714 137.8 29.142857142857142 137.8 C 25.146857142857144 137.8 25.146857142857144 131.8 29.142857142857142 131.8 Z"
stroke="#FF0000" stroke-width="2" />
</g>
</g>
<text x="628" y="25"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:16px;color:#4B4B4B;top:10;fill:#4B4B4B;"
text-anchor="middle" zIndex="4">
<tspan x="628">
THE CHART TITLE
</tspan>
</text>
<g zIndex="7" transform="translate(591,387)">
<g zIndex="1" clip-path="url(#shielddx)">
<g>
<g zIndex="1" transform="translate(8,3)">
<path fill="#ADD8E6"
d="M 1 6 L 11 6 11 16 1 16 Z" style="cursor:pointer;"
stroke="#ADD8E6" stroke-width="0.000001" />
<text x="17" y="15"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:12px;cursor:pointer;color:#3E576F;fill:#3E576F;"
text-anchor="start" zIndex="2">
<tspan x="17">
STAT 1
</tspan>
</text>
</g>
<g zIndex="1" transform="translate(33,3)">
<path fill="#FFD700"
d="M 1 6 L 11 6 11 16 1 16 Z" style="cursor:pointer;"
stroke="#FFD700" stroke-width="0.000001" />
<text x="17" y="15"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:12px;cursor:pointer;color:#3E576F;fill:#3E576F;"
text-anchor="start" zIndex="2">
<tspan x="17">
STAT 2
</tspan>
</text>
</g>
<g zIndex="1" transform="translate(58,3)">
<path fill="#FF0000"
d="M 1 6 L 11 6 11 16 1 16 Z" style="cursor:pointer;"
stroke="#FF0000" stroke-width="0.000001" />
<text x="17" y="15"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:12px;cursor:pointer;color:#3E576F;fill:#3E576F;"
text-anchor="start" zIndex="2">
<tspan x="17">
STAT 3
</tspan>
</text>
</g>
</g>
</g>
</g>
<g zIndex="7">
<text x="51.14285714285714" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle"
transform="rotate(90 51.14285714285714 394)"
visibility="visible">
<tspan x="51.14285714285714">
03:00
</tspan>
</text>
<text x="109.42857142857142" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle"
transform="rotate(90 109.42857142857142 394)"
visibility="visible">
<tspan x="109.42857142857142">
04:00
</tspan>
</text>
<text x="167.71428571428572" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle"
transform="rotate(90 167.71428571428572 394)"
visibility="visible">
<tspan x="167.71428571428572">
05:00
</tspan>
</text>
<text x="226" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle" transform="rotate(90 226 394)"
visibility="visible">
<tspan x="226">
06:00
</tspan>
</text>
<text x="284.2857142857143" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle"
transform="rotate(90 284.2857142857143 394)"
visibility="visible">
<tspan x="284.2857142857143">
07:00
</tspan>
</text>
<text x="342.57142857142856" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle"
transform="rotate(90 342.57142857142856 394)"
visibility="visible">
<tspan x="342.57142857142856">
08:00
</tspan>
</text>
<text x="400.85714285714283" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle"
transform="rotate(90 400.85714285714283 394)"
visibility="visible">
<tspan x="400.85714285714283">
09:00
</tspan>
</text>
<text x="459.1428571428571" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle"
transform="rotate(90 459.1428571428571 394)"
visibility="visible">
<tspan x="459.1428571428571">
10:00
</tspan>
</text>
<text x="517.4285714285714" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle"
transform="rotate(90 517.4285714285714 394)"
visibility="visible">
<tspan x="517.4285714285714">
11:00
</tspan>
</text>
<text x="575.7142857142857" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle"
transform="rotate(90 575.7142857142857 394)"
visibility="visible">
<tspan x="575.7142857142857">
12:00
</tspan>
</text>
<text x="634" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle" transform="rotate(90 634 394)"
visibility="visible">
<tspan x="634">
13:00
</tspan>
</text>
<text x="692.2857142857142" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle"
transform="rotate(90 692.2857142857142 394)"
visibility="visible">
<tspan x="692.2857142857142">
14:00
</tspan>
</text>
<text x="750.5714285714286" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle"
transform="rotate(90 750.5714285714286 394)"
visibility="visible">
<tspan x="750.5714285714286">
15:00
</tspan>
</text>
<text x="808.8571428571429" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle"
transform="rotate(90 808.8571428571429 394)"
visibility="visible">
<tspan x="808.8571428571429">
16:00
</tspan>
</text>
<text x="867.1428571428571" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle"
transform="rotate(90 867.1428571428571 394)"
visibility="visible">
<tspan x="867.1428571428571">
17:00
</tspan>
</text>
<text x="925.4285714285714" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle"
transform="rotate(90 925.4285714285714 394)"
visibility="visible">
<tspan x="925.4285714285714">
18:00
</tspan>
</text>
<text x="983.7142857142857" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle"
transform="rotate(90 983.7142857142857 394)"
visibility="visible">
<tspan x="983.7142857142857">
19:00
</tspan>
</text>
<text x="1042" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle" transform="rotate(90 1042 394)"
visibility="visible">
<tspan x="1042">
20:00
</tspan>
</text>
<text x="1100.2857142857142" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle"
transform="rotate(90 1100.2857142857142 394)"
visibility="visible">
<tspan x="1100.2857142857142">
21:00
</tspan>
</text>
<text x="1158.5714285714284" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle"
transform="rotate(90 1158.5714285714284 394)"
visibility="visible">
<tspan x="1158.5714285714284">
22:00
</tspan>
</text>
<text x="1216.857142857143" y="394"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="middle"
transform="rotate(90 1216.857142857143 394)"
visibility="visible">
<tspan x="1216.857142857143">
23:00
</tspan>
</text>
</g>
<g zIndex="7">
<text x="14" y="389.6"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;width:592px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="end" visibility="visible">
<tspan x="14">
99.65
</tspan>
</text>
<text x="14" y="322.20000000000385"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;width:592px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="end" visibility="visible">
<tspan x="14">
99.70
</tspan>
</text>
<text x="14" y="254.80000000000766"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;width:592px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="end" visibility="visible">
<tspan x="14">
99.75
</tspan>
</text>
<text x="14" y="187.4000000000115"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;width:592px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="end" visibility="visible">
<tspan x="14">
99.80
</tspan>
</text>
<text x="14" y="120.00000000001532"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;width:592px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="end" visibility="visible">
<tspan x="14">
99.85
</tspan>
</text>
<text x="14" y="52.6"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:11px;width:592px;color:#636363;line-height:14px;fill:#636363;"
text-anchor="end" visibility="visible">
<tspan x="14">
99.90
</tspan>
</text>
</g>
<text x="27" y="60"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:16px;cursor:pointer;color:#999999;fill:#999999;"
text-anchor="start" zIndex="8">
<tspan x="27">
Demo Version
</tspan>
</text>
<text x="1241" y="60"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:16px;cursor:pointer;color:#999999;fill:#999999;"
text-anchor="end" zIndex="8">
<tspan x="1241">
Demo Version
</tspan>
</text>
<text x="27" y="372"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:16px;cursor:pointer;color:#999999;fill:#999999;"
text-anchor="start" zIndex="8">
<tspan x="27">
Demo Version
</tspan>
</text>
<text x="1241" y="372"
style="font-family:Segoe UI, Tahoma, Verdana, sans-serif;font-size:16px;cursor:pointer;color:#999999;fill:#999999;"
text-anchor="end" zIndex="8">
<tspan x="1241">
Demo Version
</tspan>
</text>
<g zIndex="9">
<g visibility="visible" zIndex="1"
transform="translate(22,40)" clip-path="url(#shielddy)">
<rect fill="rgb(192,192,192)" x="25"
y="80.88000000000306" width="8" height="175.21999999999696"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="83"
y="67.40000000001532" width="8" height="188.6999999999847"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="141"
y="67.40000000001532" width="8" height="188.6999999999847"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="200"
y="67.40000000001532" width="8" height="188.6999999999847"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="258"
y="67.40000000001532" width="8" height="188.6999999999847"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="316"
y="67.40000000001532" width="8" height="188.6999999999847"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="374"
y="94.36000000000996" width="8" height="175.23999999999006"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="433"
y="80.88000000000306" width="8" height="175.21999999999696"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="491"
y="80.88000000000306" width="8" height="175.21999999999696"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="549"
y="94.36000000000996" width="8" height="161.73999999999006"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="608"
y="80.88000000000306" width="8" height="215.71999999999696"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="666"
y="67.40000000001532" width="8" height="188.6999999999847"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="724"
y="80.88000000000306" width="8" height="202.21999999999696"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="782"
y="80.88000000000306" width="8" height="188.71999999999696"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="841"
y="80.88000000000306" width="8" height="188.71999999999696"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="899"
y="67.40000000001532" width="8" height="242.59999999998468"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="957"
y="80.88000000000306" width="8" height="175.21999999999696"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="1016"
y="80.88000000000306" width="8" height="188.71999999999696"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="1074"
y="107.84000000001686" width="8" height="175.25999999998317"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="1132"
y="80.88000000000306" width="8" height="188.71999999999696"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
<rect fill="rgb(192,192,192)" x="1190"
y="67.40000000001532" width="8" height="188.6999999999847"
isTracker="1470758094180" fill-opacity="0.0001"
visibility="visible" style="" />
</g>
<g visibility="visible" zIndex="1"
transform="translate(22,40)">
<path fill="none"
d="M 19.142857142857142 161.8 L 29.142857142857142 161.8 C 29.142857142857142 161.8 64.11428571428571 161.8 87.42857142857143 161.8 C 110.74285714285716 161.8 122.4 161.8 145.71428571428572 161.8 C 169.0285714285714 161.8 180.68571428571428 161.8 204 161.8 C 227.3142857142857 161.8 238.9714285714286 161.8 262.2857142857143 161.8 C 285.6 161.8 297.25714285714287 161.8 320.5714285714286 161.8 C 343.8857142857143 161.8 355.54285714285714 175.2 378.8571428571429 175.2 C 402.17142857142863 175.2 413.8285714285715 161.8 437.14285714285717 161.8 C 460.4571428571429 161.8 472.1142857142857 161.8 495.42857142857144 161.8 C 518.742857142857 161.8 530.4 169.82 553.7142857142857 175.2 C 577.0285714285714 180.57999999999998 588.6857142857143 188.7 612 188.7 C 635.3142857142857 188.7 646.9714285714285 161.8 670.2857142857142 161.8 C 693.6 161.8 705.2571428571429 175.2 728.5714285714286 175.2 C 751.8857142857144 175.2 763.5428571428571 175.2 786.8571428571428 175.2 C 810.1714285714286 175.2 821.8285714285714 175.2 845.1428571428571 175.2 C 868.4571428571428 175.2 880.1142857142855 188.7 903.4285714285713 188.7 C 926.742857142857 188.7 938.4 161.8 961.7142857142857 161.8 C 985.0285714285714 161.8 996.6857142857143 167.11999999999998 1020 175.2 C 1043.3142857142857 183.27999999999997 1054.9714285714285 202.2 1078.2857142857142 202.2 C 1101.6 202.2 1113.2571428571428 183.28 1136.5714285714284 175.2 C 1159.8857142857141 167.12 1194.857142857143 161.8 1194.857142857143 161.8 L 1204.857142857143 161.8"
isTracker="true" stroke-linejoin="bevel" visibility="visible"
stroke-opacity="0.0001" stroke="rgb(192,192,192)"
stroke-width="23" style="" />
</g>
<g visibility="visible" zIndex="1"
transform="translate(22,40)">
<path fill="none"
d="M 19.142857142857142 134.8 L 29.142857142857142 134.8 C 29.142857142857142 134.8 64.11428571428571 121.3 87.42857142857143 121.3 C 110.74285714285716 121.3 122.4 121.3 145.71428571428572 121.3 C 169.0285714285714 121.3 180.68571428571428 107.8 204 107.8 C 227.3142857142857 107.8 238.9714285714286 121.3 262.2857142857143 121.3 C 285.6 121.3 297.25714285714287 121.3 320.5714285714286 121.3 C 343.8857142857143 121.3 355.54285714285714 121.3 378.8571428571429 121.3 C 402.17142857142863 121.3 413.8285714285715 121.3 437.14285714285717 121.3 C 460.4571428571429 121.3 472.1142857142857 121.3 495.42857142857144 121.3 C 518.742857142857 121.3 530.4 126.70000000000002 553.7142857142857 134.8 C 577.0285714285714 142.9 588.6857142857143 161.8 612 161.8 C 635.3142857142857 161.8 646.9714285714285 134.8 670.2857142857142 134.8 C 693.6 134.8 705.2571428571429 148.3 728.5714285714286 148.3 C 751.8857142857144 148.3 763.5428571428571 134.8 786.8571428571428 134.8 C 810.1714285714286 134.8 821.8285714285714 134.8 845.1428571428571 134.8 C 868.4571428571428 134.8 880.1142857142855 161.8 903.4285714285713 161.8 C 926.742857142857 161.8 938.4 134.8 961.7142857142857 134.8 C 985.0285714285714 134.8 996.6857142857143 134.8 1020 134.8 C 1043.3142857142857 134.8 1054.9714285714285 161.8 1078.2857142857142 161.8 C 1101.6 161.8 1113.2571428571428 134.8 1136.5714285714284 134.8 C 1159.8857142857141 134.8 1194.857142857143 134.8 1194.857142857143 134.8 L 1204.857142857143 134.8"
isTracker="true" stroke-linejoin="bevel" visibility="visible"
stroke-opacity="0.0001" stroke="rgb(192,192,192)"
stroke-width="23" style="" />
</g>
</g>
</svg>
</div>
<div class="shield-tooltip" style="pointer-events: none"></div>
</div>
</div>
</li>
</ul>
</body>
</html>
|
|
From: John S. <ko...@ea...> - 2016-07-30 21:27:21
|
I did some more work and found that even with the javascript errors reported in Netbeans, fiddler has all the java scripts were returning 200. In Chrome I compared the same search vs Htmlunit, A bit deep for me but Chrome has some cookie information in the search request and HtmlUnit only as JSession ID. Htmlunit has two responses with the data show up in Fiddler. Chrome only one. Then I thought I should look at what other browers do, so checked IE brower and fiddler does not show cookies in the search request but only a JSession ID. (more like Htmlunit) Then I thought I should try setting Htmlunit to IE and see what the results were. Well Low and behold the result data ends up being returned in to Java. There is only one response that shows up in Fiddler instead of the Two in Chrome, and there was no add cookie data with the Jessision ID. FireFox seems to work too. Went back to Chrome to double check and it still had the same not working results. Also note that I am on Htmlunit 2.22 and there has been an upgrade to 2.23. I don't know if that had a Chrome update within it. Anyway I need to use the working stuff now to see if I can get some actual work done. But I use Chrome and would still like to know how to get it to work if anyone has any ideas. Thanks John |
|
From: Ronald B. <rb...@rb...> - 2016-07-30 12:23:37
|
Hi Ben,
your code confuses me a bit.
HtmlUnit is designed more or less as a high level API, usually there is no need to work with something HttpResponse and HttpEntity.
To make the idea a bit more clear you can do the following:
1. Setup your 'browser'
WebClient webClient = new WebClient();
webClient.getOptions().setThrowExceptionOnScriptError(false);
Because the web site you like to visit throws some javascript errors (check the browser log of the real browser) you have to define this option. Otherwise HtmlUnit will stop working at the first js exception.
2. Open the page and fill the form
String startURL = "http://webapps.nyc.gov:8084/CICS/fin1/find001i";
HtmlPage page = webClient.getPage(startURL);
HtmlSelect borough = (HtmlSelect) page.getElementByName("FBORO");
HtmlOption option = borough.getOptionByText("Manhattan");
option.setSelected(true);
HtmlTextInput houseNum = (HtmlTextInput) page.getElementByName("FHOUSENUM");
houseNum.setValueAttribute("100");
HtmlTextInput streetName = (HtmlTextInput) page.getElementByName("FSTNAME");
streetName.setValueAttribute("a");
As you can see, you can use the controls on the page directly. There are a bunch of different ways to find the controls (by id, name, xpath, css selector....)
3. Its time to trigger some action
HtmlSubmitInput search = (HtmlSubmitInput) page.getElementByName("DFH_ENTER");
HtmlPage result = search.click();
It is that simple - no need to interact with all the http stuff
4. OK done with or first page
System.out.println(result.asXml());
Hope that helps
RBRi
--------------------------
WETATOR
Smart web application testing
http://www.wetator.org
On Fri, 29 Jul 2016 22:31:20 +0000 May, Benjamin L. wrote:
>
>Bump! Still need to figure this out
>
>From: May, Benjamin L.
>Sent: Thursday, July 28, 2016 7:45 AM
>To: 'Ahmed Ashour' <asa...@ya...>; 'htm...@li...' <htm...@li...>
>Subject: RE: [Htmlunit-user] first time user
>
>Hey Ahmed,
>
>I recompiled today using the newly-released 2.23 and it still doesn't work.
>
>If you run the code snippet below by itself it works but the content of the page is an error message. If you run the full code, which involves several prior pages which are saving session variables somewhere on the server side and it actually
>attempts to run the real results page, it still does a stack overflow. The full code (with as much extraneous code and dependencies removed) is attached. It's ugly but this is a one-time scrape so it doesn't have to be pretty! :)
>
>-Ben
>
>From: Ahmed Ashour [mailto:asa...@ya...]
>Sent: Wednesday, July 27, 2016 9:00 AM
>To: htm...@li...<mailto:htm...@li...>
>Subject: Re: [Htmlunit-user] first time user
>
>Hi May,
>
>Which version do you use?
>
>With latest snapshot (a release is imminent), there are no errors.
>
>Ahmed
>
>________________________________
>From: "May, Benjamin L." <bl...@cu...<mailto:bl...@cu...>>
>To: "'htm...@li...'" <htm...@li...<mailto:htm...@li...>>
>Sent: Wednesday, July 27, 2016 4:16 AM
>Subject: [Htmlunit-user] first time user
>
>Hey all! First time using this library, just trying to get a page that requires javascript... Code snippet:
>
> WebClient webClient = new WebClient(BrowserVersion.CHROME);
>
> webClient.getOptions().setJavaScriptEnabled(true);
> webClient.getOptions().setCssEnabled(false);
> webClient.getOptions().setRedirectEnabled(true);
> webClient.getOptions().setThrowExceptionOnScriptError(false);
> webClient.getOptions().setThrowExceptionOnFailingStatusCode(false);
> webClient.getOptions().setPrintContentOnFailingStatusCode(true);
> webClient.getOptions().setThrowExceptionOnScriptError(false);
>
> String link = "http://nycprop.nyc.gov/nycproperty/statements/flk/jsp/stmtassessflk.jsp?statementId=104487723";
> HtmlPage page = webClient.getPage(link);
> webClient.waitForBackgroundJavaScript(30 * 1000);
> String pageAsText = page.asText();
> System.out.println(pageAsText);
>
>And I am getting a HUGE stackoverflow exception. If you try and view the URL in a browser with JS disabled you get a message about needing to turn it on, but there's barely any javascript in the page source from what I can see...
>
>TIA!
>
>
>----< Inline text [text-plain-04.txt] >------------------
>
>------------------------------------------------------------------------------
>
>
>
>----< Inline text [text-plain-05.txt] >------------------
>
>_______________________________________________
>Htmlunit-user mailing list
>Htm...@li...
>https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>
>
|
|
From: John S. <ko...@ea...> - 2016-07-30 07:44:40
|
Hi, I have been using a bit of htmlunit to download data and documents from websites for about a year. One of those sites updated there interface to https and to be more "mobile". I have not been able to acquire the search result data. I connected Fiddler to help. I can see the initial page open, set the name and see the page updated, then when the java clicks the search button I don't get the results in htmlunit, if I send that to the terminal I get a page that states "loading", which I don't see in fiddler, But I can see the search result page returned in fiddler (two times) . And as a test I can copy that fiddler text, save to a file.html and open the result that matches what I would see in a browser. I think I have goggled , looked and tried everything but an working answer. I don't know if I am in a complex htmlunit/javascript/https or a simple beginner htmlunit programing issue. It's so close to have the data in fiddler and not be able to get in into java. I have tried a number of webClient.getOptions and wait forJava script in different combinations. I would be thankful for any pointers that might help and thought I would check first for a beginner mistakes. And then post the more voluminous errors / Fiddler results after that if needed, because it looks like I have the same errors getting to the page with the search name entered as trying to get to the search results . Sorry if the below is a bit verbose but I tried to cut to a minimum total test case at least. Thanks John Me, a bit over my head as a 1970/80 microprocessor assembler programmer, dabbling in java/htmlunit htmlunit-2.22-bin.zip Product Version: NetBeans IDE 8.0.2 (Build 201411181905) Updates: NetBeans IDE is updated to version NetBeans 8.0.2 Patch 2 Java: 1.8.0_60; Java HotSpot(TM) 64-Bit Server VM 25.60-b23 Runtime: Java(TM) SE Runtime Environment 1.8.0_60-b27 System: Windows 7 version 6.1 running on amd64; Cp1252; en_US (nb) Telerik Fiddler Web Debugger (v4.6.2.32002) I have a number of errors that pop up. Most are css errors under "ALL" and are not "SEVERE". The SEVERE errors all start with . illegal selector. and look like this example: SEVERE: runtimeError: message=[An invalid or illegal selector was specified (selector: '[id='sizzle-1469854857076'] :mobile-panel' error: Invalid selector: [id="sizzle-1469854857076"] :mobile-panel).] sourceName=[https://crrecords.slocounty.ca.gov/SLOWeb/resources/jquery-1.11. 0.js;jsessionid=F228FB048D9BE7AAFED5E8B5B8725160] line=[865] lineSource=[null] lineOffset=[0] Actual code from netbeans: package slodeeddatascraper; import com.gargoylesoftware.htmlunit.BrowserVersion; import com.gargoylesoftware.htmlunit.FailingHttpStatusCodeException; import com.gargoylesoftware.htmlunit.NicelyResynchronizingAjaxController; import com.gargoylesoftware.htmlunit.SilentCssErrorHandler; import com.gargoylesoftware.htmlunit.WebClient; import com.gargoylesoftware.htmlunit.html.HtmlAnchor; import com.gargoylesoftware.htmlunit.html.HtmlForm; import com.gargoylesoftware.htmlunit.html.HtmlPage; import com.gargoylesoftware.htmlunit.html.HtmlTextInput; import java.io.File; import java.io.IOException; import java.util.logging.Level; import java.util.logging.Logger; public class SLODeedDataScraper { public static void main(String[] args) { java.util.logging.Logger.getLogger("com.gargoylesoftware").setLevel(Level.SE VERE); // ALL SEVERE OFF try (final WebClient webClient = new WebClient(BrowserVersion.CHROME,"127.0.0.1", 8888)) { webClient.getOptions().setJavaScriptEnabled(true); webClient.getOptions().setTimeout(40000);// increase from 2000 to 40000 webClient.getOptions().setUseInsecureSSL(true); webClient.getCookieManager().setCookiesEnabled(true); webClient.getOptions().setThrowExceptionOnScriptError(false); webClient.getOptions().setPrintContentOnFailingStatusCode(false); webClient.setCssErrorHandler(new SilentCssErrorHandler()); webClient.setAjaxController(new NicelyResynchronizingAjaxController()); try { HtmlPage page1 = webClient.getPage("https://crrecords.slocounty.ca.gov/SLOWeb/search/DOCSEARC H215S1"); webClient.waitForBackgroundJavaScriptStartingBefore(10000); webClient.waitForBackgroundJavaScript(100000); HtmlForm form = page1.getForms().get(0); // Change the value of the text field to the name to search for final HtmlTextInput textField = form.getInputByName("field_BothNamesID"); textField.setValueAttribute("Snyder"); webClient.waitForBackgroundJavaScriptStartingBefore(10000); webClient.waitForBackgroundJavaScript(100000); // save page as file in the dir above netbeans page1.save(new File("..//../myfile2.html")); System.out.println("Test 20.00 tests good name placed in field "); // webpage Search Button code: // <a class="self-service-right ui-link ui-btn ui-btn-b ui-icon-search ui-btn-icon-right ui-btn-inline ui-shadow ui-corner-all" // id="searchButton" // data-role="button" data-inline="true" data-theme="b" data-icon="search" data-iconpos="right" // href="/SLOWeb/searchResults/DOCSEARCH215S1" // role="button"> Search </a> System.out.println("Test 40.02 HtmlAnchor found:" +form.getFirstByXPath(".//a[@id='searchButton']")); HtmlAnchor anchor = form.getFirstByXPath(".//a[@id='searchButton']"); anchor.click(); webClient.waitForBackgroundJavaScriptStartingBefore(10000); webClient.waitForBackgroundJavaScript(100000); System.out.println("Test 60.09 Done waitForBackgroundJavaScript..." ); // Check for results from of search System.out.println(page1.asXml()); // save page as file in the dir above netbeans page1.save(new File("..//../myfile4.html")); } catch (IOException ex) { Logger.getLogger(SLODeedDataScraper.class.getName()).log(Level.SEVERE, null, ex); } catch (FailingHttpStatusCodeException ex) { Logger.getLogger(SLODeedDataScraper.class.getName()).log(Level.SEVERE, null, ex); } } } } |
|
From: May, B. L. <bl...@cu...> - 2016-07-29 22:31:28
|
Bump! Still need to figure this out…
From: May, Benjamin L.
Sent: Thursday, July 28, 2016 7:45 AM
To: 'Ahmed Ashour' <asa...@ya...>; 'htm...@li...' <htm...@li...>
Subject: RE: [Htmlunit-user] first time user
Hey Ahmed,
I recompiled today using the newly-released 2.23 and it still doesn’t work.
If you run the code snippet below by itself it works but the content of the page is an error message. If you run the full code, which involves several prior pages which are saving session variables somewhere on the server side and it actually attempts to run the real results page, it still does a stack overflow. The full code (with as much extraneous code and dependencies removed) is attached. It’s ugly but this is a one-time scrape so it doesn’t have to be pretty! :)
-Ben
From: Ahmed Ashour [mailto:asa...@ya...]
Sent: Wednesday, July 27, 2016 9:00 AM
To: htm...@li...<mailto:htm...@li...>
Subject: Re: [Htmlunit-user] first time user
Hi May,
Which version do you use?
With latest snapshot (a release is imminent), there are no errors.
Ahmed
________________________________
From: "May, Benjamin L." <bl...@cu...<mailto:bl...@cu...>>
To: "'htm...@li...'" <htm...@li...<mailto:htm...@li...>>
Sent: Wednesday, July 27, 2016 4:16 AM
Subject: [Htmlunit-user] first time user
Hey all! First time using this library, just trying to get a page that requires javascript... Code snippet:
WebClient webClient = new WebClient(BrowserVersion.CHROME);
webClient.getOptions().setJavaScriptEnabled(true);
webClient.getOptions().setCssEnabled(false);
webClient.getOptions().setRedirectEnabled(true);
webClient.getOptions().setThrowExceptionOnScriptError(false);
webClient.getOptions().setThrowExceptionOnFailingStatusCode(false);
webClient.getOptions().setPrintContentOnFailingStatusCode(true);
webClient.getOptions().setThrowExceptionOnScriptError(false);
String link = "http://nycprop.nyc.gov/nycproperty/statements/flk/jsp/stmtassessflk.jsp?statementId=104487723";
HtmlPage page = webClient.getPage(link);
webClient.waitForBackgroundJavaScript(30 * 1000);
String pageAsText = page.asText();
System.out.println(pageAsText);
And I am getting a HUGE stackoverflow exception. If you try and view the URL in a browser with JS disabled you get a message about needing to turn it on, but there's barely any javascript in the page source from what I can see...
TIA!
|
|
From: Ronald B. <rb...@rb...> - 2016-07-28 19:35:20
|
Hopefully this is fixed as side effect of another fix i did some minutes before. Please use the latest snapshot build. RBRi On Thu, 28 Jul 2016 07:58:01 +0100 Peter Rader wrote: > >Collegues, > >I often have IAE exceptions like this: > >Exception in thread "HtmlUnit Managed Thread #83 for WebWindow : >XMLHttpRequest.send" java.lang.IllegalArgumentException: Illegal group >reference > at java.util.regex.Matcher.appendReplacement(Matcher.java:857) > at java.util.regex.Matcher.replaceAll(Matcher.java:955) > at >com.gargoylesoftware.htmlunit.javascript.regexp.HtmlUnitRegExpProxy.action(HtmlUnitRegExpProxy.java:75) > at org.mozilla.javascript.NativeString.execIdCall(NativeString.java:380) > at org.mozilla.javascript.IdFunctionObject.call(IdFunctionObject.java:129) > at org.mozilla.javascript.Interpreter.interpretLoop(Interpreter.java:3330) > at org.mozilla.javascript.Interpreter.interpret(Interpreter.java:2487) > at >org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:164) > at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:398) > at >com.gargoylesoftware.htmlunit.javascript.HtmlUnitContextFactory.doTopCall(HtmlUnitContextFactory.java:192) > at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3065) > at >org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:162) > at >com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:472) > at >com.gargoylesoftware.htmlunit.javascript.host.XMLHttpRequest.setState(XMLHttpRequest.java:142) > at >com.gargoylesoftware.htmlunit.javascript.host.XMLHttpRequest.doSend(XMLHttpRequest.java:413) > at >com.gargoylesoftware.htmlunit.javascript.host.XMLHttpRequest.access$000(XMLHttpRequest.java:54) > at >com.gargoylesoftware.htmlunit.javascript.host.XMLHttpRequest$1.run(XMLHttpRequest.java:361) > at org.mozilla.javascript.Context.call(Context.java:515) > at org.mozilla.javascript.ContextFactory.call(ContextFactory.java:507) > at >com.gargoylesoftware.htmlunit.javascript.host.XMLHttpRequest$2.run(XMLHttpRequest.java:367) > at java.lang.Thread.run(Thread.java:745) > at >com.gargoylesoftware.htmlunit.ThreadManager$1.run(ThreadManager.java:116) > >Any idea? > >Regards > > >------------------------------------------------------------------------------ >_______________________________________________ >Htmlunit-user mailing list >Htm...@li... >https://lists.sourceforge.net/lists/listinfo/htmlunit-user > |
|
From: Ronald B. <rb...@rb...> - 2016-07-28 16:28:18
|
Looks like a Bug. Plaese open an issue and try to attach a sample replace call that triggers this. RBRi On Thu, 28 Jul 2016 07:58:01 +0100 Peter Rader wrote: > >Collegues, > >I often have IAE exceptions like this: > >Exception in thread "HtmlUnit Managed Thread #83 for WebWindow : >XMLHttpRequest.send" java.lang.IllegalArgumentException: Illegal group >reference > at java.util.regex.Matcher.appendReplacement(Matcher.java:857) > at java.util.regex.Matcher.replaceAll(Matcher.java:955) > at >com.gargoylesoftware.htmlunit.javascript.regexp.HtmlUnitRegExpProxy.action(HtmlUnitRegExpProxy.java:75) > at org.mozilla.javascript.NativeString.execIdCall(NativeString.java:380) > at org.mozilla.javascript.IdFunctionObject.call(IdFunctionObject.java:129) > at org.mozilla.javascript.Interpreter.interpretLoop(Interpreter.java:3330) > at org.mozilla.javascript.Interpreter.interpret(Interpreter.java:2487) > at >org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:164) > at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:398) > at >com.gargoylesoftware.htmlunit.javascript.HtmlUnitContextFactory.doTopCall(HtmlUnitContextFactory.java:192) > at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3065) > at >org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:162) > at >com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.callFunction(JavaScriptEngine.java:472) > at >com.gargoylesoftware.htmlunit.javascript.host.XMLHttpRequest.setState(XMLHttpRequest.java:142) > at >com.gargoylesoftware.htmlunit.javascript.host.XMLHttpRequest.doSend(XMLHttpRequest.java:413) > at >com.gargoylesoftware.htmlunit.javascript.host.XMLHttpRequest.access$000(XMLHttpRequest.java:54) > at >com.gargoylesoftware.htmlunit.javascript.host.XMLHttpRequest$1.run(XMLHttpRequest.java:361) > at org.mozilla.javascript.Context.call(Context.java:515) > at org.mozilla.javascript.ContextFactory.call(ContextFactory.java:507) > at >com.gargoylesoftware.htmlunit.javascript.host.XMLHttpRequest$2.run(XMLHttpRequest.java:367) > at java.lang.Thread.run(Thread.java:745) > at >com.gargoylesoftware.htmlunit.ThreadManager$1.run(ThreadManager.java:116) > >Any idea? > >Regards > > >------------------------------------------------------------------------------ >_______________________________________________ >Htmlunit-user mailing list >Htm...@li... >https://lists.sourceforge.net/lists/listinfo/htmlunit-user > |
|
From: May, B. L. <bl...@cu...> - 2016-07-28 11:45:20
|
Hey Ahmed,
I recompiled today using the newly-released 2.23 and it still doesn’t work.
If you run the code snippet below by itself it works but the content of the page is an error message. If you run the full code, which involves several prior pages which are saving session variables somewhere on the server side and it actually attempts to run the real results page, it still does a stack overflow. The full code (with as much extraneous code and dependencies removed) is attached. It’s ugly but this is a one-time scrape so it doesn’t have to be pretty! :)
-Ben
From: Ahmed Ashour [mailto:asa...@ya...]
Sent: Wednesday, July 27, 2016 9:00 AM
To: htm...@li...
Subject: Re: [Htmlunit-user] first time user
Hi May,
Which version do you use?
With latest snapshot (a release is imminent), there are no errors.
Ahmed
________________________________
From: "May, Benjamin L." <bl...@cu...<mailto:bl...@cu...>>
To: "'htm...@li...'" <htm...@li...<mailto:htm...@li...>>
Sent: Wednesday, July 27, 2016 4:16 AM
Subject: [Htmlunit-user] first time user
Hey all! First time using this library, just trying to get a page that requires javascript... Code snippet:
WebClient webClient = new WebClient(BrowserVersion.CHROME);
webClient.getOptions().setJavaScriptEnabled(true);
webClient.getOptions().setCssEnabled(false);
webClient.getOptions().setRedirectEnabled(true);
webClient.getOptions().setThrowExceptionOnScriptError(false);
webClient.getOptions().setThrowExceptionOnFailingStatusCode(false);
webClient.getOptions().setPrintContentOnFailingStatusCode(true);
webClient.getOptions().setThrowExceptionOnScriptError(false);
String link = "http://nycprop.nyc.gov/nycproperty/statements/flk/jsp/stmtassessflk.jsp?statementId=104487723";
HtmlPage page = webClient.getPage(link);
webClient.waitForBackgroundJavaScript(30 * 1000);
String pageAsText = page.asText();
System.out.println(pageAsText);
And I am getting a HUGE stackoverflow exception. If you try and view the URL in a browser with JS disabled you get a message about needing to turn it on, but there's barely any javascript in the page source from what I can see...
TIA!
|
189 messages has been excluded from this view by a project administrator.
