Menu
▾
▴
htmlunit-user — Discussion of the use of HtmlUnit
You can subscribe to this list here.
| 2003 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
(6) |
Jul
(17) |
Aug
(18) |
Sep
(22) |
Oct
(16) |
Nov
(6) |
Dec
(11) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2004 |
Jan
(11) |
Feb
(10) |
Mar
(34) |
Apr
(26) |
May
(6) |
Jun
(22) |
Jul
(14) |
Aug
(4) |
Sep
(47) |
Oct
(69) |
Nov
(23) |
Dec
(21) |
| 2005 |
Jan
(53) |
Feb
(33) |
Mar
(92) |
Apr
(65) |
May
(63) |
Jun
(57) |
Jul
(43) |
Aug
(132) |
Sep
(61) |
Oct
(75) |
Nov
(60) |
Dec
(130) |
| 2006 |
Jan
(74) |
Feb
(87) |
Mar
(101) |
Apr
(58) |
May
(54) |
Jun
(42) |
Jul
(31) |
Aug
(67) |
Sep
(61) |
Oct
(71) |
Nov
(28) |
Dec
(58) |
| 2007 |
Jan
(53) |
Feb
(50) |
Mar
(96) |
Apr
(66) |
May
(55) |
Jun
(130) |
Jul
(99) |
Aug
(115) |
Sep
(37) |
Oct
(78) |
Nov
(24) |
Dec
(70) |
| 2008 |
Jan
(94) |
Feb
(85) |
Mar
(197) |
Apr
(274) |
May
(119) |
Jun
(143) |
Jul
(193) |
Aug
(99) |
Sep
(160) |
Oct
(120) |
Nov
(178) |
Dec
(109) |
| 2009 |
Jan
(238) |
Feb
(169) |
Mar
(115) |
Apr
(109) |
May
(131) |
Jun
(167) |
Jul
(144) |
Aug
(193) |
Sep
(155) |
Oct
(154) |
Nov
(97) |
Dec
(127) |
| 2010 |
Jan
(108) |
Feb
(127) |
Mar
(176) |
Apr
(113) |
May
(130) |
Jun
(200) |
Jul
(115) |
Aug
(80) |
Sep
(92) |
Oct
(101) |
Nov
(124) |
Dec
(53) |
| 2011 |
Jan
(67) |
Feb
(144) |
Mar
(88) |
Apr
(60) |
May
(89) |
Jun
(54) |
Jul
(68) |
Aug
(81) |
Sep
(48) |
Oct
(40) |
Nov
(10) |
Dec
(20) |
| 2012 |
Jan
(21) |
Feb
(28) |
Mar
(17) |
Apr
(35) |
May
(41) |
Jun
(44) |
Jul
(68) |
Aug
(67) |
Sep
(89) |
Oct
(58) |
Nov
(47) |
Dec
(56) |
| 2013 |
Jan
(49) |
Feb
(28) |
Mar
(46) |
Apr
(31) |
May
(28) |
Jun
(37) |
Jul
(34) |
Aug
(52) |
Sep
(42) |
Oct
(108) |
Nov
(59) |
Dec
(56) |
| 2014 |
Jan
(41) |
Feb
(72) |
Mar
(46) |
Apr
(21) |
May
(19) |
Jun
(17) |
Jul
(15) |
Aug
(40) |
Sep
(11) |
Oct
(3) |
Nov
(5) |
Dec
(31) |
| 2015 |
Jan
(11) |
Feb
(12) |
Mar
(19) |
Apr
(19) |
May
(38) |
Jun
(54) |
Jul
(14) |
Aug
(42) |
Sep
(14) |
Oct
(16) |
Nov
(26) |
Dec
(14) |
| 2016 |
Jan
(3) |
Feb
(1) |
Mar
(24) |
Apr
(5) |
May
(15) |
Jun
(14) |
Jul
(33) |
Aug
(19) |
Sep
(8) |
Oct
(10) |
Nov
|
Dec
(2) |
| 2017 |
Jan
(16) |
Feb
(12) |
Mar
(23) |
Apr
(8) |
May
(11) |
Jun
(20) |
Jul
(21) |
Aug
(20) |
Sep
|
Oct
(6) |
Nov
(9) |
Dec
(2) |
| 2018 |
Jan
(7) |
Feb
(5) |
Mar
(6) |
Apr
(5) |
May
(1) |
Jun
(2) |
Jul
(2) |
Aug
|
Sep
(4) |
Oct
(3) |
Nov
|
Dec
(4) |
| 2019 |
Jan
(2) |
Feb
(2) |
Mar
(3) |
Apr
(4) |
May
|
Jun
(4) |
Jul
(9) |
Aug
(2) |
Sep
|
Oct
(4) |
Nov
(1) |
Dec
(7) |
| 2020 |
Jan
(2) |
Feb
(6) |
Mar
(9) |
Apr
(1) |
May
(1) |
Jun
(15) |
Jul
(1) |
Aug
(1) |
Sep
(2) |
Oct
(6) |
Nov
(3) |
Dec
(5) |
| 2021 |
Jan
(3) |
Feb
(1) |
Mar
(2) |
Apr
(1) |
May
|
Jun
(1) |
Jul
(1) |
Aug
(3) |
Sep
(1) |
Oct
|
Nov
(1) |
Dec
|
| 2022 |
Jan
|
Feb
|
Mar
|
Apr
|
May
(2) |
Jun
(1) |
Jul
(4) |
Aug
|
Sep
|
Oct
|
Nov
(1) |
Dec
(6) |
| 2025 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
(1) |
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
|
From: Nitin <nit...@gm...> - 2014-11-20 11:10:47
|
I generally use fiddler for such requirements. On Nov 20, 2014 4:39 PM, "teramera" <ter...@gm...> wrote: > i want to log all http requests that are being made when a url is loaded > and > javascript is executed. > Is there any way to accomplish this using htmlunit > > thanks > > > > -- > View this message in context: > http://htmlunit.10904.n7.nabble.com/Log-ajax-requests-HTMLUnit-tp35000.html > Sent from the HtmlUnit - General mailing list archive at Nabble.com. > > > ------------------------------------------------------------------------------ > Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server > from Actuate! Instantly Supercharge Your Business Reports and Dashboards > with Interactivity, Sharing, Native Excel Exports, App Integration & more > Get technology previously reserved for billion-dollar corporations, FREE > > http://pubads.g.doubleclick.net/gampad/clk?id=157005751&iu=/4140/ostg.clktrk > _______________________________________________ > Htmlunit-user mailing list > Htm...@li... > https://lists.sourceforge.net/lists/listinfo/htmlunit-user > |
|
From: teramera <ter...@gm...> - 2014-11-20 11:08:14
|
i want to log all http requests that are being made when a url is loaded and javascript is executed. Is there any way to accomplish this using htmlunit thanks -- View this message in context: http://htmlunit.10904.n7.nabble.com/Log-ajax-requests-HTMLUnit-tp35000.html Sent from the HtmlUnit - General mailing list archive at Nabble.com. |
|
From: Kevin K. <ke...@ce...> - 2014-11-17 09:56:29
|
Hello Guys,
I am currently using htmlunit to simulate scrapping of a web page that
requires an ssl client certificate to be installed (https connection). This
certificate has successfully been installed in my windows OS . On access of
the given webpage via web browsers(chrome & IE), a prompt is issued to
select a personal certificate that will be used . I would like to access
the windows cert store preferably this personal certificate to authenticate
and create a successful connection to my htmlunit client.
I have managed to research on the SunMSCAPI with Windows-MY to read the
store as shown in below code.
Provider provider = Security.getProvider("SunMSCAPI");
KeyStore store = KeyStore.getInstance("Windows-MY", provider);
store.load(null, null);
Enumeration<?> aliases = store.aliases();
while (aliases.hasMoreElements()) {
String alias = aliases.nextElement().toString();
if (alias.equals("mypersonalcert")) {
Certificate[] signerKey = (Certificate[]) store
.getCertificateChain(alias);
Object entry = store.getKey(alias, null);
System.out
.println("cert aquired! got it");
}
}
How do I successfully integrate this to my htmlunit webconnection and web
client instance for connection?
Input will be highly appreciated.
|
|
From: Yuta T. <y.t...@gm...> - 2014-10-28 10:29:24
|
Hi Team, I am writing this e-mail for asking some questions about the scope (e.g. variable and function definition) and DOM tree implementation of HtmlUnit. Now, I would like to execute arbitrary JavaScript codes using the clone (copy) of original JavaScript scope and DOM tree information separately from these of original. I don't want to affect the original scope and DOM tree by executing arbitrary JavaScript codes. So, I tried to write/execute the following arbitrary codes with HtmlUnit 2.13, but does not work well. # cannot copy the information cf. https://developer.mozilla.org/en-US/docs/Mozilla/Projects/Rhino/Scopes_and_Contexts In addition, I tried to execute the following arbitrary JavaScript codes in JavaScriptEngine.java before READY_STATE_COMPLETE of HtmlPage.java. // clone DOM tree HtmlPage tempHtmlPage = htmlPage.clone(); // cannot clone the HtmlPage HtmlPage tempHtmlPage = htmlPage.cloneNode(false); // cannot clone the HtmlPage HtmlPage tempHtmlPage = htmlPage.cloneNode(true); // error at DomNode // clone scope Scriptable globalScope = getScope(htmlPage, null); Context cx = ContextFactory.getGlobal().enterContext(); Scriptable localScope = cx.newObject(globalScope); localScope.setPrototype(globalScope); localScope.setParentScope(null); // 'localScope' does not keep DOM tree information. or final SimpleScriptable tempScope = ((SimpleScriptable) htmlPage.getScriptableObject()).clone(); // 'tempScope' is the same scope of original. So, please tell me the way how to execute arbitrary JavaScript codes using the clone (copy) of scope and DOM information. Looking forward to your help. Regards, Yuta |
|
From: Ahmed A. <asa...@ya...> - 2014-10-20 07:21:02
|
Hi, As you know, HtmlUnit automatically handles the JavaScript on your behalf. You need to know a little about JavaScript/Ajax, so you can know how the website work. A common question with Ajax is described in http://htmlunit.sourceforge.net/faq.html#AJAXDoesNotWork Hope that helps, Ahmed From: aershov522 <aer...@gm...> To: htm...@li... Sent: Sunday, October 19, 2014 12:24 AM Subject: Re: [Htmlunit-user] Can I modify the Javascript downloaded by HTMLUnit? Hi All,Iam trying to fetch/parse html content from a website that has Ajax & JavaScript included. The issue here is with pagination. When i view the source of the html page it (pagination link) there is no visible URL which is usually the case to fetch/render data from the server side. I understand this being loaded by a java script on every request and that is where i have lost clue. Is there a possible way to know how exactly java script is fetching the data directly from the server without any visible URL and implementing the pagination action. Since only then i can implement the same pagination using htmlunit in my web application. pls share any code link or example that would assist. thank you all...RegardsAershov View this message in context: Re: Can I modify the Javascript downloaded by HTMLUnit? Sent from the HtmlUnit - General mailing list archive at Nabble.com. |
|
From: aershov522 <aer...@gm...> - 2014-10-18 22:26:49
|
Hi All,Iam trying to fetch/parse html content from a website that has Ajax & JavaScript included. The issue here is with pagination. When i view the source of the html page it (pagination link) there is no visible URL which is usually the case to fetch/render data from the server side. I understand this being loaded by a java script on every request and that is where i have lost clue. Is there a possible way to know how exactly java script is fetching the data directly from the server without any visible URL and implementing the pagination action. Since only then i can implement the same pagination using htmlunit in my web application. pls share any code link or example that would assist. thank you all...RegardsAershov -- View this message in context: http://htmlunit.10904.n7.nabble.com/Can-I-modify-the-Javascript-downloaded-by-HTMLUnit-tp29301p34878.html Sent from the HtmlUnit - General mailing list archive at Nabble.com. |
|
From: Ahmed A. <asa...@ya...> - 2014-09-29 08:05:23
|
Hi Andre,
- Since the website actually gives a certificate error in real browser (Chrome for instance), then you must have:
webClient.getOptions().setUseInsecureSSL(true);
- Depending on your JVM, you may also need to:
System.setProperty("jsse.enableSNIExtension", "false");
System.setProperty("com.sun.net.ssl.enableECC", "false");
As hinted in:
http://stackoverflow.com/questions/15537794/sslexception-received-fatal-alert-illegal-parameter-after-java-1-7-upgrade
Hope that helps,
Ahmed
________________________________
From: Andre Carlomagno <car...@gm...>
To: htm...@li...
Sent: Saturday, September 27, 2014 4:35 PM
Subject: [Htmlunit-user] javax.net.ssl.SSLException: Received fatal alert: illegal_parameter
Hello,
I am a beginner in htmlunit.
I succeeded in accessing websites (http protocol) according to HtmlUnit Get Started page.
However, when I try to access the page https://siproquim.dpf.gov.br/smp/clf/EstadoHabilitacaoEmpresa.do I get the exception javax.net.ssl.SSLException: Received fatal alert: illegal_parameter
Can guide me how to proceed when I need to access websites with https protocol?
Thanks a lot.
My source is below, followed by the exception:
public class AccessWebsite {
public void getPfInfoByCnpj(String cnpj) throws Exception{
final WebClient webClient = new WebClient();
final HtmlPage RequestPage = webClient.getPage("https://siproquim.dpf.gov.br/smp/clf/EstadoHabilitacaoEmpresa.do");
final HtmlForm form = RequestPage.getFormByName("informacoesClfForm");
final HtmlTextInput textField = form.getInputByName("cnpj");
textField.setValueAttribute("02931883000189");
final HtmlSubmitInput button = form.getInputByValue("Consulta por CPF/CNPJ");
final HtmlPage resultPage = button.click();
System.out.println(resultPage.getTextContent());
webClient.closeAllWindows();
}
}
javax.net.ssl.SSLException: Received fatal alert: illegal_parameter
at sun.security.ssl.Alerts.getSSLException(Unknown Source)
at sun.security.ssl.Alerts.getSSLException(Unknown Source)
at sun.security.ssl.SSLSocketImpl.recvAlert(Unknown Source)
at sun.security.ssl.SSLSocketImpl.readRecord(Unknown Source)
at sun.security.ssl.SSLSocketImpl.performInitialHandshake(Unknown Source)
at sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:275)
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:254)
at com.gargoylesoftware.htmlunit.HtmlUnitSSLConnectionSocketFactory.connectSocket(HtmlUnitSSLConnectionSocketFactory.java:155)
at org.apache.http.impl.conn.HttpClientConnectionOperator.connect(HttpClientConnectionOperator.java:117)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:314)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:363)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:219)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:195)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:86)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:108)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:186)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:72)
at com.gargoylesoftware.htmlunit.HttpWebConnection.getResponse(HttpWebConnection.java:178)
at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseFromWebConnection(WebClient.java:1313)
at com.gargoylesoftware.htmlunit.WebClient.loadWebResponse(WebClient.java:1230)
at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:338)
at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:407)
at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:392)
at br.com.cpqservice.utilities.AccessWebsite.getPfInfoByCnpj(AccessWebsite.java:25)
at br.com.cpqservice.utilities.AccessWebsite.main(AccessWebsite.java:55)
|
|
From: Andre C. <car...@gm...> - 2014-09-27 14:36:01
|
Hello, I am a beginner in htmlunit. I succeeded in accessing websites (http protocol) according to HtmlUnit Get Started page. However, when I try to access the page https://siproquim.dpf.gov.br/smp/clf/EstadoHabilitacaoEmpresa.do I get the exception javax.net.ssl.SSLException: Received fatal alert: illegal_parameter Can guide me how to proceed when I need to access websites with https protocol? Thanks a lot. My source is below, followed by the exception: public class AccessWebsite { public void getPfInfoByCnpj(String cnpj) throws Exception{ final WebClient webClient = new WebClient(); final HtmlPage RequestPage = webClient.getPage(" https://siproquim.dpf.gov.br/smp/clf/EstadoHabilitacaoEmpresa.do"); final HtmlForm form = RequestPage.getFormByName("informacoesClfForm"); final HtmlTextInput textField = form.getInputByName("cnpj"); textField.setValueAttribute("02931883000189"); final HtmlSubmitInput button = form.getInputByValue("Consulta por CPF/CNPJ"); final HtmlPage resultPage = button.click(); System.out.println(resultPage.getTextContent()); webClient.closeAllWindows(); } } javax.net.ssl.SSLException: Received fatal alert: illegal_parameter at sun.security.ssl.Alerts.getSSLException(Unknown Source) at sun.security.ssl.Alerts.getSSLException(Unknown Source) at sun.security.ssl.SSLSocketImpl.recvAlert(Unknown Source) at sun.security.ssl.SSLSocketImpl.readRecord(Unknown Source) at sun.security.ssl.SSLSocketImpl.performInitialHandshake(Unknown Source) at sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:275) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:254) at com.gargoylesoftware.htmlunit.HtmlUnitSSLConnectionSocketFactory.connectSocket(HtmlUnitSSLConnectionSocketFactory.java:155) at org.apache.http.impl.conn.HttpClientConnectionOperator.connect(HttpClientConnectionOperator.java:117) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:314) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:363) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:219) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:195) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:86) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:108) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:186) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:72) at com.gargoylesoftware.htmlunit.HttpWebConnection.getResponse(HttpWebConnection.java:178) at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseFromWebConnection(WebClient.java:1313) at com.gargoylesoftware.htmlunit.WebClient.loadWebResponse(WebClient.java:1230) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:338) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:407) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:392) at br.com.cpqservice.utilities.AccessWebsite.getPfInfoByCnpj(AccessWebsite.java:25) at br.com.cpqservice.utilities.AccessWebsite.main(AccessWebsite.java:55) |
|
From: Ahmed A. <asa...@ya...> - 2014-09-10 06:57:49
|
Hi, - You shouldn't disabled throwing exception on failing status code. - I didn't get any error when running that code. Ahmed ________________________________ From: "htm...@li..." <htm...@li...> To: htm...@li... Sent: Tuesday, September 9, 2014 6:36 PM Subject: Auto-discard notification ----- Forwarded Message ----- The attached message has been automatically discarded. Hi, I try to extract data from : http://www.machinerytrader.com/ web is automatic forward to: http://www.marketbook.com/map/default.aspx I try to get back page: http://www.machinerytrader.com/ But my code doesn’t work. Here is my code: String url= "http://www.machinerytrader.com/"; final WebClient webClient = new WebClient(BrowserVersion.CHROME); webClient.getCookieManager().setCookiesEnabled(true); webClient.setAjaxController(new NicelyResynchronizingAjaxController()); webClient.getOptions().setThrowExceptionOnFailingStatusCode(false); webClient.getOptions().setJavaScriptEnabled(true); webClient.getOptions().setRedirectEnabled(true); webClient.getOptions().setCssEnabled(true); webClient.setWebConnection(new HttpWebConnection(webClient) { public WebResponse getResponse(WebRequest settings) throws IOException { WebResponse response = null; try { response = super.getResponse(settings); } catch(Exception e) { webClient.setJavaScriptTimeout(35000); response = super.getResponse(settings); } return response; } }); // HtmlPage market_Book_Page = webClient.getPage(url); //USA area HtmlMap map = market_Book_Page.getHtmlElementById("FPMap0"); List<HtmlArea> area_List = map.getElementsByAttribute("area", "", ""); HtmlArea usa_Area = area_List.get(7); HtmlPage p = usa_Area.click(); // HtmlAnchor anchor = p.getAnchorByHref("http://www.machinerytrader.com") ; HtmlPage category_Page = anchor.click(); |
|
From: Ahmed A. <asa...@ya...> - 2014-09-08 06:54:56
|
Hi, - You must subscribe to the list before posting - JavaScript is different than Java as you know. Java will be executed if your explicitly allow Applets to run. - JavaScript can execute ActiveXObjects, the control of which is outside Java, again you need to explicitly trust the website. - I don't think there is a general API for JavaScript to get access to Database/Java heap information, but you could quickly check if you can do that in real browser. Ahmed ________________________________ From: "htm...@li..." <htm...@li...> Sent: Monday, September 8, 2014 8:18 AM Subject: Auto-discard notification The attached message has been automatically discarded. Hi, My query is when we execute the javascript files in the headless browser of htmlUnit. If the JS files have some vulnerabilities , what will be the impact on the machine on which we are running the test cases. 1.with javascript executed inside html unit,will be able to connect to any database that the test cases are using 2. with javascript executed inside html unit, will be be able to get the Java heap information-- Thanks & Regards, Priyavrath.Dakua |
|
From: Ahmed A. <asa...@ya...> - 2014-09-07 08:37:07
|
Hi, You can safely ignore this. BTW, you can configure your eclipse to ignore it, see http://viralpatel.net/blogs/eclipse-ignore-serialversionuid-warning/ Ahmed ________________________________ From: Alain BUFERNE <alb...@gm...> To: htm...@li... Sent: Saturday, September 6, 2014 10:23 PM Subject: [Htmlunit-user] Extend WebClient to add method and UID I want to have my own subclass MyWebClient which will extend WebClient. This to add a method (where I will clear any timers running before waiting for javascript) and my question is Eclipse put me a warning because I didn't declare a static final serialVersionUID field of type long. But when I look with Eclipse the source code of the WebClient class there no UID and Eclipse is not showing any warning. Is this important, could I ignore the warning ? Regards Alain |
|
From: Alain B. <alb...@gm...> - 2014-09-06 20:23:38
|
I want to have my own subclass MyWebClient which will extend WebClient. This to add a method (where I will clear any timers running before waiting for javascript) and my question is Eclipse put me a warning because I didn't declare a static final serialVersionUID field of type long. But when I look with Eclipse the source code of the WebClient class there no UID and Eclipse is not showing any warning. Is this important, could I ignore the warning ? Regards Alain |
|
From: Ahmed A. <asa...@ya...> - 2014-09-05 14:15:44
|
Hi, HtmlUnit uses Rhino for all simulated browsers. Changing the JS engine is not an easy task, and V8 is written in C++. Ahmed ________________________________ From: Thashitharan Rajaratnam <dha...@ho...> To: "htm...@li..." <htm...@li...> Sent: Friday, September 5, 2014 8:42 AM Subject: [Htmlunit-user] Enable V8 engine for javascript Hi, I've seen that HtmlUnit using Rhino JS engine, in real scenario Chrome browser using V8 engine, So if i use Chrome browser instance in WebClient will it use V8 or it will use Rhino only? If so How can i change my JS engine (to V8)? (i want to use V8 because its realy speed than Rhino). regards, thashi |
|
From: Thashitharan R. <dha...@ho...> - 2014-09-05 06:42:20
|
Hi,I've seen that HtmlUnit using Rhino JS engine, in real scenario Chrome browser using V8 engine, So if i use Chrome browser instance in WebClient will it use V8 or it will use Rhino only? If so How can i change my JS engine (to V8)? (i want to use V8 because its realy speed than Rhino).regards,thashi |
|
From: Thashitharan R. <dha...@ho...> - 2014-09-05 06:35:25
|
Hi,i don't have access to Firefox_31 yet. The way before loading flash object those are checking the browser having flash plugin added or not using JS, if supports then only its displaying flash objects. So its detecting HtmlUnit 2.13 as flash enabled with the approach (adding flash plugin to browser instance), but not for HtmlUnit 2.15.i don't know how to investigate further.regards,thashi |
|
From: Thashitharan R. <dha...@ho...> - 2014-09-05 06:31:41
|
Hi,
i don't have access to Firefox_31 yet. The way before
loading flash object those are checking the browser having flash plugin added
or not using JS, if supports then only its displaying flash objects. So its
detecting HtmlUnit 2.13 as flash enabled with the approach (adding flash plugin
to browser instance), but not for HtmlUnit 2.15.i don't know how to investigate
further.
regards,
thashi
-------- Original message --------
From: Ahmed Ashour
Date:21/08/2014 5:37 PM (GMT+05:30)
To: htm...@li...
Subject: Re: [Htmlunit-user] How to enable my (htmlunit) browser work as Flash enabled?
Hi,
If the below doesn't work, then you need to investigate further in HtmlUnit code, which part that doesn't identity flash with your website.
Ahmed
private static BrowserVersion firefox31WithUptoDateFlash = new BrowserVersion(
BrowserVersion.FIREFOX_31.getApplicationName(),
BrowserVersion.FIREFOX_31.getApplicationVersion(),
BrowserVersion.FIREFOX_31.getUserAgent(),
BrowserVersion.FIREFOX_31.getBrowserVersionNumeric(),
new BrowserVersionFeatures[] {
BrowserVersionFeatures.STYLESHEET_HREF_EXPANDURL,
BrowserVersionFeatures.STYLESHEET_HREF_STYLE_NULL });
static {
PluginConfiguration plugin = new PluginConfiguration("Shockwave Flash",
"Shockwave Flash 14.0 r0", "NPSWF32_14_0_0_145.dll");
plugin.getMimeTypes().add(new PluginConfiguration.MimeType("application/x-shockwave-flash", "Adobe Flash movie","swf"));
//plugin.getMimeTypes().add(new PluginConfiguration.MimeType("application/futuresplash", "FutureSplash movie", "spl"));
firefox31WithUptoDateFlash.getPlugins().add(plugin);
}
From: dhashi88 <dha...@ho...>
To: htm...@li...
Sent: Thursday, August 21, 2014 9:41 AM
Subject: [Htmlunit-user] How to enable my (htmlunit) browser work as Flash enabled?
i was able to do in HtmlUnit 2.13 version by
private static BrowserVersion firefox17WithUptoDateFlash = new BrowserVersion(
BrowserVersion.FIREFOX_17.getApplicationName(),
BrowserVersion.FIREFOX_17.getApplicationVersion(),
BrowserVersion.FIREFOX_17.getUserAgent(),
BrowserVersion.FIREFOX_17.getBrowserVersionNumeric(),
new BrowserVersionFeatures[] {
BrowserVersionFeatures.JS_FRAME_RESOLVE_URL_WITH_PARENT_WINDOW,
BrowserVersionFeatures.STYLESHEET_HREF_EXPANDURL,
BrowserVersionFeatures.STYLESHEET_HREF_STYLE_NULL });
static {
PluginConfiguration plugin = new PluginConfiguration("Shockwave Flash",
"Shockwave Flash 14.0 r0", "NPSWF32_14_0_0_145.dll");
plugin.getMimeTypes().add(new PluginConfiguration.MimeType("application/x-shockwave-flash", "Adobe Flash movie","swf"));
//plugin.getMimeTypes().add(new PluginConfiguration.MimeType("application/futuresplash", "FutureSplash movie", "spl"));
firefox17WithUptoDateFlash.getPlugins().add(plugin);
}
but same is not working for HtmlUnit 2.15 . what is the reason. How can i achieve this?
------------------------------------------------------------------------------
Slashdot TV.
Video for Nerds. Stuff that matters.
http://tv.slashdot.org/
_______________________________________________
Htmlunit-user mailing list
Htm...@li...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user
------------------------------------------------------------------------------
Slashdot TV.
Video for Nerds. Stuff that matters.
http://tv.slashdot.org/
_______________________________________________
Htmlunit-user mailing list
Htm...@li...
https://lists.sourceforge.net/lists/listinfo/htmlunit-user |
|
From: dhashi88 <dha...@ho...> - 2014-09-05 06:21:33
|
MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="--_com.android.email_561322280204460" ----_com.android.email_561322280204460 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: base64 CkhpICwKSSBkb24ndCBoYXZlIGFjY2VzcyB0byBGaXJlZm94XzMxIHlldC4gVGhlIHdheSBiZWZv cmUgbG9hZGluZyBmbGFzaCBvYmplY3QgdGhvc2UgYXJlIGNoZWNraW5nIHRoZSBicm93c2VyIGhh dmluZyBmbGFzaCBzdXBwb3J0IG9yIG5vdCh1c2luZyBqcykuIElmIHN1cHBvcnQgdGhlbiBvbmx5 IGl0cyBkaXNwbGF5aW5nLiBTbyBpdHMgZGV0ZWN0aW5nIGh0bWx1bml0IDIuMTMgYXMgZmxhc2gg ZW5hYmxlZCBicm93c2VyIGJ1dCBmb3IgMi4xNSBpdHMgbm90LiBJIGRvbid0IGtub3cgaG93IHRv IGludmVzdGlnYXRlIGZ1cnRoZXIuwqAKUmVnYXJkcywKVGhhc2hpCgpTZW50IGZyb20gbXkgNEcg UmVhZHkgU2Ftc3VuZyBHYWxheHkgUzTCoA== ----_com.android.email_561322280204460 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: base64 PGh0bWw+PGhlYWQ+PG1ldGEgaHR0cC1lcXVpdj0iQ29udGVudC1UeXBlIiBjb250ZW50PSJ0ZXh0 L2h0bWw7IGNoYXJzZXQ9VVRGLTgiPjwvaGVhZD48Ym9keSA+PGRpdj48YnI+PC9kaXY+PGRpdj48 ZGl2PkhpICw8L2Rpdj48ZGl2PkkgZG9uJ3QgaGF2ZSBhY2Nlc3MgdG8gRmlyZWZveF8zMSB5ZXQu IFRoZSB3YXkgYmVmb3JlIGxvYWRpbmcgZmxhc2ggb2JqZWN0IHRob3NlIGFyZSBjaGVja2luZyB0 aGUgYnJvd3NlciBoYXZpbmcgZmxhc2ggc3VwcG9ydCBvciBub3QodXNpbmcganMpLiBJZiBzdXBw b3J0IHRoZW4gb25seSBpdHMgZGlzcGxheWluZy4gU28gaXRzIGRldGVjdGluZyBodG1sdW5pdCAy LjEzIGFzIGZsYXNoIGVuYWJsZWQgYnJvd3NlciBidXQgZm9yIDIuMTUgaXRzIG5vdC4gSSBkb24n dCBrbm93IGhvdyB0byBpbnZlc3RpZ2F0ZSBmdXJ0aGVyLiZuYnNwOzwvZGl2PjxkaXY+UmVnYXJk cyw8L2Rpdj48ZGl2PlRoYXNoaTwvZGl2PjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXYgc3R5bGU9 ImZvbnQtc2l6ZTo3cHgiPlNlbnQgZnJvbSBteSA0RyBSZWFkeSBTYW1zdW5nIEdhbGF4eSBTNCZu YnNwOzwvZGl2PjwvYm9keT48L2h0bWw+ ----_com.android.email_561322280204460-- |
|
From: Vasudevan C. <vco...@gm...> - 2014-08-29 12:12:26
|
Yes, it is done.
Vasu
On Fri, Aug 29, 2014 at 5:27 PM, Er. Ravikant Kharole <
rav...@gm...> wrote:
> Hey do you have enabled the java script through driver.get
> option().setjavascriptenbled(true);
> On 29/08/2014 3:49 pm, "Vasudevan Comandur" <vco...@gm...> wrote:
>
>> Hi,
>>
>> I am calling a URL through HTMLUnit which is returning a JS file
>> having the
>> following lines
>> ****************************
>> var RecaptchaState = {
>> challenge :
>> '03AHJ_Vuu2NVPdOEg-sq2qWRIm-0JBaEYRDOEXtH9H929ItBmsDElumsglx0imTdk6ufalg3qlDngopHhAISeoJVRD___BA7FLk0nJDncaa2jvRWz-ZVXP16nNaLzRBDXr64WRrb1JADKOrLYwOd0T7v0bVNQedMLn_kanJPP7SglKDyQfcfk8RjHCVZh77VVYM7WxY8vTER-L',
>> timeout : 1800,
>> lang : 'en-GB',
>> server : 'http://www.google.com/recaptcha/api/',
>> site : '6Lf1-AQAAAAAAL9EskceOVja5Uh5_yo1FRtb1Q83',
>> error_message : '',
>> programming_error : '',
>> is_incorrect : false,
>> rtl : false} ;
>>
>> document.write('<scr'+'ipt type="text/javascript" s'+'rc="' +
>> RecaptchaState.server + 'js/recaptcha_canary.js"></scr'+'ipt>');
>>
>> *****************************
>>
>> I had made a call to wait for 60 seconds using the API immediately after
>> the first request
>> http://www.google.com/recaptcha/api/challenge?k=6Lf1-AQAAAAAAL9EskceOVja5Uh5_yo1FRtb1Q83
>> ;
>>
>> webClient.waitForBackgroundJavaScript(60000) ;
>>
>> I did not see the request going out of HTMLUnit. The response header from
>> webserver is copied below
>>
>> **************************
>>
>>
>> HTTP/1.1 200 OK Cache-Control no-cache, no-store, max-age=0,
>> must-revalidate Pragma no-cache Expires Fri, 01 Jan 1990 00:00:00 GMT
>> Date Fri, 29 Aug 2014 10:07:26 GMT Set-Cookie
>> NID=67=oksi5OMloXzJQ23JjKvhwyoMIaGMl_r7gj2IK-NRIg5nFKIadkK2CoveqS3o3SdxJ_dWazFXWIkO5SW55nbCumor63HeCiHk0MgURUcZKzsnGDte55Sm4sGEUI9xdk79;Domain=.
>> google.com;Path=/;Expires=Sat, 28-Feb-2015 10:07:26 GMT;HttpOnly P3P CP="This
>> is not a P3P policy! See
>> http://www.google.com/support/accounts/bin/answer.py?hl=en&answer=151657
>> for more info." Content-Type text/javascript X-Content-Type-Options
>> nosniff X-XSS-Protection 1; mode=block Server GSE Alternate-Protocol
>> 80:quic Transfer-Encoding chunked
>> ***************************************************************
>>
>> What could be the reason?
>>
>> Regards
>> Vasu
>>
>>
>>
>> ------------------------------------------------------------------------------
>> Slashdot TV.
>> Video for Nerds. Stuff that matters.
>> http://tv.slashdot.org/
>> _______________________________________________
>> Htmlunit-user mailing list
>> Htm...@li...
>> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>>
>>
>
> ------------------------------------------------------------------------------
> Slashdot TV.
> Video for Nerds. Stuff that matters.
> http://tv.slashdot.org/
> _______________________________________________
> Htmlunit-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>
>
|
|
From: Er. R. K. <rav...@gm...> - 2014-08-29 11:57:56
|
Hey do you have enabled the java script through driver.get
option().setjavascriptenbled(true);
On 29/08/2014 3:49 pm, "Vasudevan Comandur" <vco...@gm...> wrote:
> Hi,
>
> I am calling a URL through HTMLUnit which is returning a JS file having
> the
> following lines
> ****************************
> var RecaptchaState = {
> challenge :
> '03AHJ_Vuu2NVPdOEg-sq2qWRIm-0JBaEYRDOEXtH9H929ItBmsDElumsglx0imTdk6ufalg3qlDngopHhAISeoJVRD___BA7FLk0nJDncaa2jvRWz-ZVXP16nNaLzRBDXr64WRrb1JADKOrLYwOd0T7v0bVNQedMLn_kanJPP7SglKDyQfcfk8RjHCVZh77VVYM7WxY8vTER-L',
> timeout : 1800,
> lang : 'en-GB',
> server : 'http://www.google.com/recaptcha/api/',
> site : '6Lf1-AQAAAAAAL9EskceOVja5Uh5_yo1FRtb1Q83',
> error_message : '',
> programming_error : '',
> is_incorrect : false,
> rtl : false} ;
>
> document.write('<scr'+'ipt type="text/javascript" s'+'rc="' +
> RecaptchaState.server + 'js/recaptcha_canary.js"></scr'+'ipt>');
>
> *****************************
>
> I had made a call to wait for 60 seconds using the API immediately after
> the first request
> http://www.google.com/recaptcha/api/challenge?k=6Lf1-AQAAAAAAL9EskceOVja5Uh5_yo1FRtb1Q83
> ;
>
> webClient.waitForBackgroundJavaScript(60000) ;
>
> I did not see the request going out of HTMLUnit. The response header from
> webserver is copied below
>
> **************************
>
>
> HTTP/1.1 200 OK Cache-Control no-cache, no-store, max-age=0,
> must-revalidate Pragma no-cache Expires Fri, 01 Jan 1990 00:00:00 GMT
> Date Fri, 29 Aug 2014 10:07:26 GMT Set-Cookie
> NID=67=oksi5OMloXzJQ23JjKvhwyoMIaGMl_r7gj2IK-NRIg5nFKIadkK2CoveqS3o3SdxJ_dWazFXWIkO5SW55nbCumor63HeCiHk0MgURUcZKzsnGDte55Sm4sGEUI9xdk79;Domain=.
> google.com;Path=/;Expires=Sat, 28-Feb-2015 10:07:26 GMT;HttpOnly P3P CP="This
> is not a P3P policy! See
> http://www.google.com/support/accounts/bin/answer.py?hl=en&answer=151657
> for more info." Content-Type text/javascript X-Content-Type-Options
> nosniff X-XSS-Protection 1; mode=block Server GSE Alternate-Protocol
> 80:quic Transfer-Encoding chunked
> ***************************************************************
>
> What could be the reason?
>
> Regards
> Vasu
>
>
>
> ------------------------------------------------------------------------------
> Slashdot TV.
> Video for Nerds. Stuff that matters.
> http://tv.slashdot.org/
> _______________________________________________
> Htmlunit-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlunit-user
>
>
|
|
From: Vasudevan C. <vco...@gm...> - 2014-08-29 10:17:54
|
Hi,
I am calling a URL through HTMLUnit which is returning a JS file having
the
following lines
****************************
var RecaptchaState = {
challenge :
'03AHJ_Vuu2NVPdOEg-sq2qWRIm-0JBaEYRDOEXtH9H929ItBmsDElumsglx0imTdk6ufalg3qlDngopHhAISeoJVRD___BA7FLk0nJDncaa2jvRWz-ZVXP16nNaLzRBDXr64WRrb1JADKOrLYwOd0T7v0bVNQedMLn_kanJPP7SglKDyQfcfk8RjHCVZh77VVYM7WxY8vTER-L',
timeout : 1800,
lang : 'en-GB',
server : 'http://www.google.com/recaptcha/api/',
site : '6Lf1-AQAAAAAAL9EskceOVja5Uh5_yo1FRtb1Q83',
error_message : '',
programming_error : '',
is_incorrect : false,
rtl : false} ;
document.write('<scr'+'ipt type="text/javascript" s'+'rc="' +
RecaptchaState.server + 'js/recaptcha_canary.js"></scr'+'ipt>');
*****************************
I had made a call to wait for 60 seconds using the API immediately after
the first request
http://www.google.com/recaptcha/api/challenge?k=6Lf1-AQAAAAAAL9EskceOVja5Uh5_yo1FRtb1Q83
;
webClient.waitForBackgroundJavaScript(60000) ;
I did not see the request going out of HTMLUnit. The response header from
webserver is copied below
**************************
HTTP/1.1 200 OK Cache-Control no-cache, no-store, max-age=0,
must-revalidate Pragma no-cache Expires Fri, 01 Jan 1990 00:00:00 GMT
Date Fri, 29 Aug 2014 10:07:26 GMT Set-Cookie
NID=67=oksi5OMloXzJQ23JjKvhwyoMIaGMl_r7gj2IK-NRIg5nFKIadkK2CoveqS3o3SdxJ_dWazFXWIkO5SW55nbCumor63HeCiHk0MgURUcZKzsnGDte55Sm4sGEUI9xdk79;Domain=.
google.com;Path=/;Expires=Sat, 28-Feb-2015 10:07:26 GMT;HttpOnly P3P CP="This
is not a P3P policy! See
http://www.google.com/support/accounts/bin/answer.py?hl=en&answer=151657
for more info." Content-Type text/javascript X-Content-Type-Options
nosniff X-XSS-Protection 1; mode=block Server GSE Alternate-Protocol
80:quic Transfer-Encoding chunked
***************************************************************
What could be the reason?
Regards
Vasu
|
|
From: Roberto B. - A. <r.b...@af...> - 2014-08-28 14:39:40
|
Yes it works! Thanks!!! ----- Original Message ----- From: Ahmed Ashour To: htm...@li... Sent: Thursday, August 28, 2014 3:55 PM Subject: Re: [Htmlunit-user] Site table not loaded. Hi, Would you use 2.15, or even better the latest snapshot in http://build.canoo.com/htmlunit/ ? I get the container detailed data. Ahmed ------------------------------------------------------------------------------ From: Roberto Bottoni - AfterBit <r.b...@af...> To: htm...@li... Sent: Thursday, August 28, 2014 3:38 PM Subject: [Htmlunit-user] Site table not loaded. HtmlUnit version 2.14 I'm trying to grab this page : http://m.hanjin.com/mhanjin/CUP_MOB_0802.do?menuFlag=C&searchType=C&blCntrNo=CAXU3336862 This is my code : public class Main { static final WebClient browser; static { browser = new WebClient(BrowserVersion.FIREFOX_24); browser.getOptions().setJavaScriptEnabled(true); CookieManager cookieMan = new CookieManager(); cookieMan = browser.getCookieManager(); cookieMan.setCookiesEnabled(true); browser.getOptions().setRedirectEnabled(true); browser.getOptions().setThrowExceptionOnFailingStatusCode(false); browser.getOptions().setPrintContentOnFailingStatusCode(true); browser.getOptions().setThrowExceptionOnScriptError(false); } public static void main(String[] arguments) { doTestHANJINMobile(); } private static void doTestHANJINMobile() { try { HtmlPage page = (HtmlPage) browser.getPage("http://m.hanjin.com/mhanjin/CUP_MOB_0802.do?menuFlag=C&searchType=C&blCntrNo=CAXU3336862"); System.out.println("waitForBackgroundJavaScript..."); browser.waitForBackgroundJavaScriptStartingBefore(5000); browser.waitForBackgroundJavaScript(5000); System.out.println("XML Source : \n" + page.asXml() + "\n"); } catch (Exception e) { System.out.println("EXCEPTION --------------- " + e.toString()); } } } But i get just the "Sailing Information" table and not the "Container Detail" table. I tried with other browser version ( IE, Chrome..) but nothing happens... ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ------------------------------------------------------------------------------ _______________________________________________ Htmlunit-user mailing list Htm...@li... https://lists.sourceforge.net/lists/listinfo/htmlunit-user |
|
From: Ahmed A. <asa...@ya...> - 2014-08-28 13:55:20
|
Hi, Would you use 2.15, or even better the latest snapshot in http://build.canoo.com/htmlunit/ ? I get the container detailed data. Ahmed ________________________________ From: Roberto Bottoni - AfterBit <r.b...@af...> To: htm...@li... Sent: Thursday, August 28, 2014 3:38 PM Subject: [Htmlunit-user] Site table not loaded. HtmlUnit version 2.14 I'm trying to grab this page : http://m.hanjin.com/mhanjin/CUP_MOB_0802.do?menuFlag=C&searchType=C&blCntrNo=CAXU3336862 This is my code : public class Main { static final WebClient browser; static { browser = new WebClient(BrowserVersion.FIREFOX_24); browser.getOptions().setJavaScriptEnabled(true); CookieManager cookieMan = new CookieManager(); cookieMan = browser.getCookieManager(); cookieMan.setCookiesEnabled(true); browser.getOptions().setRedirectEnabled(true); browser.getOptions().setThrowExceptionOnFailingStatusCode(false); browser.getOptions().setPrintContentOnFailingStatusCode(true); browser.getOptions().setThrowExceptionOnScriptError(false); } public static void main(String[] arguments) { doTestHANJINMobile(); } private static void doTestHANJINMobile() { try { HtmlPage page = (HtmlPage) browser.getPage("http://m.hanjin.com/mhanjin/CUP_MOB_0802.do?menuFlag=C&searchType=C&blCntrNo=CAXU3336862"); System.out.println("waitForBackgroundJavaScript..."); browser.waitForBackgroundJavaScriptStartingBefore(5000); browser.waitForBackgroundJavaScript(5000); System.out.println("XML Source : \n" + page.asXml() + "\n"); } catch (Exception e) { System.out.println("EXCEPTION --------------- " + e.toString()); } } } But i get just the "Sailing Information" table and not the "Container Detail" table. I tried with other browser version ( IE, Chrome..) but nothing happens... |
|
From: Roberto B. - A. <r.b...@af...> - 2014-08-28 13:38:30
|
HtmlUnit version 2.14 I'm trying to grab this page : http://m.hanjin.com/mhanjin/CUP_MOB_0802.do?menuFlag=C&searchType=C&blCntrNo=CAXU3336862 This is my code : public class Main { static final WebClient browser; static { browser = new WebClient(BrowserVersion.FIREFOX_24); browser.getOptions().setJavaScriptEnabled(true); CookieManager cookieMan = new CookieManager(); cookieMan = browser.getCookieManager(); cookieMan.setCookiesEnabled(true); browser.getOptions().setRedirectEnabled(true); browser.getOptions().setThrowExceptionOnFailingStatusCode(false); browser.getOptions().setPrintContentOnFailingStatusCode(true); browser.getOptions().setThrowExceptionOnScriptError(false); } public static void main(String[] arguments) { doTestHANJINMobile(); } private static void doTestHANJINMobile() { try { HtmlPage page = (HtmlPage) browser.getPage("http://m.hanjin.com/mhanjin/CUP_MOB_0802.do?menuFlag=C&searchType=C&blCntrNo=CAXU3336862"); System.out.println("waitForBackgroundJavaScript..."); browser.waitForBackgroundJavaScriptStartingBefore(5000); browser.waitForBackgroundJavaScript(5000); System.out.println("XML Source : \n" + page.asXml() + "\n"); } catch (Exception e) { System.out.println("EXCEPTION --------------- " + e.toString()); } } } But i get just the "Sailing Information" table and not the "Container Detail" table. I tried with other browser version ( IE, Chrome..) but nothing happens... |
|
From: Vasudevan C. <vco...@gm...> - 2014-08-26 07:11:48
|
THanks Ahmed. I shall download the same and check it out. Regards Vasu On Mon, Aug 25, 2014 at 11:24 PM, Ahmed Ashour <asa...@ya...> wrote: > Finally, it is fine now. > > > ------------------------------ > *From:* Vasudevan Comandur <vco...@gm...> > *To:* Ahmed Ashour <asa...@ya...> > *Cc:* Html Unit Users <htm...@li...> > *Sent:* Monday, August 25, 2014 4:44 PM > > *Subject:* Re: [Htmlunit-user] HTMLUnit with Recaptcha service of Google > > Hi Ahmed, > > Let me wait for the build to succeed and pull the sources. > > IS the change done in HttpWebConnection.java file only for referer & > cookie? > > Regards > Vasu > > > > > On Mon, Aug 25, 2014 at 7:46 PM, Ahmed Ashour <asa...@ya...> wrote: > > Hi Vasu, > > Build #2824 was made 23/08/2014 22:23:10 > <http://build.canoo.com/htmlunit/buildresults?log=log20140823222310Lbuild.2824>, > which is two days back. > > Currently the build is running after few failed ones "now building since > 08/25/2014 15:30:06" > > Ahmed > ------------------------------ > *From:* Vasudevan Comandur <vco...@gm...> > *To:* Ahmed Ashour <asa...@ya...> > *Cc:* Html Unit Users <htm...@li...> > *Sent:* Monday, August 25, 2014 4:10 PM > > *Subject:* Re: [Htmlunit-user] HTMLUnit with Recaptcha service of Google > > Hi Ahmed, > > Has the build been successful?. I looked into the file > Httpwebconnection.java in the build # 2824 and I did not see > any code for referer and cookie. > > Have you made the changes in some other file?. Please confirm. > > Regards > Vasu > > > On Mon, Aug 25, 2014 at 2:25 PM, Ahmed Ashour <asa...@ya...> wrote: > > Hi Vasu, > > Please always communicate through the user-list. > > Referer and Cookies are now fixed in SVN. > > Thanks, > Ahmed > ------------------------------ > *From:* Vasudevan Comandur <vco...@gm...> > *To:* Ahmed Ashour <asa...@ya...> > *Sent:* Friday, August 22, 2014 2:31 PM > > *Subject:* Re: [Htmlunit-user] HTMLUnit with Recaptcha service of Google > > Hi Ahmed, > > How about Referer and Cookie headers?. Will it come after Connection? > > But when I looked into the headers of FF, Connection is coming after > Referer & Cookies. Copying the header for your > reference. > > > GET > /recaptcha/api/reload?c=03AHJ_VuuDDJeKrmGjlz1qmHvOCg24MbFS8gIBET5ZEzoT9x6WArdJvsS081P9buyCrsG1V6sqIk18N1Dfmrx3CnkhJ6jWu1glZwILtg5GZDHQEZphmxiRv3_6bkOME83Ex2FeQ-KhgWyFUut1tAKS4lsve_EJwDy_b02fyGfoW77iFFxHK4_gUPGbyLUV5R56wfEJLtDK7Y7AyBkyiXKN3vlqBOiahdNP3OR9804dExS2zvm2CJR1_InMAZETw9xhCQiviGeZNKqc-bC9oiqUNl1MTRkNnZ5M5bdCGjen9oprPziN6Q3Uf2NRm_jp2CQJDRburqzVBKL_3fA1TcPiSEHG-F0Vt9Ka8g&k=6Lf1-AQAAAAAAL9EskceOVja5Uh5_yo1FRtb1Q83&reason=t&type=image&lang=en&th=,8bBAlXaKcbT6sLautLQmRqgA5vAAAABAoAAAACPYAMvWdozw4osKbFVJ1AqPclG0Mn06Z0JwwRajuOfW-9LduuzuoI2mWRjA33V033hmvp-6if1HJBQNP4Xosnkci6mAKwBGfcnnwCc7-Kl0iIZrrNIuIBxQGc42xY-obi9gQZ8m5pgQ5cJFRHGEwCGIUg7FH8986Rw3_AKT3N2wfujfNtmrv8NTchi9UDkiPJGb9b_6qFdDD3EfBM0VCjY6T3xN7GydIpTI4MnWa-iA3nWq5YAaIFJCuzH47VPNdFIHCgst-KNwwcK0kSIPQQ > HTTP/1.1Hostwww.google.comUser-AgentMozilla/5.0 (Windows NT 5.1; rv:31.0) > Gecko/20100101 Firefox/31.0Accept*/*Accept-Languageen-US,en;q=0.5 > Accept-Encodinggzip, deflateReferer > http://www.patcurtis.com/captcha/recaptcha_demo.phpCookie > NID=67=UTuSYqnmGItItcnyg5Jg3dGLTxCNQIHEk0cQp6gUvl9lYhkHjTeqvSc1mowP1LvSmf_uSRvRb6PMmifh9gagVFuKJDS160nr6MdZzMFXPfJoAtl7ZpA53su_izSPPIW3D0hGnAyV97SSUKPAyvNnP8bkovl9CdmcN2TIPE2_LBkaEomtrbuRIKs4JNju_aEdgfKvDclCMw; > SID=DQAAAPAAAAB5aQmSV5SJw0dntY7eIMRMjEFwqScqktfLB64G0TkCiNKGDxF23waqqXSuzUwuLOY_mC4n6QHLz3STedw42FWwsDCP10d7i3to2E5HrLe9SIn8E0W6mjclWwUp-pBHgOdZVqRGNHAXkraQg3P5bLznaEXL05lSGG7H3q7_lU9KIzRxlbOxmjwu4T0WCXm4O2dfL7qcZ0t8AhDEChNfyobvoloa11DxeyGeWCqEms_E1hYZNH8w4fqXVsaqFkrolO9VsC8Yyykg4CRnjMf9R4MhYBVXA-Y2KQri4WXgfsnLrpg0ebFWxKXt7cxPY3x-6-M; > HSID=AGpI2QsnbQ1VCYYfW; APISID=652VROec_KUf4hKf/ABJNvaUeifvJVbTVk; > PREF=ID=aafd265723a3ae2d:FF=0:LD=en:TM=1408702050:LM=1408702050:GM=1:S=y6H_PRt6O_BZFVb9; > OGP=-4061129:Connectionkeep-alive > > Looking forward to your comments. > > Regards > Vasu > > > > > On Fri, Aug 22, 2014 at 4:28 PM, Ahmed Ashour <asa...@ya...> wrote: > > Hi Vasu, > > HttpWebConnection as well. > > Ahmed > > > On Aug 22, 2014, at 12:47 PM, Vasudevan Comandur <vco...@gm...> > wrote: > > Hi Ahmed, > > Thanks for the quick reply. > > Have you made the changes in only one file (BrowserVersion.Java) or in > few other files as well? > > The reason is that if I have apply this fix to an older version of > HTMLUnit, I could do that by myself. > > Looking forward to your reply. > > Regards > Vasu > > > On Fri, Aug 22, 2014 at 4:08 PM, Ahmed Ashour <asa...@ya...> wrote: > > Hi Vasu, > > Yes, the build usually takes one hour, and the team is monitoring it. > > The artifacts are of the last successful build. > > Ahmed > ------------------------------ > *From:* Vasudevan Comandur <vco...@gm...> > *To:* Ahmed Ashour <asa...@ya...>; " > htm...@li..." <htm...@li...> > > *Sent:* Friday, August 22, 2014 12:35 PM > > *Subject:* Re: [Htmlunit-user] HTMLUnit with Recaptcha service of Google > > Hi Ahmed, > > Thanks. At present, it says the build has failed. So I need to wait > till the build is successful to get the latest. > > Am I correct? > > Regards > Vasu > > > On Fri, Aug 22, 2014 at 3:54 PM, Ahmed Ashour <asa...@ya...> wrote: > > > > Hi Vasu, > > - HtmlUnit homepage: http://htmlunit.sourceforge.net/ > - Latest build: Cruise Control server <http://build.canoo.com/htmlunit> > - When we have a successful build: 'Build Artifacts', the artifacts > as-of-now were built before the commit. > > Ahmed > ------------------------------ > *From:* Vasudevan Comandur <vco...@gm...> > *To:* Ahmed Ashour <asa...@ya...>; " > htm...@li..." <htm...@li...> > > *Sent:* Friday, August 22, 2014 12:16 PM > > *Subject:* Re: [Htmlunit-user] HTMLUnit with Recaptcha service of Google > > Hi Ahmed, > > How can I get the source & the jar for the fix that you put now from > SVN?. > > Regards > Vasu > > > > ------------------------------------------------------------------------------ > Slashdot TV. > Video for Nerds. Stuff that matters. > http://tv.slashdot.org/ > _______________________________________________ > Htmlunit-user mailing list > Htm...@li... > https://lists.sourceforge.net/lists/listinfo/htmlunit-user > > > > > > > > > > > > > > > |
|
From: Vasudevan C. <vco...@gm...> - 2014-08-25 14:44:44
|
Hi Ahmed, Let me wait for the build to succeed and pull the sources. IS the change done in HttpWebConnection.java file only for referer & cookie? Regards Vasu On Mon, Aug 25, 2014 at 7:46 PM, Ahmed Ashour <asa...@ya...> wrote: > Hi Vasu, > > Build #2824 was made 23/08/2014 22:23:10 > <http://build.canoo.com/htmlunit/buildresults?log=log20140823222310Lbuild.2824>, > which is two days back. > > Currently the build is running after few failed ones "now building since > 08/25/2014 15:30:06" > > Ahmed > ------------------------------ > *From:* Vasudevan Comandur <vco...@gm...> > *To:* Ahmed Ashour <asa...@ya...> > *Cc:* Html Unit Users <htm...@li...> > *Sent:* Monday, August 25, 2014 4:10 PM > > *Subject:* Re: [Htmlunit-user] HTMLUnit with Recaptcha service of Google > > Hi Ahmed, > > Has the build been successful?. I looked into the file > Httpwebconnection.java in the build # 2824 and I did not see > any code for referer and cookie. > > Have you made the changes in some other file?. Please confirm. > > Regards > Vasu > > > On Mon, Aug 25, 2014 at 2:25 PM, Ahmed Ashour <asa...@ya...> wrote: > > Hi Vasu, > > Please always communicate through the user-list. > > Referer and Cookies are now fixed in SVN. > > Thanks, > Ahmed > ------------------------------ > *From:* Vasudevan Comandur <vco...@gm...> > *To:* Ahmed Ashour <asa...@ya...> > *Sent:* Friday, August 22, 2014 2:31 PM > > *Subject:* Re: [Htmlunit-user] HTMLUnit with Recaptcha service of Google > > Hi Ahmed, > > How about Referer and Cookie headers?. Will it come after Connection? > > But when I looked into the headers of FF, Connection is coming after > Referer & Cookies. Copying the header for your > reference. > > > GET > /recaptcha/api/reload?c=03AHJ_VuuDDJeKrmGjlz1qmHvOCg24MbFS8gIBET5ZEzoT9x6WArdJvsS081P9buyCrsG1V6sqIk18N1Dfmrx3CnkhJ6jWu1glZwILtg5GZDHQEZphmxiRv3_6bkOME83Ex2FeQ-KhgWyFUut1tAKS4lsve_EJwDy_b02fyGfoW77iFFxHK4_gUPGbyLUV5R56wfEJLtDK7Y7AyBkyiXKN3vlqBOiahdNP3OR9804dExS2zvm2CJR1_InMAZETw9xhCQiviGeZNKqc-bC9oiqUNl1MTRkNnZ5M5bdCGjen9oprPziN6Q3Uf2NRm_jp2CQJDRburqzVBKL_3fA1TcPiSEHG-F0Vt9Ka8g&k=6Lf1-AQAAAAAAL9EskceOVja5Uh5_yo1FRtb1Q83&reason=t&type=image&lang=en&th=,8bBAlXaKcbT6sLautLQmRqgA5vAAAABAoAAAACPYAMvWdozw4osKbFVJ1AqPclG0Mn06Z0JwwRajuOfW-9LduuzuoI2mWRjA33V033hmvp-6if1HJBQNP4Xosnkci6mAKwBGfcnnwCc7-Kl0iIZrrNIuIBxQGc42xY-obi9gQZ8m5pgQ5cJFRHGEwCGIUg7FH8986Rw3_AKT3N2wfujfNtmrv8NTchi9UDkiPJGb9b_6qFdDD3EfBM0VCjY6T3xN7GydIpTI4MnWa-iA3nWq5YAaIFJCuzH47VPNdFIHCgst-KNwwcK0kSIPQQ > HTTP/1.1Hostwww.google.comUser-AgentMozilla/5.0 (Windows NT 5.1; rv:31.0) > Gecko/20100101 Firefox/31.0Accept*/*Accept-Languageen-US,en;q=0.5 > Accept-Encodinggzip, deflateReferer > http://www.patcurtis.com/captcha/recaptcha_demo.phpCookie > NID=67=UTuSYqnmGItItcnyg5Jg3dGLTxCNQIHEk0cQp6gUvl9lYhkHjTeqvSc1mowP1LvSmf_uSRvRb6PMmifh9gagVFuKJDS160nr6MdZzMFXPfJoAtl7ZpA53su_izSPPIW3D0hGnAyV97SSUKPAyvNnP8bkovl9CdmcN2TIPE2_LBkaEomtrbuRIKs4JNju_aEdgfKvDclCMw; > SID=DQAAAPAAAAB5aQmSV5SJw0dntY7eIMRMjEFwqScqktfLB64G0TkCiNKGDxF23waqqXSuzUwuLOY_mC4n6QHLz3STedw42FWwsDCP10d7i3to2E5HrLe9SIn8E0W6mjclWwUp-pBHgOdZVqRGNHAXkraQg3P5bLznaEXL05lSGG7H3q7_lU9KIzRxlbOxmjwu4T0WCXm4O2dfL7qcZ0t8AhDEChNfyobvoloa11DxeyGeWCqEms_E1hYZNH8w4fqXVsaqFkrolO9VsC8Yyykg4CRnjMf9R4MhYBVXA-Y2KQri4WXgfsnLrpg0ebFWxKXt7cxPY3x-6-M; > HSID=AGpI2QsnbQ1VCYYfW; APISID=652VROec_KUf4hKf/ABJNvaUeifvJVbTVk; > PREF=ID=aafd265723a3ae2d:FF=0:LD=en:TM=1408702050:LM=1408702050:GM=1:S=y6H_PRt6O_BZFVb9; > OGP=-4061129:Connectionkeep-alive > > Looking forward to your comments. > > Regards > Vasu > > > > > On Fri, Aug 22, 2014 at 4:28 PM, Ahmed Ashour <asa...@ya...> wrote: > > Hi Vasu, > > HttpWebConnection as well. > > Ahmed > > > On Aug 22, 2014, at 12:47 PM, Vasudevan Comandur <vco...@gm...> > wrote: > > Hi Ahmed, > > Thanks for the quick reply. > > Have you made the changes in only one file (BrowserVersion.Java) or in > few other files as well? > > The reason is that if I have apply this fix to an older version of > HTMLUnit, I could do that by myself. > > Looking forward to your reply. > > Regards > Vasu > > > On Fri, Aug 22, 2014 at 4:08 PM, Ahmed Ashour <asa...@ya...> wrote: > > Hi Vasu, > > Yes, the build usually takes one hour, and the team is monitoring it. > > The artifacts are of the last successful build. > > Ahmed > ------------------------------ > *From:* Vasudevan Comandur <vco...@gm...> > *To:* Ahmed Ashour <asa...@ya...>; " > htm...@li..." <htm...@li...> > > *Sent:* Friday, August 22, 2014 12:35 PM > > *Subject:* Re: [Htmlunit-user] HTMLUnit with Recaptcha service of Google > > Hi Ahmed, > > Thanks. At present, it says the build has failed. So I need to wait > till the build is successful to get the latest. > > Am I correct? > > Regards > Vasu > > > On Fri, Aug 22, 2014 at 3:54 PM, Ahmed Ashour <asa...@ya...> wrote: > > > > Hi Vasu, > > - HtmlUnit homepage: http://htmlunit.sourceforge.net/ > - Latest build: Cruise Control server <http://build.canoo.com/htmlunit> > - When we have a successful build: 'Build Artifacts', the artifacts > as-of-now were built before the commit. > > Ahmed > ------------------------------ > *From:* Vasudevan Comandur <vco...@gm...> > *To:* Ahmed Ashour <asa...@ya...>; " > htm...@li..." <htm...@li...> > > *Sent:* Friday, August 22, 2014 12:16 PM > > *Subject:* Re: [Htmlunit-user] HTMLUnit with Recaptcha service of Google > > Hi Ahmed, > > How can I get the source & the jar for the fix that you put now from > SVN?. > > Regards > Vasu > > > > ------------------------------------------------------------------------------ > Slashdot TV. > Video for Nerds. Stuff that matters. > http://tv.slashdot.org/ > _______________________________________________ > Htmlunit-user mailing list > Htm...@li... > https://lists.sourceforge.net/lists/listinfo/htmlunit-user > > > > > > > > > > > > |
189 messages has been excluded from this view by a project administrator.
