[Htmlunit-user] Problem to click Anchor Tag Embedded with AJax and Javascript.

[gaurab.pradhan <gau...@gm...>]

Hello to All,

I am new to Htmlunit, I am using Htmlunit 2.13 to crawl web site, i can
handle java script webpages easily using Htmlunit, but from couple of days i
have having problem, current i am trying to crawl some information from
webpage, that webpage is made using Ajax and other stuff.
I am not getting desired pages after clicking anchor tag.
 On the web page link is embedded in following way.

there are multiple of this type of links i need to go to each of links.
Here is my code:
WebClient client = new WebClient(BrowserVersion.CHROME); //i have tried with
FIREFOX_17 as well 
LogFactory.getFactory().setAttribute("org.apache.commons.logging.Log",
"org.apache.commons.logging.impl.NoOpLog");
java.util.logging.Logger.getLogger("com.gargoylesoftware.htmlunit").setLevel(Level.OFF);
java.util.logging.Logger.getLogger("org.apache.commons.httpclient").setLevel(Level.OFF);

client.setAjaxController(new NicelyResynchronizingAjaxController());
client.waitForBackgroundJavaScript(10000);
client.waitForBackgroundJavaScriptStartingBefore(10000);
client.getOptions().setCssEnabled(true);
client.setCssErrorHandler(new SilentCssErrorHandler());
client.getOptions().setThrowExceptionOnFailingStatusCode(false);
client.getOptions().setThrowExceptionOnScriptError(false);
client.getOptions().setRedirectEnabled(true);
client.getOptions().setAppletEnabled(false);
client.getOptions().setJavaScriptEnabled(true);
client.getOptions().setPopupBlockerEnabled(true);
client.getOptions().setTimeout(5000);
client.getOptions().setPrintContentOnFailingStatusCode(false);
client.getOptions().setUseInsecureSSL(true);
HtmlPage homePage = client.getPage("SomeURL");
synchronized (homePage) {
                homePage.wait(5000);
            }
List <#> <HtmlAnchor> anchors = new ArrayList<HtmlAnchor>();
anchors = homePage.getAnchors();
HtmlPage tempPage = null;
for (int i = 0; i < anchors.size(); i++) {
       tempPage = anchors.get(i).click();
       String secondLink = homePage.getUrl().toString();
       System.out.println("LINK TO GET DOCUMENTS     = " + secondLink);
       client.waitForBackgroundJavaScript(10000);
       client.waitForBackgroundJavaScriptStartingBefore(10000);
    }

Please Help me to go out of this problem..
Thanks,
Gaurab Pradhan



--
View this message in context: http://htmlunit.10904.n7.nabble.com/Problem-to-click-Anchor-Tag-Embedded-with-AJax-and-Javascript-tp32518.html
Sent from the HtmlUnit - General mailing list archive at Nabble.com.